Trace number 4266558

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco-sat 1.12Signal 43.572899 686.27301

General information on the benchmark

NameWwtpp/Wwtpp-ord-s1/
Wwtpp-ord-ex03380.xml
MD5SUM4b7737b348ce8099143a34a20635223c
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.400709
Satisfiable
(Un)Satisfiability was proved
Number of variables476
Number of constraints402
Number of domains22
Minimum domain size1
Maximum domain size10001
Distribution of domain sizes[{"size":1,"count":22},{"size":2,"count":92},{"size":1001,"count":46},{"size":1501,"count":46},{"size":2501,"count":46},{"size":3001,"count":46},{"size":5001,"count":88},{"size":10001,"count":90}]
Minimum variable degree1
Maximum variable degree3
Distribution of variable degrees[{"degree":1,"count":16},{"degree":2,"count":29},{"degree":3,"count":431}]
Minimum constraint arity2
Maximum constraint arity24
Distribution of constraint arities[{"arity":2,"count":189},{"arity":3,"count":96},{"arity":4,"count":90},{"arity":10,"count":4},{"arity":11,"count":7},{"arity":12,"count":7},{"arity":13,"count":5},{"arity":14,"count":2},{"arity":23,"count":1},{"arity":24,"count":1}]
Number of extensional constraints192
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":192},{"type":"sum","count":210}]
Optimization problemNO
Type of objective

Solver Data 

33.68/33.78	terminate called after throwing an instance of 'Glucose::OutOfMemoryException'
33.68/33.78	c
33.68/33.78	c This is cosoco 1.12 --  
33.68/33.78	c
33.68/33.78	c command line: cosoco -lc -model -restarts -sat HOME/instance-4266558-1502596440.xml

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14443 MiB free)
  memory of node 1: 16384 MiB (14736 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4266558-1502596440/watcher-4266558-1502596440 -o /tmp/evaluation-result-4266558-1502596440/solver-4266558-1502596440 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node113-1502567255-24899 --watchdog 2580 cosoco -lc -model -restarts -sat HOME/instance-4266558-1502596440.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29644, runsolver pid=29641

[startup+0.10016 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=29751440/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=155288 memory=131556 CPUtime=0.1 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 33125 0 0 0 6 4 0 0 20 0 1 0 92731702 159014912 32889 33554432000 4194304 5972588 140730701158320 140730701154968 139907665611749 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 38822 32889 749 435 0 32185 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 155288 KiB
Current children cumulated memory: 131556 KiB

[startup+0.209742 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=29704196/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=202532 memory=178804 CPUtime=0.21 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 45130 0 0 0 16 5 0 0 20 0 1 0 92731702 207392768 44701 33554432000 4194304 5972588 140730701158320 140730701154968 5675835 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 50633 44701 749 435 0 43996 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 202532 KiB
Current children cumulated memory: 178804 KiB

[startup+0.309724 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=29670464/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=244760 memory=219152 CPUtime=0.31 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 53723 0 0 0 24 7 0 0 20 0 1 0 92731702 250634240 54788 33554432000 4194304 5972588 140730701158320 140730701154968 5252461 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 61190 54788 783 435 0 54553 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 244760 KiB
Current children cumulated memory: 219152 KiB

[startup+0.700404 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=29567508/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=474144 memory=404464 CPUtime=0.69 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 80120 0 0 0 58 11 0 0 20 0 1 0 92731702 485523456 101116 33554432000 4194304 5972588 140730701158320 140730701155112 5252461 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 118536 101116 783 435 0 111899 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 474144 KiB
Current children cumulated memory: 404464 KiB

[startup+1.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=29321696/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=910336 memory=784304 CPUtime=1.49 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 129092 0 0 0 128 21 0 0 20 0 1 0 92731702 932184064 196076 33554432000 4194304 5972588 140730701158320 140730701155112 5252461 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 227584 196076 783 435 0 220947 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 910336 KiB
Current children cumulated memory: 784304 KiB

[startup+3.10965 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=28453888/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=1508132 memory=1461988 CPUtime=3.1 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 224614 0 0 0 273 37 0 0 20 0 1 0 92731702 1544327168 365497 33554432000 4194304 5972588 140730701158320 140730701155112 139907665681242 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 377033 365497 783 435 0 370396 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 1508132 KiB
Current children cumulated memory: 1461988 KiB

[startup+6.30037 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=27118208/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=3269548 memory=2872424 CPUtime=6.29 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 432484 0 0 0 556 73 0 0 20 0 1 0 92731702 3348017152 718106 33554432000 4194304 5972588 140730701158320 140730701155112 5252508 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 817387 718106 783 435 0 810750 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 3269548 KiB
Current children cumulated memory: 2872424 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29645
/proc/meminfo: memFree=24530452/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=5869448 memory=5628268 CPUtime=12.69 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 806662 0 0 0 1128 141 0 0 20 0 1 0 92731702 6010314752 1406555 33554432000 4194304 5972588 140730701158320 140730701155112 5280404 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 1467362 1406555 783 435 0 1460725 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 5869448 KiB
Current children cumulated memory: 5628268 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29653
/proc/meminfo: memFree=18824804/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=13310864 memory=11252648 CPUtime=25.48 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) R 29641 29644 24815 0 -1 4202496 1459349 0 0 0 2271 277 0 0 20 0 1 0 92731702 13630324736 2813162 33554432000 4194304 5972588 140730701158320 140730701155112 5252508 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3327716 2813162 783 435 0 3321079 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 13310864 KiB
Current children cumulated memory: 11252648 KiB

[startup+51.1097 s]
/proc/loadavg: 2.60 2.14 2.09 2/189 29654
/proc/meminfo: memFree=9186856/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14863632 CPUtime=35.39 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3153 386 0 0 20 0 1 0 92731702 15424270336 3715908 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 1 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3715908 783 435 0 3759054 0
Current children cumulated CPU time: 35.39 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14863632 KiB
heavy processes:
  %CPU=65 pid=29654 uid=0 cmd=

[startup+102.3 s]
/proc/loadavg: 3.96 2.58 2.24 2/190 29656
/proc/meminfo: memFree=7486016/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14863632 CPUtime=35.89 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3197 392 0 0 20 0 1 0 92731702 15424270336 3715908 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3715908 783 435 0 3759054 0
Current children cumulated CPU time: 35.89 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14863632 KiB
heavy processes:
  %CPU=21 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+162.3 s]
/proc/loadavg: 4.62 3.02 2.41 3/190 29657
/proc/meminfo: memFree=4642560/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14864192 CPUtime=36.69 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3267 402 0 0 20 0 1 0 92731702 15424270336 3716048 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 3 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3716048 783 435 0 3759054 0
Current children cumulated CPU time: 36.69 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14864192 KiB
heavy processes:
  %CPU=16 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+222.3 s]
/proc/loadavg: 4.86 3.38 2.58 2/190 29658
/proc/meminfo: memFree=1677100/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14865560 CPUtime=37.53 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3340 413 0 0 20 0 1 0 92731702 15424270336 3716390 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3716390 783 435 0 3759054 0
Current children cumulated CPU time: 37.53 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14865560 KiB
heavy processes:
  %CPU=14 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+282.301 s]
/proc/loadavg: 4.95 3.68 2.73 2/190 29659
/proc/meminfo: memFree=1099760/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14866476 CPUtime=38.4 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3416 424 0 0 20 0 1 0 92731702 15424270336 3716619 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3716619 783 435 0 3759054 0
Current children cumulated CPU time: 38.4 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14866476 KiB
heavy processes:
  %CPU=13 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+342.3 s]
/proc/loadavg: 5.03 3.93 2.87 2/189 29660
/proc/meminfo: memFree=382176/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14867732 CPUtime=39.24 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3488 436 0 0 20 0 1 0 92731702 15424270336 3716933 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 3 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3716933 783 435 0 3759054 0
Current children cumulated CPU time: 39.24 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14867732 KiB
heavy processes:
  %CPU=12 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+402.301 s]
/proc/loadavg: 5.06 4.14 3.01 2/189 29661
/proc/meminfo: memFree=190180/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14869388 CPUtime=40.4 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3585 455 0 0 20 0 1 0 92731702 15424270336 3717347 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717347 783 435 0 3759054 0
Current children cumulated CPU time: 40.4 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14869388 KiB
heavy processes:
  %CPU=12 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+462.3 s]
/proc/loadavg: 5.02 4.30 3.14 2/189 29662
/proc/meminfo: memFree=201912/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14869388 CPUtime=41.81 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879462 0 0 0 3701 480 0 0 20 0 1 0 92731702 15424270336 3717347 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071580971376 0 0 17 1 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717347 783 435 0 3759054 0
Current children cumulated CPU time: 41.81 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14869388 KiB
heavy processes:
  %CPU=13 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+522.3 s]
/proc/loadavg: 5.12 4.46 3.26 2/189 29663
/proc/meminfo: memFree=254172/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14869800 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717450 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717450 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14869800 KiB
heavy processes:
  %CPU=12 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+590.844 s]
/proc/loadavg: 6.21 4.90 3.50 3/189 29664
/proc/meminfo: memFree=294248/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14870852 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717713 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717713 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14870852 KiB
heavy processes:
  %CPU=12 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+642.3 s]
/proc/loadavg: 5.26 4.84 3.56 2/190 29673
/proc/meminfo: memFree=340744/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB
heavy processes:
  %CPU=11 pid=29654 uid=0 cmd=/usr/libexec/abrt-hook-ccpp 6 18446744073709551615 29644 506 1001 1502595616 e 29644 29644 

[startup+686.273 s]
# the end of solver process 29644 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=37.8908 s, system=5.68211 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+657.2 s]
/proc/loadavg: 5.13 4.83 3.57 2/190 29673
/proc/meminfo: memFree=386452/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+670 s]
/proc/loadavg: 4.88 4.79 3.58 2/190 29673
/proc/meminfo: memFree=386516/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+676.4 s]*
/proc/loadavg: 4.81 4.78 3.58 2/190 29673
/proc/meminfo: memFree=386424/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+682.8 s]
/proc/loadavg: 4.75 4.77 3.59 2/190 29674
/proc/meminfo: memFree=385620/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+684.4 s]*
/proc/loadavg: 4.69 4.75 3.59 2/190 29674
/proc/meminfo: memFree=384656/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+685.2 s]
/proc/loadavg: 4.69 4.75 3.59 2/190 29674
/proc/meminfo: memFree=384656/32770624 swapFree=67108860/67108860
[pid=29644] ppid=29641 vsize=15062764 memory=14871228 CPUtime=42.93 cores=1,3,5,7
/proc/29644/stat : 29644 (cosoco) S 29641 29644 24815 0 -1 512 1879463 0 0 0 3789 504 0 0 20 0 1 0 92731702 15424270336 3717807 33554432000 4194304 5972588 140730701158320 140730701155368 139907665314263 0 0 4096 0 18446744071581338616 0 0 17 5 0 0 0 0 0 8070896 8075904 24862720 140730701165754 140730701165854 140730701165854 140730701168590 0
/proc/29644/statm: 3765691 3717807 783 435 0 3759054 0
Current children cumulated CPU time: 42.93 s
Current children cumulated vsize: 15062764 KiB
Current children cumulated memory: 14871228 KiB

[startup+686 s]
/proc/loadavg: 4.69 4.75 3.59 3/190 29675
/proc/meminfo: memFree=2023392/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+686.2 s]
/proc/loadavg: 4.69 4.75 3.59 3/190 29675
/proc/meminfo: memFree=2023392/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child ended because it received signal 6 (SIGABRT)
Child dumped core
Real time (s): 686.273
CPU time (s): 43.5729
CPU user time (s): 37.8908
CPU system time (s): 5.68211
CPU usage (%): 6.34921
Max. virtual memory (cumulated for all children) (KiB): 15062764
Max. memory (cumulated for all children) (KiB): 14871228

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 37.8908
system time used= 5.68211
maximum resident set size= 14871396
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1879463
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3726592
involuntary context switches= 39


# summary of solver processes directly reported to runsolver:
#   pid: 29644
#   total CPU time (s): 43.5729
#   total CPU user time (s): 37.8908
#   total CPU system time (s): 5.68211

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 2.50068 second user time and 4.67863 second system time

The end

Launcher Data 

Begin job on node113 at 2017-08-13 05:39:42
IDJOB=4266558
IDBENCH=140669
IDSOLVER=2655
FILE ID=node113/4266558-1502596440
RUNJOBID= node113-1502567255-24899
PBS_JOBID= 20628282
Free space on /tmp= 61808 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/Wwtpp/Wwtpp-ord-s1/Wwtpp-ord-ex03380.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4266558-1502596440/watcher-4266558-1502596440 -o /tmp/evaluation-result-4266558-1502596440/solver-4266558-1502596440 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node113-1502567255-24899 --watchdog 2580  cosoco -lc -model -restarts -sat HOME/instance-4266558-1502596440.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4b7737b348ce8099143a34a20635223c
RANDOM SEED=1682472685

node113.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29880332 kB
MemAvailable:   31958088 kB
Buffers:          116588 kB
Cached:          2244512 kB
SwapCached:            0 kB
Active:           485204 kB
Inactive:        1958480 kB
Active(anon):      31044 kB
Inactive(anon):    79328 kB
Active(file):     454160 kB
Inactive(file):  1879152 kB
Unevictable:        6572 kB
Mlocked:            6572 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2796 kB
Writeback:             0 kB
AnonPages:         97124 kB
Mapped:            44708 kB
Shmem:             25224 kB
Slab:             146108 kB
SReclaimable:     120560 kB
SUnreclaim:        25548 kB
KernelStack:        3568 kB
PageTables:         5212 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     381344 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     38912 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 47352 MiB
End job on node113 at 2017-08-13 05:51:09