Trace number 4409016

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1391.51 1393.45

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-09-024-008.xml
MD5SUM0092e4980ed4af349e39cdcd3a0de294
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.68622
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size23
Distribution of domain sizes[{"size":2,"count":216},{"size":23,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":216},{"degree":37,"count":1}]
Minimum constraint arity24
Maximum constraint arity216
Distribution of constraint arities[{"arity":24,"count":9},{"arity":49,"count":36},{"arity":216,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (868 MiB free)
  memory of node 1: 16384 MiB (15043 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409016-1569794542/watcher-4409016-1569794542 -o /tmp/evaluation-result-4409016-1569794542/solver-4409016-1569794542 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1569787351-8456 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409016-1569794542.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Linux 3.10.0-514.16.1.el
solver pid=9758, runsolver pid=9755
Current StackSize limit: 8192 KiB


[startup+0.100677 s]*
/proc/loadavg: 2.38 2.07 2.02 3/202 9759
/proc/meminfo: memFree=16287744/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=28300 memory=4744 CPUtime=0.08 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 1363 0 1 0 8 0 0 0 20 0 1 0 555394162 28979200 1186 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 7075 1186 845 493 0 380 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 28300 KiB
Current children cumulated memory: 4744 KiB

[startup+0.209778 s]*
/proc/loadavg: 2.38 2.07 2.02 3/202 9759
/proc/meminfo: memFree=16285328/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=29544 memory=5800 CPUtime=0.19 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 1657 0 1 0 19 0 0 0 20 0 1 0 555394162 30253056 1450 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 7386 1450 846 493 0 691 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 29544 KiB
Current children cumulated memory: 5800 KiB

[startup+0.309466 s]*
/proc/loadavg: 2.38 2.07 2.02 3/202 9759
/proc/meminfo: memFree=16283872/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=30552 memory=6980 CPUtime=0.28 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 1926 0 1 0 28 0 0 0 20 0 1 0 555394162 31285248 1745 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 7638 1745 846 493 0 943 0
Current children cumulated CPU time: 0.28 s
Current children cumulated vsize: 30552 KiB
Current children cumulated memory: 6980 KiB

[startup+0.700334 s]
/proc/loadavg: 2.38 2.07 2.02 3/202 9760
/proc/meminfo: memFree=16281188/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=34828 memory=11220 CPUtime=0.67 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2984 0 1 0 66 1 0 0 20 0 1 0 555394162 35663872 2805 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 8707 2805 846 493 0 2012 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 34828 KiB
Current children cumulated memory: 11220 KiB

[startup+1.50029 s]
/proc/loadavg: 2.38 2.07 2.02 3/204 9762
/proc/meminfo: memFree=16264912/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=43988 memory=20216 CPUtime=1.47 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 5224 0 1 0 146 1 0 0 20 0 1 0 555394162 45043712 5054 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 10997 5054 846 493 0 4302 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 43988 KiB
Current children cumulated memory: 20216 KiB

[startup+3.10943 s]
/proc/loadavg: 2.38 2.07 2.02 3/201 9762
/proc/meminfo: memFree=16536524/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=62352 memory=38128 CPUtime=3.08 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 9776 0 1 0 306 2 0 0 20 0 1 0 555394162 63848448 9532 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 15588 9532 846 493 0 8893 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 62352 KiB
Current children cumulated memory: 38128 KiB

[startup+6.30027 s]
/proc/loadavg: 2.27 2.05 2.02 3/201 9762
/proc/meminfo: memFree=16479496/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=99348 memory=73960 CPUtime=6.27 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 18769 0 1 0 624 3 0 0 20 0 1 0 555394162 101732352 18490 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 24837 18490 846 493 0 18142 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 99348 KiB
Current children cumulated memory: 73960 KiB

[startup+12.7003 s]
/proc/loadavg: 2.25 2.05 2.02 3/201 9764
/proc/meminfo: memFree=16367588/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=169592 memory=145644 CPUtime=12.67 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 36750 0 1 0 1262 5 0 0 20 0 1 0 555394162 173662208 36411 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 42398 36411 846 493 0 35703 0
Current children cumulated CPU time: 12.67 s
Current children cumulated vsize: 169592 KiB
Current children cumulated memory: 145644 KiB

[startup+25.5003 s]
/proc/loadavg: 2.19 2.05 2.02 3/201 9764
/proc/meminfo: memFree=16124104/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=315800 memory=290252 CPUtime=25.47 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 71477 0 1 0 2536 11 0 0 20 0 1 0 555394162 323379200 72563 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 78950 72563 846 493 0 72255 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 315800 KiB
Current children cumulated memory: 290252 KiB

[startup+51.1095 s]
/proc/loadavg: 2.13 2.04 2.02 3/201 9764
/proc/meminfo: memFree=15639216/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=611312 memory=576772 CPUtime=51.07 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 139598 0 1 0 5087 20 0 0 20 0 1 0 555394162 625983488 144193 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 152828 144193 846 493 0 146133 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 611312 KiB
Current children cumulated memory: 576772 KiB

[startup+102.3 s]
/proc/loadavg: 2.05 2.04 2.02 3/201 9770
/proc/meminfo: memFree=14685568/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=1209024 memory=1149180 CPUtime=102.27 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 274484 0 1 0 10190 37 0 0 20 0 1 0 555394162 1238040576 287295 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 302256 287295 846 493 0 295561 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1209024 KiB
Current children cumulated memory: 1149180 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.03 2.02 3/201 9774
/proc/meminfo: memFree=13562492/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=1893920 memory=1821620 CPUtime=162.27 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 432426 0 1 0 16171 56 0 0 20 0 1 0 555394162 1939374080 455405 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 473480 455405 846 493 0 466785 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 1893920 KiB
Current children cumulated memory: 1821620 KiB

[startup+222.3 s]
/proc/loadavg: 2.88 2.23 2.09 3/200 9843
/proc/meminfo: memFree=28424400/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=2521052 memory=2494792 CPUtime=222.27 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 589479 0 1 0 22151 76 0 0 20 0 1 0 555394162 2581557248 623698 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 630263 623698 846 493 0 623568 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2521052 KiB
Current children cumulated memory: 2494792 KiB

[startup+282.3 s]
/proc/loadavg: 2.40 2.21 2.09 3/200 9849
/proc/meminfo: memFree=27751444/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=3234180 memory=3166348 CPUtime=282.25 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 747224 0 1 0 28127 98 0 0 20 0 1 0 555394162 3311800320 791587 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 808545 791587 846 493 0 801850 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 3234180 KiB
Current children cumulated memory: 3166348 KiB

[startup+342.3 s]
/proc/loadavg: 2.50 2.29 2.12 3/200 9854
/proc/meminfo: memFree=27078316/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=3986804 memory=3838624 CPUtime=342.23 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 904639 0 1 0 34105 118 0 0 20 0 1 0 555394162 4082487296 959656 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 996701 959656 846 493 0 990006 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 3986804 KiB
Current children cumulated memory: 3838624 KiB

[startup+402.3 s]
/proc/loadavg: 2.18 2.23 2.12 3/200 9859
/proc/meminfo: memFree=26404920/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=4617440 memory=4512592 CPUtime=402.21 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 1062479 0 1 0 40081 140 0 0 20 0 1 0 555394162 4728258560 1128148 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 1154360 1128148 846 493 0 1147665 0
Current children cumulated CPU time: 402.21 s
Current children cumulated vsize: 4617440 KiB
Current children cumulated memory: 4512592 KiB

[startup+462.3 s]
/proc/loadavg: 2.07 2.19 2.11 3/200 9865
/proc/meminfo: memFree=25730744/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=5249564 memory=5183040 CPUtime=462.2 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 1219946 0 1 0 46056 164 0 0 20 0 1 0 555394162 5375553536 1295760 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 1312391 1295760 846 493 0 1305696 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 5249564 KiB
Current children cumulated memory: 5183040 KiB


################
# More data... #
################

Current children cumulated vsize: 9488500 KiB
Current children cumulated memory: 9218816 KiB

[startup+882.3 s]
/proc/loadavg: 2.01 2.07 2.09 3/199 9906
/proc/meminfo: memFree=21012240/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=10115632 memory=9889552 CPUtime=882.1 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2321129 0 1 0 87869 341 0 0 20 0 1 0 555394162 10358407168 2472388 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 2528908 2472388 846 493 0 2522213 0
Current children cumulated CPU time: 882.1 s
Current children cumulated vsize: 10115632 KiB
Current children cumulated memory: 9889552 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.06 2.08 3/199 9910
/proc/meminfo: memFree=20337768/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=10753436 memory=10562916 CPUtime=942.09 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2478316 0 1 0 93839 370 0 0 20 0 1 0 555394162 11011518464 2640729 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 2688359 2640729 846 493 0 2681664 0
Current children cumulated CPU time: 942.09 s
Current children cumulated vsize: 10753436 KiB
Current children cumulated memory: 10562916 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.05 2.08 3/199 9916
/proc/meminfo: memFree=19666248/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=11380568 memory=11233072 CPUtime=1002.07 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2635266 0 1 0 99808 399 0 0 20 0 1 0 555394162 11653701632 2808268 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 2845142 2808268 846 493 0 2838447 0
Current children cumulated CPU time: 1002.07 s
Current children cumulated vsize: 11380568 KiB
Current children cumulated memory: 11233072 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.04 2.07 3/199 9920
/proc/meminfo: memFree=18993412/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=12007436 memory=11904856 CPUtime=1062.05 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2792104 0 1 0 105775 430 0 0 20 0 1 0 555394162 12295614464 2976214 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3001859 2976214 846 493 0 2995164 0
Current children cumulated CPU time: 1062.05 s
Current children cumulated vsize: 12007436 KiB
Current children cumulated memory: 11904856 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/199 9931
/proc/meminfo: memFree=18320344/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=12634172 memory=12576792 CPUtime=1122.04 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 2948972 0 1 0 111743 461 0 0 20 0 1 0 555394162 12937392128 3144198 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3158543 3144198 846 493 0 3151848 0
Current children cumulated CPU time: 1122.04 s
Current children cumulated vsize: 12634172 KiB
Current children cumulated memory: 12576792 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/199 9937
/proc/meminfo: memFree=17647676/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=13681068 memory=13248004 CPUtime=1182.02 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 3106194 0 1 0 117709 493 0 0 20 0 1 0 555394162 14009413632 3312001 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3420267 3312001 846 493 0 3413572 0
Current children cumulated CPU time: 1182.02 s
Current children cumulated vsize: 13681068 KiB
Current children cumulated memory: 13248004 KiB

[startup+1242.3 s]
/proc/loadavg: 2.06 2.04 2.06 3/199 9941
/proc/meminfo: memFree=16975192/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=14307276 memory=13919148 CPUtime=1242.01 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 3262887 0 1 0 123676 525 0 0 20 0 1 0 555394162 14650650624 3479787 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3576819 3479787 846 493 0 3570124 0
Current children cumulated CPU time: 1242.01 s
Current children cumulated vsize: 14307276 KiB
Current children cumulated memory: 13919148 KiB

[startup+1302.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/199 9945
/proc/meminfo: memFree=16305088/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=14933484 memory=14590556 CPUtime=1302 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 3419620 0 1 0 129640 560 0 0 20 0 1 0 555394162 15291887616 3647639 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3733371 3647639 846 493 0 3726676 0
Current children cumulated CPU time: 1302 s
Current children cumulated vsize: 14933484 KiB
Current children cumulated memory: 14590556 KiB

[startup+1362.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/199 9951
/proc/meminfo: memFree=15631808/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15575964 memory=15260220 CPUtime=1361.98 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 3576407 0 1 0 135603 595 0 0 20 0 1 0 555394162 15949787136 3815055 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3893991 3815055 846 493 0 3887296 0
Current children cumulated CPU time: 1361.98 s
Current children cumulated vsize: 15575964 KiB
Current children cumulated memory: 15260220 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1390.7 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 9952
/proc/meminfo: memFree=15319852/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15872040 memory=15577640 CPUtime=1390.37 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) R 9755 9758 8424 0 -1 4202496 3650783 0 1 0 138427 610 0 0 20 0 1 0 555394162 16252968960 3894410 33554432000 4194304 6211132 140722843739888 140722843724360 140058956258277 0 0 4096 8405026 0 0 0 17 1 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3968010 3894410 846 493 0 3961315 0
Current children cumulated CPU time: 1390.37 s
Current children cumulated vsize: 15872040 KiB
Current children cumulated memory: 15577640 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1393.45 s]
# the end of solver process 9758 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1384.61 s, system=6.89846 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1392 s]*
/proc/loadavg: 2.01 2.02 2.05 3/200 9953
/proc/meminfo: memFree=14573168/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15872040 memory=15577900 CPUtime=1390.62 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) S 9755 9758 8424 0 -1 512 3650787 0 1 0 138449 613 0 0 20 0 1 0 555394162 16252968960 3894475 33554432000 4194304 6211132 140722843739888 140722843724360 5189800 0 16384 4096 8405026 0 0 0 17 5 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3968010 3894475 847 493 0 3961315 0
Current children cumulated CPU time: 1390.62 s
Current children cumulated vsize: 15872040 KiB
Current children cumulated memory: 15577900 KiB

[startup+1392.4 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 9953
/proc/meminfo: memFree=14573168/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15872040 memory=15577900 CPUtime=1390.69 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) S 9755 9758 8424 0 -1 512 3650787 0 1 0 138455 614 0 0 20 0 1 0 555394162 16252968960 3894475 33554432000 4194304 6211132 140722843739888 140722843724360 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3968010 3894475 847 493 0 3961315 0
Current children cumulated CPU time: 1390.69 s
Current children cumulated vsize: 15872040 KiB
Current children cumulated memory: 15577900 KiB

[startup+1392.6 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 9953
/proc/meminfo: memFree=14573168/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15872040 memory=15577900 CPUtime=1390.73 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) S 9755 9758 8424 0 -1 512 3650787 0 1 0 138459 614 0 0 20 0 1 0 555394162 16252968960 3894475 33554432000 4194304 6211132 140722843739888 140722843724360 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3968010 3894475 847 493 0 3961315 0
Current children cumulated CPU time: 1390.73 s
Current children cumulated vsize: 15872040 KiB
Current children cumulated memory: 15577900 KiB

[startup+1392.7 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 9953
/proc/meminfo: memFree=14573168/32770624 swapFree=66976580/67108860
[pid=9758] ppid=9755 vsize=15872040 memory=15577900 CPUtime=1390.75 cores=1,3,5,7
/proc/9758/stat : 9758 (cosoco) S 9755 9758 8424 0 -1 512 3650787 0 1 0 138461 614 0 0 20 0 1 0 555394162 16252968960 3894475 33554432000 4194304 6211132 140722843739888 140722843724360 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 1 0 0 8312316 8317760 35373056 140722843743243 140722843743345 140722843743345 140722843746254 0
/proc/9758/statm: 3968010 3894475 847 493 0 3961315 0
Current children cumulated CPU time: 1390.75 s
Current children cumulated vsize: 15872040 KiB
Current children cumulated memory: 15577900 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1393.45
CPU time (s): 1391.51
CPU user time (s): 1384.61
CPU system time (s): 6.89846
CPU usage (%): 99.8604
Max. virtual memory (cumulated for all children) (KiB): 15872040
Max. memory (cumulated for all children) (KiB): 15577900

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1384.61
system time used= 6.89846
maximum resident set size= 15577900
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3650787
page faults= 1
swaps= 0
block input operations= 9984
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 141856
involuntary context switches= 1474


# summary of solver processes directly reported to runsolver:
#   pid: 9758
#   total CPU time (s): 1391.51
#   total CPU user time (s): 1384.61
#   total CPU system time (s): 6.89846

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.18328 second user time and 9.09815 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-30 00:01:40
IDJOB=4409016
IDBENCH=122987
IDSOLVER=2876
FILE ID=node124/4409016-1569794542
RUNJOBID= node124-1569787351-8456
PBS_JOBID= 21705829
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-09-024-008.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409016-1569794542/watcher-4409016-1569794542 -o /tmp/evaluation-result-4409016-1569794542/solver-4409016-1569794542 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1569787351-8456 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409016-1569794542.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0092e4980ed4af349e39cdcd3a0de294
RANDOM SEED=843305118

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        16294244 kB
MemAvailable:   17450184 kB
Buffers:          103548 kB
Cached:          1390252 kB
SwapCached:        29128 kB
Active:         15082912 kB
Inactive:         809368 kB
Active(anon):   14225752 kB
Inactive(anon):   254500 kB
Active(file):     857160 kB
Inactive(file):   554868 kB
Unevictable:      108852 kB
Mlocked:          108852 kB
SwapTotal:      67108860 kB
SwapFree:       66976580 kB
Dirty:              2740 kB
Writeback:         43916 kB
AnonPages:      14479332 kB
Mapped:            30216 kB
Shmem:             73488 kB
Slab:             149972 kB
SReclaimable:     119496 kB
SUnreclaim:        30476 kB
KernelStack:        3536 kB
PageTables:        33784 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:   14946688 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     94208 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61476 MiB
End job on node124 at 2019-09-30 00:24:53