Trace number 4408193

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (MO) 2038.5 2040.28

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-85-085-36-36-15.xml
MD5SUMe7b94b237cf4deebd8c7bf96e74cfc29
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7225
Number of constraints3741
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":7225}]
Minimum variable degree87
Maximum variable degree87
Distribution of variable degrees[{"degree":87,"count":7225}]
Minimum constraint arity85
Maximum constraint arity7225
Distribution of constraint arities[{"arity":85,"count":170},{"arity":170,"count":3570},{"arity":7225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":3740}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14856 MiB free)
  memory of node 1: 16384 MiB (13795 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408193-1569792700/watcher-4408193-1569792700 -o /tmp/evaluation-result-4408193-1569792700/solver-4408193-1569792700 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408193-1569792700.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=31142, runsolver pid=31139

[startup+0.100195 s]*
/proc/loadavg: 2.32 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29333372/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=38096 memory=14308 CPUtime=0.1 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3802 0 0 0 10 0 0 0 20 0 1 0 555184743 39010304 3577 33554432000 4194304 6211132 140735088808192 140735088804728 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 9524 3577 842 493 0 2829 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38096 KiB
Current children cumulated memory: 14308 KiB

[startup+0.209827 s]*
/proc/loadavg: 2.32 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29321656/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=38920 memory=15364 CPUtime=0.21 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 4015 0 0 0 21 0 0 0 20 0 1 0 555184743 39854080 3841 33554432000 4194304 6211132 140735088808192 140735088804728 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 9730 3841 842 493 0 3035 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38920 KiB
Current children cumulated memory: 15364 KiB

[startup+0.309818 s]*
/proc/loadavg: 2.32 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29322432/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=39732 memory=16156 CPUtime=0.31 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 4210 0 0 0 31 0 0 0 20 0 1 0 555184743 40685568 4039 33554432000 4194304 6211132 140735088808192 140735088769432 5451653 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 9933 4039 842 493 0 3238 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 39732 KiB
Current children cumulated memory: 16156 KiB

[startup+0.700384 s]
/proc/loadavg: 2.32 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29313792/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=42716 memory=19060 CPUtime=0.69 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 4949 0 0 0 69 0 0 0 20 0 1 0 555184743 43741184 4765 33554432000 4194304 6211132 140735088808192 140735088769432 5451568 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 10679 4765 842 493 0 3984 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 42716 KiB
Current children cumulated memory: 19060 KiB

[startup+1.50042 s]
/proc/loadavg: 2.32 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29297872/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=48912 memory=25248 CPUtime=1.49 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 6498 0 0 0 149 0 0 0 20 0 1 0 555184743 50085888 6312 33554432000 4194304 6211132 140735088808192 140735088769432 5443128 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 12228 6312 842 493 0 5533 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48912 KiB
Current children cumulated memory: 25248 KiB

[startup+3.10978 s]
/proc/loadavg: 2.29 2.09 2.03 3/202 31143
/proc/meminfo: memFree=29627880/32770624 swapFree=66954172/67108860
[pid=31142] ppid=31139 vsize=61372 memory=37736 CPUtime=3.1 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 9685 0 0 0 310 0 0 0 20 0 1 0 555184743 62844928 9434 33554432000 4194304 6211132 140735088808192 140735088769432 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 15343 9434 842 493 0 8648 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 61372 KiB
Current children cumulated memory: 37736 KiB

[startup+6.30034 s]
/proc/loadavg: 2.29 2.09 2.03 3/202 31148
/proc/meminfo: memFree=29972724/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=86240 memory=62344 CPUtime=6.3 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 15930 0 0 0 628 2 0 0 20 0 1 0 555184743 88309760 15586 33554432000 4194304 6211132 140735088808192 140735088769432 5455682 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 21560 15586 842 493 0 14865 0
Current children cumulated CPU time: 6.3 s
Current children cumulated vsize: 86240 KiB
Current children cumulated memory: 62344 KiB

[startup+12.7003 s]
/proc/loadavg: 2.27 2.09 2.03 3/202 31148
/proc/meminfo: memFree=29869372/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=136548 memory=112132 CPUtime=12.69 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 28414 0 0 0 1266 3 0 0 20 0 1 0 555184743 139825152 28033 33554432000 4194304 6211132 140735088808192 140735088769432 140683826182982 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 34137 28033 842 493 0 27442 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 136548 KiB
Current children cumulated memory: 112132 KiB

[startup+25.5004 s]
/proc/loadavg: 2.21 2.09 2.03 3/201 31148
/proc/meminfo: memFree=29643748/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=235272 memory=211372 CPUtime=25.49 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 53404 0 0 0 2542 7 0 0 20 0 1 0 555184743 240918528 52843 33554432000 4194304 6211132 140735088808192 140735088769432 140683826182996 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 58818 52843 842 493 0 52123 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 235272 KiB
Current children cumulated memory: 211372 KiB

[startup+51.1098 s]
/proc/loadavg: 2.14 2.08 2.03 3/202 31151
/proc/meminfo: memFree=29191836/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=435636 memory=411848 CPUtime=51.1 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 103032 0 0 0 5098 12 0 0 20 0 1 0 555184743 446091264 102962 33554432000 4194304 6211132 140735088808192 140735088769432 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 108909 102962 842 493 0 102214 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 435636 KiB
Current children cumulated memory: 411848 KiB

[startup+102.3 s]
/proc/loadavg: 2.06 2.07 2.03 3/202 31154
/proc/meminfo: memFree=28308196/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=836792 memory=808344 CPUtime=102.3 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 201218 0 0 0 10204 26 0 0 20 0 1 0 555184743 856875008 202086 33554432000 4194304 6211132 140735088808192 140735088769432 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 209198 202086 842 493 0 202503 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 836792 KiB
Current children cumulated memory: 808344 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.06 2.03 3/201 31158
/proc/meminfo: memFree=27269672/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=1303392 memory=1274296 CPUtime=162.29 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 315648 0 0 0 16190 39 0 0 20 0 1 0 555184743 1334673408 318574 33554432000 4194304 6211132 140735088808192 140735088769432 140683817162288 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 325848 318574 842 493 0 319153 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1303392 KiB
Current children cumulated memory: 1274296 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.04 2.03 3/201 31162
/proc/meminfo: memFree=26228204/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=1775460 memory=1740192 CPUtime=222.29 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 430103 0 0 0 22176 53 0 0 20 0 1 0 555184743 1818071040 435048 33554432000 4194304 6211132 140735088808192 140735088769432 140683816238053 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 443865 435048 842 493 0 437170 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 1775460 KiB
Current children cumulated memory: 1740192 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.03 3/200 31168
/proc/meminfo: memFree=25190252/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=2231388 memory=2204296 CPUtime=282.29 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 544104 0 0 0 28161 68 0 0 20 0 1 0 555184743 2284941312 551074 33554432000 4194304 6211132 140735088808192 140735088769432 5446292 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 557847 551074 842 493 0 551152 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2231388 KiB
Current children cumulated memory: 2204296 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/199 31172
/proc/meminfo: memFree=24150252/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=2712184 memory=2670772 CPUtime=342.29 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 658669 0 0 0 34147 82 0 0 20 0 1 0 555184743 2777276416 667693 33554432000 4194304 6211132 140735088808192 140735088769432 5446292 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 678046 667693 842 493 0 671351 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2712184 KiB
Current children cumulated memory: 2670772 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/199 31176
/proc/meminfo: memFree=23108944/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=3168244 memory=3137180 CPUtime=402.3 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 772762 0 0 0 40136 94 0 0 20 0 1 0 555184743 3244281856 784295 33554432000 4194304 6211132 140735088808192 140735088769432 5456338 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 792061 784295 842 493 0 785366 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 3168244 KiB
Current children cumulated memory: 3137180 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/200 31182
/proc/meminfo: memFree=22067732/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=3660820 memory=3603200 CPUtime=462.3 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 887364 0 0 0 46121 109 0 0 20 0 1 0 555184743 3748679680 900800 33554432000 4194304 6211132 140735088808192 140735088769432 5451580 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 915205 900800 842 493 0 908510 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 3660820 KiB
Current children cumulated memory: 3603200 KiB


################
# More data... #
################

Current children cumulated vsize: 11083780 KiB
Current children cumulated memory: 11042648 KiB

[startup+1482.3 s]
/proc/loadavg: 2.49 2.14 2.08 3/200 31293
/proc/meminfo: memFree=4416136/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=11538520 memory=11505656 CPUtime=1482.32 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 2828284 0 0 0 147756 476 0 0 20 0 1 0 555184743 11815444480 2876414 33554432000 4194304 6211132 140735088808192 140735088769432 5452189 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 2884630 2876414 842 493 0 2877935 0
Current children cumulated CPU time: 1482.32 s
Current children cumulated vsize: 11538520 KiB
Current children cumulated memory: 11505656 KiB

[startup+1542.3 s]
/proc/loadavg: 2.25 2.14 2.08 3/201 31299
/proc/meminfo: memFree=3378344/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=11993656 memory=11970024 CPUtime=1542.32 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 2942739 0 0 0 153729 503 0 0 20 0 1 0 555184743 12281503744 2992506 33554432000 4194304 6211132 140735088808192 140735088769432 5451539 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 2998414 2992506 842 493 0 2991719 0
Current children cumulated CPU time: 1542.32 s
Current children cumulated vsize: 11993656 KiB
Current children cumulated memory: 11970024 KiB

[startup+1602.3 s]
/proc/loadavg: 2.09 2.12 2.08 3/200 31303
/proc/meminfo: memFree=2339720/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=12573096 memory=12436128 CPUtime=1602.32 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3057027 0 0 0 159706 526 0 0 20 0 1 0 555184743 12874850304 3109032 33554432000 4194304 6211132 140735088808192 140735088769432 5012966 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3143274 3109032 842 493 0 3136579 0
Current children cumulated CPU time: 1602.32 s
Current children cumulated vsize: 12573096 KiB
Current children cumulated memory: 12436128 KiB

[startup+1662.3 s]
/proc/loadavg: 2.03 2.09 2.07 2/197 31313
/proc/meminfo: memFree=16395020/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=13027176 memory=12898340 CPUtime=1662.32 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3170911 0 0 0 165679 553 0 0 20 0 1 0 555184743 13339828224 3224585 33554432000 4194304 6211132 140735088808192 140735088769432 5440668 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3256794 3224585 842 493 0 3250099 0
Current children cumulated CPU time: 1662.32 s
Current children cumulated vsize: 13027176 KiB
Current children cumulated memory: 12898340 KiB

[startup+1722.3 s]
/proc/loadavg: 2.33 2.20 2.12 3/202 31380
/proc/meminfo: memFree=16840000/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=13482180 memory=13363580 CPUtime=1722.3 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3284826 0 0 0 171649 581 0 0 20 0 1 0 555184743 13805752320 3340895 33554432000 4194304 6211132 140735088808192 140735088769432 5446292 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3370545 3340895 842 493 0 3363850 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 13482180 KiB
Current children cumulated memory: 13363580 KiB

[startup+1782.3 s]
/proc/loadavg: 2.12 2.17 2.11 3/202 31392
/proc/meminfo: memFree=16375944/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=13937844 memory=13829348 CPUtime=1782.28 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3398827 0 0 0 177619 609 0 0 20 0 1 0 555184743 14272352256 3457337 33554432000 4194304 6211132 140735088808192 140735088769432 5446272 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3484461 3457337 842 493 0 3477766 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 13937844 KiB
Current children cumulated memory: 13829348 KiB

[startup+1842.3 s]
/proc/loadavg: 2.05 2.14 2.10 3/203 31422
/proc/meminfo: memFree=15910892/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=14392452 memory=14294324 CPUtime=1842.26 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3512604 0 0 0 183586 640 0 0 20 0 1 0 555184743 14737870848 3573581 33554432000 4194304 6211132 140735088808192 140735088769432 4982624 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3598113 3573581 842 493 0 3591418 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 14392452 KiB
Current children cumulated memory: 14294324 KiB

[startup+1902.3 s]
/proc/loadavg: 2.02 2.11 2.10 3/204 31428
/proc/meminfo: memFree=15447084/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=14847852 memory=14757784 CPUtime=1902.25 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3626533 0 0 0 189557 668 0 0 20 0 1 0 555184743 15204200448 3689446 33554432000 4194304 6211132 140735088808192 140735088769432 5455690 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3711963 3689446 842 493 0 3705268 0
Current children cumulated CPU time: 1902.25 s
Current children cumulated vsize: 14847852 KiB
Current children cumulated memory: 14757784 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.09 2.09 3/203 31432
/proc/meminfo: memFree=14980472/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15302988 memory=15223476 CPUtime=1962.22 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3740457 0 0 0 195524 698 0 0 20 0 1 0 555184743 15670259712 3805869 33554432000 4194304 6211132 140735088808192 140735088769432 5452274 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3825747 3805869 842 493 0 3819052 0
Current children cumulated CPU time: 1962.22 s
Current children cumulated vsize: 15302988 KiB
Current children cumulated memory: 15223476 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.07 2.09 3/201 31497
/proc/meminfo: memFree=14494480/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15758124 memory=15688716 CPUtime=2022.22 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3854325 0 0 0 201488 734 0 0 20 0 1 0 555184743 16136318976 3922179 33554432000 4194304 6211132 140735088808192 140735088769432 5446299 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3939531 3922179 842 493 0 3932836 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 15758124 KiB
Current children cumulated memory: 15688716 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2037.4 s]
/proc/loadavg: 2.00 2.07 2.08 3/201 31500
/proc/meminfo: memFree=14377504/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15872700 memory=15805260 CPUtime=2037.31 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 4202496 3883000 0 0 0 202989 742 0 0 20 0 1 0 555184743 16253644800 3951315 33554432000 4194304 6211132 140735088808192 140735088769432 140683817164224 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3968175 3951315 842 493 0 3961480 0
Current children cumulated CPU time: 2037.31 s
Current children cumulated vsize: 15872700 KiB
Current children cumulated memory: 15805260 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2040.28 s]
# the end of solver process 31142 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2030.16 s, system=8.33902 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2038.4 s]
/proc/loadavg: 2.00 2.07 2.08 3/202 31501
/proc/meminfo: memFree=14042580/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15872700 memory=15805260 CPUtime=2037.47 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) R 31139 31142 30008 0 -1 512 3883004 0 0 0 203003 744 0 0 20 0 1 0 555184743 16253644800 3951315 33554432000 4194304 6211132 140735088808192 140735088769432 5189800 0 16384 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3968175 3951315 842 493 0 3961480 0
Current children cumulated CPU time: 2037.47 s
Current children cumulated vsize: 15872700 KiB
Current children cumulated memory: 15805260 KiB

[startup+2039.2 s]
/proc/loadavg: 2.08 2.09 2.09 3/202 31501
/proc/meminfo: memFree=13515924/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15872700 memory=15805260 CPUtime=2037.58 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) S 31139 31142 30008 0 -1 512 3883004 0 0 0 203013 745 0 0 20 0 1 0 555184743 16253644800 3951315 33554432000 4194304 6211132 140735088808192 140735088769432 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3968175 3951315 842 493 0 3961480 0
Current children cumulated CPU time: 2037.58 s
Current children cumulated vsize: 15872700 KiB
Current children cumulated memory: 15805260 KiB

[startup+2039.4 s]
/proc/loadavg: 2.08 2.09 2.09 3/202 31501
/proc/meminfo: memFree=13515924/32770624 swapFree=66954180/67108860
[pid=31142] ppid=31139 vsize=15872700 memory=15805260 CPUtime=2037.61 cores=0,2,4,6
/proc/31142/stat : 31142 (cosoco) S 31139 31142 30008 0 -1 512 3883004 0 0 0 203015 746 0 0 20 0 1 0 555184743 16253644800 3951315 33554432000 4194304 6211132 140735088808192 140735088769432 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 33185792 140735088813067 140735088813169 140735088813169 140735088816078 0
/proc/31142/statm: 3968175 3951315 842 493 0 3961480 0
Current children cumulated CPU time: 2037.61 s
Current children cumulated vsize: 15872700 KiB
Current children cumulated memory: 15805260 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2040.28
CPU time (s): 2038.5
CPU user time (s): 2030.16
CPU system time (s): 8.33902
CPU usage (%): 99.9127
Max. virtual memory (cumulated for all children) (KiB): 15872700
Max. memory (cumulated for all children) (KiB): 15805260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2030.16
system time used= 8.33901
maximum resident set size= 15805472
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3883004
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 130867
involuntary context switches= 1841


# summary of solver processes directly reported to runsolver:
#   pid: 31142
#   total CPU time (s): 2038.5
#   total CPU user time (s): 2030.16
#   total CPU system time (s): 8.33902

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.74 second user time and 11.0555 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-29 23:30:59
IDJOB=4408193
IDBENCH=124071
IDSOLVER=2874
FILE ID=node119/4408193-1569792700
RUNJOBID= node119-1569787352-30039
PBS_JOBID= 21705833
Free space on /tmp= 61672 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-85-085-36-36-15.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408193-1569792700/watcher-4408193-1569792700 -o /tmp/evaluation-result-4408193-1569792700/solver-4408193-1569792700 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408193-1569792700.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7b94b237cf4deebd8c7bf96e74cfc29
RANDOM SEED=1788209250

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29339012 kB
MemAvailable:   31790896 kB
Buffers:          218884 kB
Cached:          2566132 kB
SwapCached:        46676 kB
Active:          1269116 kB
Inactive:        1579208 kB
Active(anon):      29048 kB
Inactive(anon):   116176 kB
Active(file):    1240068 kB
Inactive(file):  1463032 kB
Unevictable:      107588 kB
Mlocked:          107588 kB
SwapTotal:      67108860 kB
SwapFree:       66954172 kB
Dirty:            190300 kB
Writeback:         77924 kB
AnonPages:        128772 kB
Mapped:            29400 kB
Shmem:             73180 kB
Slab:             179384 kB
SReclaimable:     129240 kB
SUnreclaim:        50144 kB
KernelStack:        3552 kB
PageTables:         5740 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     581744 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 61516 MiB
End job on node119 at 2019-09-30 00:04:59