Trace number 4389924

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1145.75 1147.71

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-19-020-009.xml
MD5SUM62ee24bcba75d1d33fbbd4bb45a854a0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark1412.74
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints191
Number of domains2
Minimum domain size2
Maximum domain size17
Distribution of domain sizes[{"size":2,"count":380},{"size":17,"count":1}]
Minimum variable degree20
Maximum variable degree172
Distribution of variable degrees[{"degree":20,"count":380},{"degree":172,"count":1}]
Minimum constraint arity20
Maximum constraint arity380
Distribution of constraint arities[{"arity":20,"count":19},{"arity":41,"count":171},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":190}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15115 MiB free)
  memory of node 1: 16384 MiB (7375 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389924-1568322614/watcher-4389924-1568322614 -o /tmp/evaluation-result-4389924-1568322614/solver-4389924-1568322614 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568311987-15585 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389924-1568322614.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=17576, runsolver pid=17573
Current StackSize limit: 8192 KiB


[startup+0.100143 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 17577
/proc/meminfo: memFree=23029160/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=28988 memory=5272 CPUtime=0.1 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 1518 0 0 0 10 0 0 0 20 0 1 0 408500124 29683712 1318 33554432000 4194304 6210612 140735120726896 140735120723432 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 7247 1318 845 493 0 552 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28988 KiB
Current children cumulated memory: 5272 KiB

[startup+0.209573 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 17577
/proc/meminfo: memFree=23026556/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=30432 memory=6852 CPUtime=0.21 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 1890 0 0 0 21 0 0 0 20 0 1 0 408500124 31162368 1713 33554432000 4194304 6210612 140735120726896 140735120723432 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 7608 1713 845 493 0 913 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30432 KiB
Current children cumulated memory: 6852 KiB

[startup+0.309187 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=23024324/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=31876 memory=8172 CPUtime=0.31 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2230 0 0 0 31 0 0 0 20 0 1 0 408500124 32641024 2043 33554432000 4194304 6210612 140735120726896 140735120723432 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 7969 2043 845 493 0 1274 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31876 KiB
Current children cumulated memory: 8172 KiB

[startup+0.700278 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=23019732/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=37236 memory=13444 CPUtime=0.69 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3536 0 0 0 69 0 0 0 20 0 1 0 408500124 38129664 3361 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 9309 3361 845 493 0 2614 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 37236 KiB
Current children cumulated memory: 13444 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=23008448/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=48468 memory=24324 CPUtime=1.49 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 6265 0 0 0 149 0 0 0 20 0 1 0 408500124 49631232 6081 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 12117 6081 845 493 0 5422 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48468 KiB
Current children cumulated memory: 24324 KiB

[startup+3.10948 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=22961584/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=69888 memory=46356 CPUtime=3.1 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 11796 0 0 0 309 1 0 0 20 0 1 0 408500124 71565312 11589 33554432000 4194304 6210612 140735120726896 140735120712904 5454000 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 17472 11589 845 493 0 10777 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 69888 KiB
Current children cumulated memory: 46356 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=22889444/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=114276 memory=89892 CPUtime=6.29 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 22728 0 0 0 626 3 0 0 20 0 1 0 408500124 117018624 22473 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 28569 22473 845 493 0 21874 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 114276 KiB
Current children cumulated memory: 89892 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17577
/proc/meminfo: memFree=22743976/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=203952 memory=177404 CPUtime=12.69 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 44165 0 0 0 1264 5 0 0 20 0 1 0 408500124 208846848 44351 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 50988 44351 845 493 0 44293 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 203952 KiB
Current children cumulated memory: 177404 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17586
/proc/meminfo: memFree=22433080/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=385240 memory=352056 CPUtime=25.49 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 85818 0 0 0 2539 10 0 0 20 0 1 0 408500124 394485760 88014 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 96310 88014 845 493 0 89615 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 385240 KiB
Current children cumulated memory: 352056 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17588
/proc/meminfo: memFree=21808136/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=727980 memory=703292 CPUtime=51.1 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 168055 0 0 0 5088 22 0 0 20 0 1 0 408500124 745451520 175823 33554432000 4194304 6210612 140735120726896 140735120712904 5478472 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 181995 175823 845 493 0 175300 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 727980 KiB
Current children cumulated memory: 703292 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17592
/proc/meminfo: memFree=20587248/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=1442620 memory=1401460 CPUtime=102.28 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 332395 0 0 0 10185 43 0 0 20 0 1 0 408500124 1477242880 350365 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 360655 350365 845 493 0 353960 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1442620 KiB
Current children cumulated memory: 1401460 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17596
/proc/meminfo: memFree=19149728/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=2263248 memory=2222012 CPUtime=162.27 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 524241 0 0 0 16160 67 0 0 20 0 1 0 408500124 2317565952 555503 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 565812 555503 845 493 0 559117 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2263248 KiB
Current children cumulated memory: 2222012 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17600
/proc/meminfo: memFree=17711176/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=3111780 memory=3041984 CPUtime=222.27 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 715965 0 0 0 22135 92 0 0 20 0 1 0 408500124 3186462720 760496 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 777945 760496 845 493 0 771250 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 3111780 KiB
Current children cumulated memory: 3041984 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17606
/proc/meminfo: memFree=16275600/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=4001716 memory=3860668 CPUtime=282.27 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 907916 0 0 0 28107 120 0 0 20 0 1 0 408500124 4097757184 965167 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 1000429 965167 845 493 0 993734 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 4001716 KiB
Current children cumulated memory: 3860668 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17610
/proc/meminfo: memFree=14833412/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=4767032 memory=4681264 CPUtime=342.27 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 1099319 0 0 0 34085 142 0 0 20 0 1 0 408500124 4881440768 1170316 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 1191758 1170316 845 493 0 1185063 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 4767032 KiB
Current children cumulated memory: 4681264 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17614
/proc/meminfo: memFree=13398616/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=5532800 memory=5499600 CPUtime=402.26 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 1290706 0 0 0 40058 168 0 0 20 0 1 0 408500124 5665587200 1374900 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 1383200 1374900 845 493 0 1376505 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 5532800 KiB
Current children cumulated memory: 5499600 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17620
/proc/meminfo: memFree=11960296/32770624 swapFree=66940144/67108860
[pid=17576] ppid=17573 vsize=6484200 memory=6318872 CPUtime=462.25 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 1482341 0 0 0 46030 195 0 0 20 0 1 0 408500124 6639820800 1579718 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 1621050 1579718 845 493 0 1614355 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 6484200 KiB
Current children cumulated memory: 6318872 KiB


################
# More data... #
################

Current children cumulated vsize: 8013552 KiB
Current children cumulated memory: 7957488 KiB

[startup+642.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/200 17642
/proc/meminfo: memFree=7653272/32770624 swapFree=66940148/67108860
[pid=17576] ppid=17573 vsize=9059816 memory=8775784 CPUtime=642.25 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2057046 0 0 0 63948 277 0 0 20 0 1 0 408500124 9277251584 2193946 33554432000 4194304 6210612 140735120726896 140735120712904 140146137750334 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 2264954 2193946 845 493 0 2258259 0
Current children cumulated CPU time: 642.25 s
Current children cumulated vsize: 9059816 KiB
Current children cumulated memory: 8775784 KiB

[startup+702.3 s]
/proc/loadavg: 1.94 2.00 2.04 3/200 17646
/proc/meminfo: memFree=6216468/32770624 swapFree=66940148/67108860
[pid=17576] ppid=17573 vsize=9822116 memory=9593596 CPUtime=702.24 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2247877 0 0 0 69920 304 0 0 20 0 1 0 408500124 10057846784 2398399 33554432000 4194304 6210612 140735120726896 140735120712904 5451353 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 2455529 2398399 845 493 0 2448834 0
Current children cumulated CPU time: 702.24 s
Current children cumulated vsize: 9822116 KiB
Current children cumulated memory: 9593596 KiB

[startup+762.3 s]
/proc/loadavg: 2.32 2.09 2.07 3/200 17715
/proc/meminfo: memFree=20516352/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=10577420 memory=10402368 CPUtime=762.23 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2436873 0 0 0 75885 338 0 0 20 0 1 0 408500124 10831278080 2600592 33554432000 4194304 6210612 140735120726896 140735120712904 140146147699599 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 2644355 2600592 845 493 0 2637660 0
Current children cumulated CPU time: 762.23 s
Current children cumulated vsize: 10577420 KiB
Current children cumulated memory: 10402368 KiB

[startup+822.3 s]
/proc/loadavg: 2.07 2.06 2.06 3/201 17722
/proc/meminfo: memFree=19000580/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=11339852 memory=11220176 CPUtime=822.19 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2627708 0 0 0 81852 367 0 0 20 0 1 0 408500124 11612008448 2805044 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 2834963 2805044 845 493 0 2828268 0
Current children cumulated CPU time: 822.19 s
Current children cumulated vsize: 11339852 KiB
Current children cumulated memory: 11220176 KiB

[startup+882.3 s]
/proc/loadavg: 2.03 2.05 2.05 3/201 17726
/proc/meminfo: memFree=17485028/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=12105896 memory=12037900 CPUtime=882.16 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 2819007 0 0 0 87819 397 0 0 20 0 1 0 408500124 12396437504 3009475 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3026474 3009475 845 493 0 3019779 0
Current children cumulated CPU time: 882.16 s
Current children cumulated vsize: 12105896 KiB
Current children cumulated memory: 12037900 KiB

[startup+942.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/200 17731
/proc/meminfo: memFree=15970432/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=13290072 memory=12857432 CPUtime=942.15 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3010752 0 0 0 93785 430 0 0 20 0 1 0 408500124 13609033728 3214358 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3322518 3214358 845 493 0 3315823 0
Current children cumulated CPU time: 942.15 s
Current children cumulated vsize: 13290072 KiB
Current children cumulated memory: 12857432 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 17737
/proc/meminfo: memFree=14453632/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=14054088 memory=13675304 CPUtime=1002.11 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3202125 0 0 0 99748 463 0 0 20 0 1 0 408500124 14391386112 3418826 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3513522 3418826 845 493 0 3506827 0
Current children cumulated CPU time: 1002.11 s
Current children cumulated vsize: 14054088 KiB
Current children cumulated memory: 13675304 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 17741
/proc/meminfo: memFree=12940532/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=14821080 memory=14493032 CPUtime=1062.09 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3393397 0 0 0 105710 499 0 0 20 0 1 0 408500124 15176785920 3623258 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3705270 3623258 845 493 0 3698575 0
Current children cumulated CPU time: 1062.09 s
Current children cumulated vsize: 14821080 KiB
Current children cumulated memory: 14493032 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 17746
/proc/meminfo: memFree=11424484/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15584832 memory=15312632 CPUtime=1122.06 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3584707 0 0 0 111671 535 0 0 20 0 1 0 408500124 15958867968 3828158 33554432000 4194304 6210612 140735120726896 140735120712904 140146137754597 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3896208 3828158 845 493 0 3889513 0
Current children cumulated CPU time: 1122.06 s
Current children cumulated vsize: 15584832 KiB
Current children cumulated memory: 15312632 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1144.9 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 17748
/proc/meminfo: memFree=10868600/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15872196 memory=15618792 CPUtime=1144.65 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 4202496 3656690 0 0 0 113916 549 0 0 20 0 1 0 408500124 16253128704 3904698 33554432000 4194304 6210612 140735120726896 140735120712904 140146137750334 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3968049 3904698 845 493 0 3961354 0
Current children cumulated CPU time: 1144.65 s
Current children cumulated vsize: 15872196 KiB
Current children cumulated memory: 15618792 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1147.71 s]
# the end of solver process 17576 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1139.42 s, system=6.32498 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1145.6 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 17749
/proc/meminfo: memFree=10796136/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15872196 memory=15618792 CPUtime=1144.75 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) S 17573 17576 15554 0 -1 512 3656695 0 0 0 113924 551 0 0 20 0 1 0 408500124 16253128704 3904698 33554432000 4194304 6210612 140735120726896 140735120712904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3968049 3904698 845 493 0 3961354 0
Current children cumulated CPU time: 1144.75 s
Current children cumulated vsize: 15872196 KiB
Current children cumulated memory: 15618792 KiB

[startup+1146.4 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 17749
/proc/meminfo: memFree=10283068/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15872196 memory=15618792 CPUtime=1144.86 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) S 17573 17576 15554 0 -1 512 3656695 0 0 0 113935 551 0 0 20 0 1 0 408500124 16253128704 3904698 33554432000 4194304 6210612 140735120726896 140735120712904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3968049 3904698 845 493 0 3961354 0
Current children cumulated CPU time: 1144.86 s
Current children cumulated vsize: 15872196 KiB
Current children cumulated memory: 15618792 KiB

[startup+1146.8 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 17749
/proc/meminfo: memFree=10283068/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15872196 memory=15618792 CPUtime=1144.91 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) S 17573 17576 15554 0 -1 512 3656695 0 0 0 113940 551 0 0 20 0 1 0 408500124 16253128704 3904698 33554432000 4194304 6210612 140735120726896 140735120712904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3968049 3904698 845 493 0 3961354 0
Current children cumulated CPU time: 1144.91 s
Current children cumulated vsize: 15872196 KiB
Current children cumulated memory: 15618792 KiB

[startup+1146.9 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 17749
/proc/meminfo: memFree=10283068/32770624 swapFree=66940644/67108860
[pid=17576] ppid=17573 vsize=15872196 memory=15618792 CPUtime=1144.93 cores=0,2,4,6
/proc/17576/stat : 17576 (cosoco) R 17573 17576 15554 0 -1 512 3656695 0 0 0 113942 551 0 0 20 0 1 0 408500124 16253128704 3904698 33554432000 4194304 6210612 140735120726896 140735120712904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8308220 8313664 19009536 140735120733195 140735120733297 140735120733297 140735120736206 0
/proc/17576/statm: 3968049 3904698 845 493 0 3961354 0
Current children cumulated CPU time: 1144.93 s
Current children cumulated vsize: 15872196 KiB
Current children cumulated memory: 15618792 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1147.71
CPU time (s): 1145.75
CPU user time (s): 1139.42
CPU system time (s): 6.32498
CPU usage (%): 99.8294
Max. virtual memory (cumulated for all children) (KiB): 15872196
Max. memory (cumulated for all children) (KiB): 15618792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1139.42
system time used= 6.32498
maximum resident set size= 15618960
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3656695
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 125433
involuntary context switches= 1751


# summary of solver processes directly reported to runsolver:
#   pid: 17576
#   total CPU time (s): 1145.75
#   total CPU user time (s): 1139.42
#   total CPU system time (s): 6.32498

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.75363 second user time and 8.18471 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-12 23:09:37
IDJOB=4389924
IDBENCH=122984
IDSOLVER=2829
FILE ID=node149/4389924-1568322614
RUNJOBID= node149-1568311987-15585
PBS_JOBID= 21701127
Free space on /tmp= 57068 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-19-020-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389924-1568322614/watcher-4389924-1568322614 -o /tmp/evaluation-result-4389924-1568322614/solver-4389924-1568322614 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568311987-15585 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389924-1568322614.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 62ee24bcba75d1d33fbbd4bb45a854a0
RANDOM SEED=1560223239

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23032184 kB
MemAvailable:   23655252 kB
Buffers:          119596 kB
Cached:           802864 kB
SwapCached:        61236 kB
Active:          8564352 kB
Inactive:         607984 kB
Active(anon):    8218076 kB
Inactive(anon):    71652 kB
Active(file):     346276 kB
Inactive(file):   536332 kB
Unevictable:      111364 kB
Mlocked:          111364 kB
SwapTotal:      67108860 kB
SwapFree:       66940144 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:       8301376 kB
Mapped:            44296 kB
Shmem:             31076 kB
Slab:             141412 kB
SReclaimable:     112592 kB
SUnreclaim:        28820 kB
KernelStack:        3472 kB
PageTables:        21528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    8719496 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1574912 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /tmp at the end= 56576 MiB
End job on node149 at 2019-09-12 23:28:44