Trace number 4397071

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 2389.63 2391.78

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-03-350-100.xml
MD5SUM2ec8df38dc21edc74720c494de453c4e
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark2.11825
Satisfiable
(Un)Satisfiability was proved
Number of variables1051
Number of constraints7
Number of domains2
Minimum domain size2
Maximum domain size351
Distribution of domain sizes[{"size":2,"count":1050},{"size":351,"count":1}]
Minimum variable degree4
Maximum variable degree4
Distribution of variable degrees[{"degree":4,"count":1051}]
Minimum constraint arity350
Maximum constraint arity1050
Distribution of constraint arities[{"arity":350,"count":3},{"arity":701,"count":3},{"arity":1050,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":6}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13579 MiB free)
  memory of node 1: 16384 MiB (13787 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397071-1568575577/watcher-4397071-1568575577 -o /tmp/evaluation-result-4397071-1568575577/solver-4397071-1568575577 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1324087207-28529 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397071-1568575577.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29061, runsolver pid=29058

[startup+0.100157 s]*
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28022380/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=28820 memory=5372 CPUtime=0.1 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 1525 0 0 0 10 0 0 0 20 0 1 0 433564019 29511680 1343 33554432000 4194304 6211092 140730484953840 140730484947688 139819227751320 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 7205 1343 846 493 0 510 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28820 KiB
Current children cumulated memory: 5372 KiB

[startup+0.21072 s]*
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28022008/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=29612 memory=6164 CPUtime=0.21 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 1708 0 0 0 21 0 0 0 20 0 1 0 433564019 30322688 1541 33554432000 4194304 6211092 140730484953840 140730484947688 139819227745253 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 7403 1541 846 493 0 708 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29612 KiB
Current children cumulated memory: 6164 KiB

[startup+0.310091 s]*
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28021372/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=30272 memory=6692 CPUtime=0.31 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 1874 0 0 0 31 0 0 0 20 0 1 0 433564019 30998528 1673 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 7568 1673 846 493 0 873 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30272 KiB
Current children cumulated memory: 6692 KiB

[startup+0.700289 s]
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28019716/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=32780 memory=9332 CPUtime=0.69 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 2508 0 0 0 69 0 0 0 20 0 1 0 433564019 33566720 2333 33554432000 4194304 6211092 140730484953840 140730484813128 5454180 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 8195 2333 846 493 0 1500 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32780 KiB
Current children cumulated memory: 9332 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28016368/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=38060 memory=14612 CPUtime=1.49 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3837 0 0 0 149 0 0 0 20 0 1 0 433564019 38973440 3653 33554432000 4194304 6211092 140730484953840 140730484813128 139819228665744 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 9515 3653 846 493 0 2820 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38060 KiB
Current children cumulated memory: 14612 KiB

[startup+3.11063 s]
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=28002628/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=48832 memory=25256 CPUtime=3.09 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 6681 0 0 0 309 0 0 0 20 0 1 0 433564019 50003968 6314 33554432000 4194304 6211092 140730484953840 140730484813128 139819237690186 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 12208 6314 846 493 0 5513 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 48832 KiB
Current children cumulated memory: 25256 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.02 1.95 3/200 29062
/proc/meminfo: memFree=27982512/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=69944 memory=46404 CPUtime=6.29 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 12122 0 0 0 627 2 0 0 20 0 1 0 433564019 71622656 11601 33554432000 4194304 6211092 140730484953840 140730484813128 5013015 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 17486 11601 846 493 0 10791 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 69944 KiB
Current children cumulated memory: 46404 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.02 1.95 3/199 29063
/proc/meminfo: memFree=27943532/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=112440 memory=88944 CPUtime=12.68 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 22875 0 0 0 1265 3 0 0 20 0 1 0 433564019 115138560 22236 33554432000 4194304 6211092 140730484953840 140730484813128 5443072 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 28110 22236 846 493 0 21415 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 112440 KiB
Current children cumulated memory: 88944 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.02 1.95 3/199 29063
/proc/meminfo: memFree=27857552/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=197528 memory=173816 CPUtime=25.47 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 44360 0 0 0 2540 7 0 0 20 0 1 0 433564019 202268672 43454 33554432000 4194304 6211092 140730484953840 140730484813128 5453912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 49382 43454 846 493 0 42687 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 197528 KiB
Current children cumulated memory: 173816 KiB

[startup+51.1106 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 29065
/proc/meminfo: memFree=27683456/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=367952 memory=343876 CPUtime=51.07 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 86985 0 0 0 5094 13 0 0 20 0 1 0 433564019 376782848 85969 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 91988 85969 846 493 0 85293 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 367952 KiB
Current children cumulated memory: 343876 KiB

[startup+102.3 s]
/proc/loadavg: 2.08 2.03 1.96 3/199 29130
/proc/meminfo: memFree=27059540/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=707492 memory=683936 CPUtime=102.23 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 172110 0 0 0 10195 28 0 0 20 0 1 0 433564019 724471808 170984 33554432000 4194304 6211092 140730484953840 140730484813128 5013034 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 176873 170984 846 493 0 170178 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 707492 KiB
Current children cumulated memory: 683936 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.03 1.96 3/200 29135
/proc/meminfo: memFree=26122176/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=1108148 memory=1082544 CPUtime=162.22 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 271781 0 0 0 16177 45 0 0 20 0 1 0 433564019 1134743552 270636 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 277037 270636 846 493 0 270342 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 1108148 KiB
Current children cumulated memory: 1082544 KiB

[startup+222.3 s]
/proc/loadavg: 1.96 2.01 1.95 3/201 29147
/proc/meminfo: memFree=25189124/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=1503092 memory=1479304 CPUtime=222.19 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 370945 0 0 0 22159 60 0 0 20 0 1 0 433564019 1539166208 369826 33554432000 4194304 6211092 140730484953840 140730484813128 5455653 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 375773 369826 846 493 0 369078 0
Current children cumulated CPU time: 222.19 s
Current children cumulated vsize: 1503092 KiB
Current children cumulated memory: 1479304 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 2.01 1.95 3/201 29153
/proc/meminfo: memFree=24249768/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=1903388 memory=1879592 CPUtime=282.18 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 470630 0 0 0 28143 75 0 0 20 0 1 0 433564019 1949069312 469898 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 475847 469898 846 493 0 469152 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 1903388 KiB
Current children cumulated memory: 1879592 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.01 1.95 3/201 29157
/proc/meminfo: memFree=23315028/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=2300312 memory=2276688 CPUtime=342.17 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 570018 0 0 0 34126 91 0 0 20 0 1 0 433564019 2355519488 569172 33554432000 4194304 6211092 140730484953840 140730484813128 139819228671379 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 575078 569172 846 493 0 568383 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 2300312 KiB
Current children cumulated memory: 2276688 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/201 29161
/proc/meminfo: memFree=22380344/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=2702096 memory=2675304 CPUtime=402.16 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 669818 0 0 0 40109 107 0 0 20 0 1 0 433564019 2766946304 668826 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 675524 668826 846 493 0 668829 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 2702096 KiB
Current children cumulated memory: 2675304 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 29167
/proc/meminfo: memFree=21443152/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=3099152 memory=3074388 CPUtime=462.15 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 769260 0 0 0 46092 123 0 0 20 0 1 0 433564019 3173531648 768597 33554432000 4194304 6211092 140730484953840 140730484813128 139819228671424 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 774788 768597 846 493 0 768093 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 3099152 KiB
Current children cumulated memory: 3074388 KiB


################
# More data... #
################

Current children cumulated vsize: 11875960 KiB
Current children cumulated memory: 11828052 KiB

[startup+1842.3 s]
/proc/loadavg: 2.61 2.16 2.08 3/200 29378
/proc/meminfo: memFree=16760420/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=12271432 memory=12225912 CPUtime=1841.96 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3058723 0 0 0 183625 571 0 0 20 0 1 0 433564019 12565946368 3056478 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3067858 3056478 846 493 0 3061163 0
Current children cumulated CPU time: 1841.96 s
Current children cumulated vsize: 12271432 KiB
Current children cumulated memory: 12225912 KiB

[startup+1902.3 s]
/proc/loadavg: 2.26 2.15 2.08 3/200 29384
/proc/meminfo: memFree=16363760/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=12667036 memory=12623456 CPUtime=1901.95 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3158132 0 0 0 189601 594 0 0 20 0 1 0 433564019 12971044864 3155864 33554432000 4194304 6211092 140730484953840 140730484813128 5446240 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3166759 3155864 846 493 0 3160064 0
Current children cumulated CPU time: 1901.95 s
Current children cumulated vsize: 12667036 KiB
Current children cumulated memory: 12623456 KiB

[startup+1962.3 s]
/proc/loadavg: 2.09 2.12 2.07 3/200 29388
/proc/meminfo: memFree=15965256/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=13062508 memory=13021136 CPUtime=1961.94 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3257623 0 0 0 195576 618 0 0 20 0 1 0 433564019 13376008192 3255284 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3265627 3255284 846 493 0 3258932 0
Current children cumulated CPU time: 1961.94 s
Current children cumulated vsize: 13062508 KiB
Current children cumulated memory: 13021136 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.10 2.07 3/201 29399
/proc/meminfo: memFree=15566856/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=13457980 memory=13418720 CPUtime=2021.93 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3357021 0 0 0 201551 642 0 0 20 0 1 0 433564019 13780971520 3354680 33554432000 4194304 6211092 140730484953840 140730484813128 5454176 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3364495 3354680 846 493 0 3357800 0
Current children cumulated CPU time: 2021.93 s
Current children cumulated vsize: 13457980 KiB
Current children cumulated memory: 13418720 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.08 2.06 3/201 29405
/proc/meminfo: memFree=15170488/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=13853452 memory=13814008 CPUtime=2081.92 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3456389 0 0 0 207525 667 0 0 20 0 1 0 433564019 14185934848 3453502 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3463363 3453502 846 493 0 3456668 0
Current children cumulated CPU time: 2081.92 s
Current children cumulated vsize: 13853452 KiB
Current children cumulated memory: 13814008 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.07 2.05 3/200 29409
/proc/meminfo: memFree=14772712/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=14248792 memory=14211624 CPUtime=2141.91 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3555875 0 0 0 213497 694 0 0 20 0 1 0 433564019 14590763008 3552906 33554432000 4194304 6211092 140730484953840 140730484813128 5456306 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3562198 3552906 846 493 0 3555503 0
Current children cumulated CPU time: 2141.91 s
Current children cumulated vsize: 14248792 KiB
Current children cumulated memory: 14211624 KiB

[startup+2202.3 s]
/proc/loadavg: 2.08 2.07 2.05 3/200 29413
/proc/meminfo: memFree=14374440/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=14643736 memory=14608452 CPUtime=2201.89 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3655239 0 0 0 219467 722 0 0 20 0 1 0 433564019 14995185664 3652113 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3660934 3652113 846 493 0 3654239 0
Current children cumulated CPU time: 2201.89 s
Current children cumulated vsize: 14643736 KiB
Current children cumulated memory: 14608452 KiB

[startup+2262.3 s]
/proc/loadavg: 2.03 2.06 2.05 3/200 29543
/proc/meminfo: memFree=13900452/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15038408 memory=15005016 CPUtime=2261.89 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3754521 0 0 0 225435 754 0 0 20 0 1 0 433564019 15399329792 3751254 33554432000 4194304 6211092 140730484953840 140730484813128 5446248 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3759602 3751254 846 493 0 3752907 0
Current children cumulated CPU time: 2261.89 s
Current children cumulated vsize: 15038408 KiB
Current children cumulated memory: 15005016 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/199 29548
/proc/meminfo: memFree=12846392/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15433220 memory=15402068 CPUtime=2321.87 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3853741 0 0 0 231403 784 0 0 20 0 1 0 433564019 15803617280 3850517 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3858305 3850517 846 493 0 3851610 0
Current children cumulated CPU time: 2321.87 s
Current children cumulated vsize: 15433220 KiB
Current children cumulated memory: 15402068 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 29553
/proc/meminfo: memFree=11794584/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15828032 memory=15796860 CPUtime=2381.87 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3953072 0 0 0 237368 819 0 0 20 0 1 0 433564019 16207904768 3949215 33554432000 4194304 6211092 140730484953840 140730484813128 5446618 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3957008 3949215 846 493 0 3950313 0
Current children cumulated CPU time: 2381.87 s
Current children cumulated vsize: 15828032 KiB
Current children cumulated memory: 15796860 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2389 s]*
/proc/loadavg: 2.00 2.04 2.05 3/200 29555
/proc/meminfo: memFree=11670920/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15872120 memory=15842980 CPUtime=2388.57 cores=0-3
/proc/29061/stat : 29061 (cosoco) R 29058 29061 28498 0 -1 4202496 3964104 0 0 0 238034 823 0 0 20 0 1 0 433564019 16253050880 3960745 33554432000 4194304 6211092 140730484953840 140730484813128 139819227745253 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3968030 3960745 846 493 0 3961335 0
Current children cumulated CPU time: 2388.57 s
Current children cumulated vsize: 15872120 KiB
Current children cumulated memory: 15842980 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2391.78 s]
# the end of solver process 29061 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2380.59 s, system=9.04116 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2390.4 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 29556
/proc/meminfo: memFree=11228780/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15872120 memory=15842980 CPUtime=2388.76 cores=0-3
/proc/29061/stat : 29061 (cosoco) S 29058 29061 28498 0 -1 512 3964109 0 0 0 238051 825 0 0 20 0 1 0 433564019 16253050880 3960745 33554432000 4194304 6211092 140730484953840 140730484813128 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3968030 3960745 846 493 0 3961335 0
Current children cumulated CPU time: 2388.76 s
Current children cumulated vsize: 15872120 KiB
Current children cumulated memory: 15842980 KiB

[startup+2390.8 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 29556
/proc/meminfo: memFree=11228780/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15872120 memory=15842980 CPUtime=2388.82 cores=0-3
/proc/29061/stat : 29061 (cosoco) S 29058 29061 28498 0 -1 512 3964109 0 0 0 238056 826 0 0 20 0 1 0 433564019 16253050880 3960745 33554432000 4194304 6211092 140730484953840 140730484813128 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3968030 3960745 846 493 0 3961335 0
Current children cumulated CPU time: 2388.82 s
Current children cumulated vsize: 15872120 KiB
Current children cumulated memory: 15842980 KiB

[startup+2391 s]*
/proc/loadavg: 2.00 2.04 2.05 3/201 29556
/proc/meminfo: memFree=10749024/32770688 swapFree=66919992/67108860
[pid=29061] ppid=29058 vsize=15872120 memory=15842980 CPUtime=2388.86 cores=0-3
/proc/29061/stat : 29061 (cosoco) S 29058 29061 28498 0 -1 512 3964109 0 0 0 238059 827 0 0 20 0 1 0 433564019 16253050880 3960745 33554432000 4194304 6211092 140730484953840 140730484813128 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 9523200 140730484958219 140730484958321 140730484958321 140730484961230 0
/proc/29061/statm: 3968030 3960745 846 493 0 3961335 0
Current children cumulated CPU time: 2388.86 s
Current children cumulated vsize: 15872120 KiB
Current children cumulated memory: 15842980 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2391.78
CPU time (s): 2389.63
CPU user time (s): 2380.59
CPU system time (s): 9.04116
CPU usage (%): 99.9101
Max. virtual memory (cumulated for all children) (KiB): 15872120
Max. memory (cumulated for all children) (KiB): 15842980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2380.59
system time used= 9.04116
maximum resident set size= 15843080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3964109
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 112802
involuntary context switches= 2994


# summary of solver processes directly reported to runsolver:
#   pid: 29061
#   total CPU time (s): 2389.63
#   total CPU user time (s): 2380.59
#   total CPU system time (s): 9.04116

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.0159 second user time and 19.5035 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-17 03:46:40
IDJOB=4397071
IDBENCH=122944
IDSOLVER=2848
FILE ID=node120/4397071-1568575577
RUNJOBID= node120-1324087207-28529
PBS_JOBID= 21703329
Free space on /tmp= 61644 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-03-350-100.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397071-1568575577/watcher-4397071-1568575577 -o /tmp/evaluation-result-4397071-1568575577/solver-4397071-1568575577 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1324087207-28529 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397071-1568575577.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2ec8df38dc21edc74720c494de453c4e
RANDOM SEED=1662273607

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        28023952 kB
MemAvailable:   31786256 kB
Buffers:          211620 kB
Cached:          3855804 kB
SwapCached:        77548 kB
Active:          1366944 kB
Inactive:        2826264 kB
Active(anon):      47792 kB
Inactive(anon):   127476 kB
Active(file):    1319152 kB
Inactive(file):  2698788 kB
Unevictable:      107628 kB
Mlocked:          107628 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:        157056 kB
Mapped:            52864 kB
Shmem:             41008 kB
Slab:             149088 kB
SReclaimable:     120400 kB
SUnreclaim:        28688 kB
KernelStack:        3552 kB
PageTables:         5520 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     588048 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    108544 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61216 MiB
End job on node120 at 2011-12-17 04:26:31