Trace number 4409144

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1296.65 1298.73

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-19-020-009.xml
MD5SUM62ee24bcba75d1d33fbbd4bb45a854a0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark1381.62
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints191
Number of domains2
Minimum domain size2
Maximum domain size17
Distribution of domain sizes[{"size":2,"count":380},{"size":17,"count":1}]
Minimum variable degree20
Maximum variable degree172
Distribution of variable degrees[{"degree":20,"count":380},{"degree":172,"count":1}]
Minimum constraint arity20
Maximum constraint arity380
Distribution of constraint arities[{"arity":20,"count":19},{"arity":41,"count":171},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":190}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (14637 MiB free)
  memory of node 1: 16384 MiB (15427 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409144-1569794384/watcher-4409144-1569794384 -o /tmp/evaluation-result-4409144-1569794384/solver-4409144-1569794384 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18515 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4409144-1569794384.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19702, runsolver pid=19699
Current StackSize limit: 8192 KiB


[startup+0.100167 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 19703
/proc/meminfo: memFree=30784272/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=28856 memory=5272 CPUtime=0.1 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 1483 0 0 0 10 0 0 0 20 0 1 0 555444423 29548544 1318 33554432000 4194304 6211132 140733573967344 140733573963880 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 7214 1318 846 493 0 519 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28856 KiB
Current children cumulated memory: 5272 KiB

[startup+0.210965 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 19703
/proc/meminfo: memFree=30782884/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=30168 memory=6596 CPUtime=0.21 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 1817 0 0 0 21 0 0 0 20 0 1 0 555444423 30892032 1649 33554432000 4194304 6211132 140733573967344 140733573963880 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 7542 1649 846 493 0 847 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30168 KiB
Current children cumulated memory: 6596 KiB

[startup+0.310909 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 19703
/proc/meminfo: memFree=30781768/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=31356 memory=7648 CPUtime=0.31 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 2118 0 0 0 31 0 0 0 20 0 1 0 555444423 32108544 1912 33554432000 4194304 6211132 140733573967344 140733573963880 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 7839 1912 846 493 0 1144 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31356 KiB
Current children cumulated memory: 7648 KiB

[startup+0.700345 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 19703
/proc/meminfo: memFree=30779572/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=35896 memory=12128 CPUtime=0.69 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3245 0 0 0 69 0 0 0 20 0 1 0 555444423 36757504 3032 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 8974 3032 846 493 0 2279 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35896 KiB
Current children cumulated memory: 12128 KiB

[startup+1.50039 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 19703
/proc/meminfo: memFree=30773312/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=45584 memory=21884 CPUtime=1.49 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 5649 0 0 0 149 0 0 0 20 0 1 0 555444423 46678016 5471 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 11396 5471 846 493 0 4701 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 45584 KiB
Current children cumulated memory: 21884 KiB

[startup+3.11077 s]
/proc/loadavg: 2.08 2.03 2.05 3/201 19703
/proc/meminfo: memFree=30728952/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=65268 memory=41344 CPUtime=3.1 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 10536 0 0 0 309 1 0 0 20 0 1 0 555444423 66834432 10336 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 16317 10336 846 493 0 9622 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 65268 KiB
Current children cumulated memory: 41344 KiB

[startup+6.30019 s]
/proc/loadavg: 2.08 2.03 2.05 3/201 19703
/proc/meminfo: memFree=31045900/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=104772 memory=79604 CPUtime=6.29 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 20190 0 0 0 627 2 0 0 20 0 1 0 555444423 107286528 19901 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 26193 19901 846 493 0 19498 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104772 KiB
Current children cumulated memory: 79604 KiB

[startup+12.7003 s]
/proc/loadavg: 2.22 2.06 2.06 3/200 19706
/proc/meminfo: memFree=31381812/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=184812 memory=156964 CPUtime=12.68 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 39011 0 0 0 1264 4 0 0 20 0 1 0 555444423 189247488 39241 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 46203 39241 846 493 0 39508 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 184812 KiB
Current children cumulated memory: 156964 KiB

[startup+25.5003 s]
/proc/loadavg: 2.18 2.06 2.06 3/201 19708
/proc/meminfo: memFree=31224600/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=336288 memory=311436 CPUtime=25.48 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 76195 0 0 0 2539 9 0 0 20 0 1 0 555444423 344358912 77859 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 84072 77859 846 493 0 77377 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 336288 KiB
Current children cumulated memory: 311436 KiB

[startup+51.1106 s]
/proc/loadavg: 2.12 2.06 2.06 3/200 19709
/proc/meminfo: memFree=30911456/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=651816 memory=620124 CPUtime=51.08 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 149344 0 0 0 5090 18 0 0 20 0 1 0 555444423 667459584 155031 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 162954 155031 846 493 0 156259 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 651816 KiB
Current children cumulated memory: 620124 KiB

[startup+102.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/200 19712
/proc/meminfo: memFree=30294892/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=1289764 memory=1237600 CPUtime=102.25 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 294494 0 0 0 10188 37 0 0 20 0 1 0 555444423 1320718336 309400 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 322441 309400 846 493 0 315746 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 1289764 KiB
Current children cumulated memory: 1237600 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/200 19718
/proc/meminfo: memFree=29569572/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=2020500 memory=1962108 CPUtime=162.23 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 463856 0 0 0 16166 57 0 0 20 0 1 0 555444423 2068992000 490527 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 505125 490527 846 493 0 498430 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 2020500 KiB
Current children cumulated memory: 1962108 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28806296/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=2778460 memory=2685760 CPUtime=222.21 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 633550 0 0 0 22141 80 0 0 20 0 1 0 555444423 2845143040 671440 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 694615 671440 846 493 0 687920 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2778460 KiB
Current children cumulated memory: 2685760 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/200 19787
/proc/meminfo: memFree=27599048/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=3454484 memory=3408268 CPUtime=282.2 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 802523 0 0 0 28116 104 0 0 20 0 1 0 555444423 3537391616 852067 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 863621 852067 846 493 0 856926 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 3454484 KiB
Current children cumulated memory: 3408268 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/199 19794
/proc/meminfo: memFree=26396544/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=4254872 memory=4131216 CPUtime=342.18 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 972069 0 0 0 34091 127 0 0 20 0 1 0 555444423 4356988928 1032804 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 1063718 1032804 846 493 0 1057023 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 4254872 KiB
Current children cumulated memory: 4131216 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/199 19798
/proc/meminfo: memFree=25190924/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=4930052 memory=4855820 CPUtime=402.16 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 1141023 0 0 0 40066 150 0 0 20 0 1 0 555444423 5048373248 1213955 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 1232513 1213955 846 493 0 1225818 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 4930052 KiB
Current children cumulated memory: 4855820 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 19802
/proc/meminfo: memFree=23988820/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=5606060 memory=5578048 CPUtime=462.14 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 1309933 0 0 0 46039 175 0 0 20 0 1 0 555444423 5740605440 1394512 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 1401515 1394512 846 493 0 1394820 0
Current children cumulated CPU time: 462.14 s
Current children cumulated vsize: 5606060 KiB
Current children cumulated memory: 5578048 KiB


################
# More data... #
################

Current children cumulated vsize: 9449216 KiB
Current children cumulated memory: 9193100 KiB

[startup+822.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19839
/proc/meminfo: memFree=16768548/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=10123736 memory=9917288 CPUtime=822.04 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 2324291 0 0 0 81870 334 0 0 20 0 1 0 555444423 10366705664 2479322 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 2530934 2479322 846 493 0 2524239 0
Current children cumulated CPU time: 822.04 s
Current children cumulated vsize: 10123736 KiB
Current children cumulated memory: 9917288 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19845
/proc/meminfo: memFree=15567832/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=10798520 memory=10639284 CPUtime=882.02 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 2493191 0 0 0 87837 365 0 0 20 0 1 0 555444423 11057684480 2659821 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 2699630 2659821 846 493 0 2692935 0
Current children cumulated CPU time: 882.02 s
Current children cumulated vsize: 10798520 KiB
Current children cumulated memory: 10639284 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 19849
/proc/meminfo: memFree=14363180/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=11472908 memory=11362936 CPUtime=942.01 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 2661969 0 0 0 93804 397 0 0 20 0 1 0 555444423 11748257792 2840734 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 2868227 2840734 846 493 0 2861532 0
Current children cumulated CPU time: 942.01 s
Current children cumulated vsize: 11472908 KiB
Current children cumulated memory: 11362936 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 19853
/proc/meminfo: memFree=13161860/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=12149456 memory=12084884 CPUtime=1001.99 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 2830857 0 0 0 99770 429 0 0 20 0 1 0 555444423 12441042944 3021221 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3037364 3021221 846 493 0 3030669 0
Current children cumulated CPU time: 1001.99 s
Current children cumulated vsize: 12149456 KiB
Current children cumulated memory: 12084884 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 19859
/proc/meminfo: memFree=11958488/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=13244268 memory=12806700 CPUtime=1061.97 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3000258 0 0 0 105733 464 0 0 20 0 1 0 555444423 13562130432 3201675 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3311067 3201675 846 493 0 3304372 0
Current children cumulated CPU time: 1061.97 s
Current children cumulated vsize: 13244268 KiB
Current children cumulated memory: 12806700 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 19863
/proc/meminfo: memFree=10757248/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=13918656 memory=13530824 CPUtime=1121.95 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3169159 0 0 0 111700 495 0 0 20 0 1 0 555444423 14252703744 3382706 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3479664 3382706 846 493 0 3472969 0
Current children cumulated CPU time: 1121.95 s
Current children cumulated vsize: 13918656 KiB
Current children cumulated memory: 13530824 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 19867
/proc/meminfo: memFree=9554688/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=14593044 memory=14252820 CPUtime=1181.93 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3338052 0 0 0 117667 526 0 0 20 0 1 0 555444423 14943277056 3563205 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3648261 3563205 846 493 0 3641566 0
Current children cumulated CPU time: 1181.93 s
Current children cumulated vsize: 14593044 KiB
Current children cumulated memory: 14252820 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19881
/proc/meminfo: memFree=8350496/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15270540 memory=14977044 CPUtime=1241.91 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3507003 0 0 0 123631 560 0 0 20 0 1 0 555444423 15637032960 3744261 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3817635 3744261 846 493 0 3810940 0
Current children cumulated CPU time: 1241.91 s
Current children cumulated vsize: 15270540 KiB
Current children cumulated memory: 14977044 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1295.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19884
/proc/meminfo: memFree=7291500/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622092 CPUtime=1295.49 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 4202496 3657707 0 0 0 128957 592 0 0 20 0 1 0 555444423 16253669376 3905523 33554432000 4194304 6211132 140733573967344 140733573953352 140593807002597 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905523 846 493 0 3961486 0
Current children cumulated CPU time: 1295.49 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622092 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1298.73 s]
# the end of solver process 19702 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1289.82 s, system=6.82786 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1296 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 19886
/proc/meminfo: memFree=7221228/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622356 CPUtime=1295.51 cores=4-7
/proc/19702/stat : 19702 (cosoco) S 19699 19702 18483 0 -1 512 3657712 0 0 0 128958 593 0 0 20 0 1 0 555444423 16253669376 3905589 33554432000 4194304 6211132 140733573967344 140733573953352 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905589 846 493 0 3961486 0
Current children cumulated CPU time: 1295.51 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622356 KiB

[startup+1296.8 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 19886
/proc/meminfo: memFree=7221228/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622356 CPUtime=1295.63 cores=4-7
/proc/19702/stat : 19702 (cosoco) S 19699 19702 18483 0 -1 512 3657712 0 0 0 128968 595 0 0 20 0 1 0 555444423 16253669376 3905589 33554432000 4194304 6211132 140733573967344 140733573953352 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905589 846 493 0 3961486 0
Current children cumulated CPU time: 1295.63 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622356 KiB

[startup+1297.6 s]
/proc/loadavg: 2.00 2.01 2.05 4/201 19886
/proc/meminfo: memFree=6686860/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622356 CPUtime=1295.76 cores=4-7
/proc/19702/stat : 19702 (cosoco) R 19699 19702 18483 0 -1 512 3657712 0 0 0 128978 598 0 0 20 0 1 0 555444423 16253669376 3905589 33554432000 4194304 6211132 140733573967344 140733573953352 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905589 846 493 0 3961486 0
Current children cumulated CPU time: 1295.76 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622356 KiB

[startup+1297.8 s]
/proc/loadavg: 2.00 2.01 2.05 4/201 19886
/proc/meminfo: memFree=6686860/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622356 CPUtime=1295.79 cores=4-7
/proc/19702/stat : 19702 (cosoco) S 19699 19702 18483 0 -1 512 3657712 0 0 0 128980 599 0 0 20 0 1 0 555444423 16253669376 3905589 33554432000 4194304 6211132 140733573967344 140733573953352 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905589 846 493 0 3961486 0
Current children cumulated CPU time: 1295.79 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622356 KiB

[startup+1297.9 s]
/proc/loadavg: 2.00 2.01 2.05 4/201 19886
/proc/meminfo: memFree=6686860/32770688 swapFree=66927776/67108860
[pid=19702] ppid=19699 vsize=15872724 memory=15622356 CPUtime=1295.8 cores=4-7
/proc/19702/stat : 19702 (cosoco) S 19699 19702 18483 0 -1 512 3657712 0 0 0 128981 599 0 0 20 0 1 0 555444423 16253669376 3905589 33554432000 4194304 6211132 140733573967344 140733573953352 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8312316 8317760 22257664 140733573968907 140733573969009 140733573969009 140733573971918 0
/proc/19702/statm: 3968181 3905589 846 493 0 3961486 0
Current children cumulated CPU time: 1295.8 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15622356 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1298.73
CPU time (s): 1296.65
CPU user time (s): 1289.82
CPU system time (s): 6.82786
CPU usage (%): 99.8393
Max. virtual memory (cumulated for all children) (KiB): 15872724
Max. memory (cumulated for all children) (KiB): 15622356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1289.82
system time used= 6.82786
maximum resident set size= 15622360
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3657712
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124396
involuntary context switches= 1122


# summary of solver processes directly reported to runsolver:
#   pid: 19702
#   total CPU time (s): 1296.65
#   total CPU user time (s): 1289.82
#   total CPU system time (s): 6.82786

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.7072 second user time and 10.3025 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-31 06:20:04
IDJOB=4409144
IDBENCH=122984
IDSOLVER=2876
FILE ID=node120/4409144-1569794384
RUNJOBID= node120-1325301813-18515
PBS_JOBID= 21705832
Free space on /tmp= 61480 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-19-020-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409144-1569794384/watcher-4409144-1569794384 -o /tmp/evaluation-result-4409144-1569794384/solver-4409144-1569794384 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18515 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4409144-1569794384.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 62ee24bcba75d1d33fbbd4bb45a854a0
RANDOM SEED=236993948

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        30785724 kB
MemAvailable:   31776152 kB
Buffers:          200920 kB
Cached:          1114088 kB
SwapCached:        68828 kB
Active:           330132 kB
Inactive:        1074660 kB
Active(anon):      40748 kB
Inactive(anon):   130376 kB
Active(file):     289384 kB
Inactive(file):   944284 kB
Unevictable:      107072 kB
Mlocked:          107072 kB
SwapTotal:      67108860 kB
SwapFree:       66927776 kB
Dirty:            513256 kB
Writeback:         79816 kB
AnonPages:        133836 kB
Mapped:            30296 kB
Shmem:             72460 kB
Slab:             175144 kB
SReclaimable:     145192 kB
SUnreclaim:        29952 kB
KernelStack:        3792 kB
PageTables:         5732 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     593512 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61356 MiB
End job on node120 at 2011-12-31 06:41:42