Trace number 4408997

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1975.23 1977.18

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-038-010.xml
MD5SUM8e449228b7b3cf049a5fccac2aa13fe6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark4.37498
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size37
Distribution of domain sizes[{"size":2,"count":380},{"size":37,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":380},{"degree":46,"count":1}]
Minimum constraint arity38
Maximum constraint arity380
Distribution of constraint arities[{"arity":38,"count":10},{"arity":77,"count":45},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15264 MiB free)
  memory of node 1: 16384 MiB (13000 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408997-1569794599/watcher-4408997-1569794599 -o /tmp/evaluation-result-4408997-1569794599/solver-4408997-1569794599 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18514 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408997-1569794599.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19782, runsolver pid=19779
Current StackSize limit: 8192 KiB


[startup+0.10016 s]*
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28942428/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=28416 memory=4744 CPUtime=0.1 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 1378 0 0 0 10 0 0 0 20 0 1 0 555465927 29097984 1186 33554432000 4194304 6211132 140734375590800 140734375587336 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 7104 1186 845 493 0 409 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28416 KiB
Current children cumulated memory: 4744 KiB

[startup+0.210672 s]*
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28939860/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=29380 memory=5536 CPUtime=0.21 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 1612 0 0 0 21 0 0 0 20 0 1 0 555465927 30085120 1384 33554432000 4194304 6211132 140734375590800 140734375587336 140004401277789 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 7345 1384 845 493 0 650 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29380 KiB
Current children cumulated memory: 5536 KiB

[startup+0.310173 s]*
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28938000/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=30040 memory=6328 CPUtime=0.31 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 1796 0 0 0 31 0 0 0 20 0 1 0 555465927 30760960 1582 33554432000 4194304 6211132 140734375590800 140734375587336 5451608 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 7510 1582 846 493 0 815 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30040 KiB
Current children cumulated memory: 6328 KiB

[startup+0.700289 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28934716/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=33068 memory=9368 CPUtime=0.69 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 2556 0 0 0 69 0 0 0 20 0 1 0 555465927 33861632 2342 33554432000 4194304 6211132 140734375590800 140734375569896 5454192 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 8267 2342 846 493 0 1572 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33068 KiB
Current children cumulated memory: 9368 KiB

[startup+1.50029 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28925004/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=39456 memory=15852 CPUtime=1.49 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 4150 0 0 0 149 0 0 0 20 0 1 0 555465927 40402944 3963 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 9864 3963 846 493 0 3169 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39456 KiB
Current children cumulated memory: 15852 KiB

[startup+3.11051 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28884476/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=52444 memory=28692 CPUtime=3.09 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 7405 0 0 0 309 0 0 0 20 0 1 0 555465927 53702656 7173 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 13111 7173 846 493 0 6416 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 52444 KiB
Current children cumulated memory: 28692 KiB

[startup+6.30029 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28825144/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=78332 memory=54048 CPUtime=6.29 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 13805 0 0 0 627 2 0 0 20 0 1 0 555465927 80211968 13512 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 19583 13512 846 493 0 12888 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 78332 KiB
Current children cumulated memory: 54048 KiB

[startup+12.7003 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19783
/proc/meminfo: memFree=28704736/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=130644 memory=104964 CPUtime=12.69 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 26604 0 0 0 1266 3 0 0 20 0 1 0 555465927 133779456 26241 33554432000 4194304 6211132 140734375590800 140734375569896 5446292 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 32661 26241 846 493 0 25966 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 130644 KiB
Current children cumulated memory: 104964 KiB

[startup+25.5003 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 19784
/proc/meminfo: memFree=28441812/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=231208 memory=207540 CPUtime=25.49 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 51794 0 0 0 2541 8 0 0 20 0 1 0 555465927 236756992 51885 33554432000 4194304 6211132 140734375590800 140734375569896 140004392257075 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 57802 51885 846 493 0 51107 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 231208 KiB
Current children cumulated memory: 207540 KiB

[startup+51.1105 s]
/proc/loadavg: 2.07 2.05 2.05 3/200 19786
/proc/meminfo: memFree=27919108/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=438172 memory=411828 CPUtime=51.1 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 101436 0 0 0 5094 16 0 0 20 0 1 0 555465927 448688128 102957 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 109543 102957 846 493 0 102848 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 438172 KiB
Current children cumulated memory: 411828 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/199 19791
/proc/meminfo: memFree=26895196/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=855048 memory=819936 CPUtime=102.29 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 199900 0 0 0 10198 31 0 0 20 0 1 0 555465927 875569152 204984 33554432000 4194304 6211132 140734375590800 140734375569896 140004392258963 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 213762 204984 846 493 0 207067 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 855048 KiB
Current children cumulated memory: 819936 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/199 19795
/proc/meminfo: memFree=25693348/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=1336128 memory=1296636 CPUtime=162.29 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 314504 0 0 0 16182 47 0 0 20 0 1 0 555465927 1368195072 324159 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 334032 324159 846 493 0 327337 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1336128 KiB
Current children cumulated memory: 1296636 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 19801
/proc/meminfo: memFree=24490300/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=1829660 memory=1775804 CPUtime=222.29 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 429200 0 0 0 22166 63 0 0 20 0 1 0 555465927 1873571840 443951 33554432000 4194304 6211132 140734375590800 140734375569896 140004392256342 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 457415 443951 846 493 0 450720 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 1829660 KiB
Current children cumulated memory: 1775804 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 19806
/proc/meminfo: memFree=23286132/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=2285984 memory=2252964 CPUtime=282.29 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 543337 0 0 0 28150 79 0 0 20 0 1 0 555465927 2340847616 563241 33554432000 4194304 6211132 140734375590800 140734375569896 5451564 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 571496 563241 846 493 0 564801 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2285984 KiB
Current children cumulated memory: 2252964 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 19810
/proc/meminfo: memFree=22082296/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=2798180 memory=2732104 CPUtime=342.3 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 658026 0 0 0 34133 97 0 0 20 0 1 0 555465927 2865336320 683026 33554432000 4194304 6211132 140734375590800 140734375569896 5012962 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 699545 683026 846 493 0 692850 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 2798180 KiB
Current children cumulated memory: 2732104 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19824
/proc/meminfo: memFree=20877816/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=3255464 memory=3209344 CPUtime=402.3 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 772306 0 0 0 40117 113 0 0 20 0 1 0 555465927 3333595136 802336 33554432000 4194304 6211132 140734375590800 140734375569896 5442999 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 813866 802336 846 493 0 807171 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 3255464 KiB
Current children cumulated memory: 3209344 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 19828
/proc/meminfo: memFree=19675888/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=3711392 memory=3686400 CPUtime=462.3 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 886512 0 0 0 46099 131 0 0 20 0 1 0 555465927 3800465408 921600 33554432000 4194304 6211132 140734375590800 140734375569896 140004401277784 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 927848 921600 846 493 0 921153 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 3711392 KiB
Current children cumulated memory: 3686400 KiB


################
# More data... #
################

Current children cumulated vsize: 11860944 KiB
Current children cumulated memory: 11800280 KiB

[startup+1542.3 s]
/proc/loadavg: 1.95 2.02 2.05 3/200 20047
/proc/meminfo: memFree=19180072/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=12316212 memory=12276540 CPUtime=1542.14 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 2942534 0 0 0 153649 565 0 0 20 0 1 0 555465927 12611801088 3069135 33554432000 4194304 6211132 140734375590800 140734375569896 5456342 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3079053 3069135 846 493 0 3072358 0
Current children cumulated CPU time: 1542.14 s
Current children cumulated vsize: 12316212 KiB
Current children cumulated memory: 12276540 KiB

[startup+1602.3 s]
/proc/loadavg: 1.98 2.02 2.05 3/200 20059
/proc/meminfo: memFree=18702124/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=13051628 memory=12753308 CPUtime=1602.12 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3057299 0 0 0 159620 592 0 0 20 0 1 0 555465927 13364867072 3188327 33554432000 4194304 6211132 140734375590800 140734375569896 5451560 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3262907 3188327 846 493 0 3256212 0
Current children cumulated CPU time: 1602.12 s
Current children cumulated vsize: 13051628 KiB
Current children cumulated memory: 12753308 KiB

[startup+1662.3 s]
/proc/loadavg: 1.99 2.01 2.05 3/200 20065
/proc/meminfo: memFree=18223748/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=13506764 memory=13231084 CPUtime=1662.11 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3171338 0 0 0 165591 620 0 0 20 0 1 0 555465927 13830926336 3307771 33554432000 4194304 6211132 140734375590800 140734375569896 140004392256342 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3376691 3307771 846 493 0 3369996 0
Current children cumulated CPU time: 1662.11 s
Current children cumulated vsize: 13506764 KiB
Current children cumulated memory: 13231084 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20069
/proc/meminfo: memFree=17746552/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=13961768 memory=13706552 CPUtime=1722.09 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3285335 0 0 0 171561 648 0 0 20 0 1 0 555465927 14296850432 3426638 33554432000 4194304 6211132 140734375590800 140734375569896 4982096 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3490442 3426638 846 493 0 3483747 0
Current children cumulated CPU time: 1722.09 s
Current children cumulated vsize: 13961768 KiB
Current children cumulated memory: 13706552 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20073
/proc/meminfo: memFree=17269264/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=14416904 memory=14184064 CPUtime=1782.08 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3399335 0 0 0 177530 678 0 0 20 0 1 0 555465927 14762909696 3546016 33554432000 4194304 6211132 140734375590800 140734375569896 140004391332837 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3604226 3546016 846 493 0 3597531 0
Current children cumulated CPU time: 1782.08 s
Current children cumulated vsize: 14416904 KiB
Current children cumulated memory: 14184064 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20079
/proc/meminfo: memFree=16791752/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=14871908 memory=14659532 CPUtime=1842.07 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3513330 0 0 0 183500 707 0 0 20 0 1 0 555465927 15228833792 3664883 33554432000 4194304 6211132 140734375590800 140734375569896 140004401277789 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3717977 3664883 846 493 0 3711282 0
Current children cumulated CPU time: 1842.07 s
Current children cumulated vsize: 14871908 KiB
Current children cumulated memory: 14659532 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20084
/proc/meminfo: memFree=16313340/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15326912 memory=15137572 CPUtime=1902.06 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3627405 0 0 0 189468 738 0 0 20 0 1 0 555465927 15694757888 3784393 33554432000 4194304 6211132 140734375590800 140734375569896 5456342 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3831728 3784393 846 493 0 3825033 0
Current children cumulated CPU time: 1902.06 s
Current children cumulated vsize: 15326912 KiB
Current children cumulated memory: 15137572 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20088
/proc/meminfo: memFree=15836068/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15781784 memory=15613040 CPUtime=1962.05 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3741406 0 0 0 195434 771 0 0 20 0 1 0 555465927 16160546816 3903260 33554432000 4194304 6211132 140734375590800 140734375569896 140004400665760 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3945446 3903260 846 493 0 3938751 0
Current children cumulated CPU time: 1962.05 s
Current children cumulated vsize: 15781784 KiB
Current children cumulated memory: 15613040 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1974.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20090
/proc/meminfo: memFree=15741924/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.04 cores=0-3
/proc/19782/stat : 19782 (cosoco) R 19779 19782 18483 0 -1 4202496 3764185 0 0 0 196625 779 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5446936 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.04 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1977.18 s]
# the end of solver process 19782 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1966.53 s, system=8.69473 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1974.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20090
/proc/meminfo: memFree=15741924/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.06 cores=0-3
/proc/19782/stat : 19782 (cosoco) S 19779 19782 18483 0 -1 512 3764189 0 0 0 196626 780 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.06 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

[startup+1975.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20091
/proc/meminfo: memFree=15404500/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.18 cores=0-3
/proc/19782/stat : 19782 (cosoco) S 19779 19782 18483 0 -1 512 3764189 0 0 0 196638 780 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.18 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

[startup+1976 s]*
/proc/loadavg: 2.00 2.01 2.05 4/199 20091
/proc/meminfo: memFree=14939112/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.3 cores=0-3
/proc/19782/stat : 19782 (cosoco) S 19779 19782 18483 0 -1 512 3764189 0 0 0 196649 781 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.3 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

[startup+1976.2 s]
/proc/loadavg: 2.00 2.01 2.05 4/199 20091
/proc/meminfo: memFree=14939112/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.32 cores=0-3
/proc/19782/stat : 19782 (cosoco) S 19779 19782 18483 0 -1 512 3764189 0 0 0 196651 781 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.32 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

[startup+1976.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/199 20091
/proc/meminfo: memFree=14939112/32770688 swapFree=66927776/67108860
[pid=19782] ppid=19779 vsize=15872600 memory=15708028 CPUtime=1974.34 cores=0-3
/proc/19782/stat : 19782 (cosoco) S 19779 19782 18483 0 -1 512 3764189 0 0 0 196653 781 0 0 20 0 1 0 555465927 16253542400 3927007 33554432000 4194304 6211132 140734375590800 140734375569896 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 37031936 140734375592971 140734375593073 140734375593073 140734375595982 0
/proc/19782/statm: 3968150 3927007 846 493 0 3961455 0
Current children cumulated CPU time: 1974.34 s
Current children cumulated vsize: 15872600 KiB
Current children cumulated memory: 15708028 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1977.18
CPU time (s): 1975.23
CPU user time (s): 1966.53
CPU system time (s): 8.69473
CPU usage (%): 99.9012
Max. virtual memory (cumulated for all children) (KiB): 15872600
Max. memory (cumulated for all children) (KiB): 15708028

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1966.53
system time used= 8.69473
maximum resident set size= 15708216
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3764189
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 115575
involuntary context switches= 1042


# summary of solver processes directly reported to runsolver:
#   pid: 19782
#   total CPU time (s): 1975.23
#   total CPU user time (s): 1966.53
#   total CPU system time (s): 8.69473

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.80724 second user time and 14.9141 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-31 06:23:39
IDJOB=4408997
IDBENCH=122994
IDSOLVER=2876
FILE ID=node120/4408997-1569794599
RUNJOBID= node120-1325301813-18514
PBS_JOBID= 21705832
Free space on /tmp= 61840 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-038-010.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408997-1569794599/watcher-4408997-1569794599 -o /tmp/evaluation-result-4408997-1569794599/solver-4408997-1569794599 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node120-1325301813-18514 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408997-1569794599.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e449228b7b3cf049a5fccac2aa13fe6
RANDOM SEED=1320885402

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        28944672 kB
MemAvailable:   29200584 kB
Buffers:          201668 kB
Cached:           384620 kB
SwapCached:        68828 kB
Active:          2910776 kB
Inactive:         344464 kB
Active(anon):    2619836 kB
Inactive(anon):   130320 kB
Active(file):     290940 kB
Inactive(file):   214144 kB
Unevictable:      107072 kB
Mlocked:          107072 kB
SwapTotal:      67108860 kB
SwapFree:       66927776 kB
Dirty:              2604 kB
Writeback:             0 kB
AnonPages:       2733148 kB
Mapped:            29128 kB
Shmem:             72460 kB
Slab:             163672 kB
SReclaimable:     133324 kB
SUnreclaim:        30348 kB
KernelStack:        3776 kB
PageTables:        10992 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:    3247052 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    442368 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61388 MiB
End job on node120 at 2011-12-31 06:56:36