Trace number 4389389

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (MO) 2300.04 2302.07

General information on the benchmark

NameBibd/Bibd-sum-lex/
Bibd-sum-09-120-40-03-10.xml
MD5SUM516a10ad09fd7e852a109bf36c14a2d3
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark34.1236
Satisfiable
(Un)Satisfiability was proved
Number of variables1080
Number of constraints166
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":1080}]
Minimum variable degree11
Maximum variable degree11
Distribution of variable degrees[{"degree":11,"count":1080}]
Minimum constraint arity9
Maximum constraint arity1080
Distribution of constraint arities[{"arity":9,"count":120},{"arity":120,"count":9},{"arity":240,"count":36},{"arity":1080,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":165}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (11925 MiB free)
  memory of node 1: 16384 MiB (12639 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389389-1568324267/watcher-4389389-1568324267 -o /tmp/evaluation-result-4389389-1568324267/solver-4389389-1568324267 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9510 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389389-1568324267.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=11762, runsolver pid=11759


[startup+0.100964 s]*
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25151648/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=29296 memory=5704 CPUtime=0.1 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 1614 0 0 0 10 0 0 0 20 0 1 0 408433161 29999104 1426 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 7324 1426 840 493 0 629 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29296 KiB
Current children cumulated memory: 5704 KiB

[startup+0.210942 s]*
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25150912/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=30088 memory=6496 CPUtime=0.2 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 1803 0 0 0 20 0 0 0 20 0 1 0 408433161 30810112 1624 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 7522 1624 840 493 0 827 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 30088 KiB
Current children cumulated memory: 6496 KiB

[startup+0.310628 s]*
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25150540/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=30748 memory=7024 CPUtime=0.31 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 1968 0 0 0 30 1 0 0 20 0 1 0 408433161 31485952 1756 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 7687 1756 840 493 0 992 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30748 KiB
Current children cumulated memory: 7024 KiB

[startup+0.70034 s]
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25149088/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=33256 memory=9664 CPUtime=0.69 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 2604 0 0 0 66 3 0 0 20 0 1 0 408433161 34054144 2416 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 8314 2416 840 493 0 1619 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33256 KiB
Current children cumulated memory: 9664 KiB

[startup+1.50034 s]
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25145740/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=38756 memory=15208 CPUtime=1.49 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3979 0 0 0 146 3 0 0 20 0 1 0 408433161 39686144 3802 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 9689 3802 840 493 0 2994 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38756 KiB
Current children cumulated memory: 15208 KiB

[startup+7.52352 s]
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25145740/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=80228 memory=56432 CPUtime=7.51 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 14555 0 0 0 747 4 0 0 20 0 1 0 408433161 82153472 14108 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 20057 14108 840 493 0 13362 0
Current children cumulated CPU time: 7.51 s
Current children cumulated vsize: 80228 KiB
Current children cumulated memory: 56432 KiB

[startup+7.60036 s]
/proc/loadavg: 2.21 2.07 2.06 3/201 11763
/proc/meminfo: memFree=25145740/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=80756 memory=56960 CPUtime=7.58 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 14686 0 0 0 754 4 0 0 20 0 1 0 408433161 82694144 14240 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 20189 14240 840 493 0 13494 0
Current children cumulated CPU time: 7.58 s
Current children cumulated vsize: 80756 KiB
Current children cumulated memory: 56960 KiB

[startup+12.7003 s]
/proc/loadavg: 2.56 2.15 2.08 4/202 11766
/proc/meminfo: memFree=25567372/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=115768 memory=92248 CPUtime=12.67 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 23458 0 0 0 1263 4 0 0 20 0 1 0 408433161 118546432 23062 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 28942 23062 840 493 0 22247 0
Current children cumulated CPU time: 12.67 s
Current children cumulated vsize: 115768 KiB
Current children cumulated memory: 92248 KiB

[startup+25.5003 s]
/proc/loadavg: 2.47 2.14 2.08 3/199 11766
/proc/meminfo: memFree=26004252/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=204224 memory=180128 CPUtime=25.48 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 45588 0 0 0 2540 8 0 0 20 0 1 0 408433161 209125376 45032 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 51056 45032 840 493 0 44361 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 204224 KiB
Current children cumulated memory: 180128 KiB

[startup+51.1003 s]
/proc/loadavg: 2.29 2.13 2.08 3/199 11769
/proc/meminfo: memFree=25825572/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=381536 memory=356352 CPUtime=51.07 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 89668 0 0 0 5093 14 0 0 20 0 1 0 408433161 390692864 89088 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 95384 89088 840 493 0 88689 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 381536 KiB
Current children cumulated memory: 356352 KiB

[startup+102.3 s]
/proc/loadavg: 2.18 2.12 2.08 3/200 11774
/proc/meminfo: memFree=25472888/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=736928 memory=710648 CPUtime=102.26 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 177779 0 0 0 10201 25 0 0 20 0 1 0 408433161 754614272 177662 33554432000 4194304 6210612 140726259951120 140726259898920 5446458 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 184232 177662 840 493 0 177537 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 736928 KiB
Current children cumulated memory: 710648 KiB

[startup+162.3 s]
/proc/loadavg: 2.12 2.12 2.08 3/201 11786
/proc/meminfo: memFree=25059132/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=1151836 memory=1123636 CPUtime=162.25 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 280022 0 0 0 16187 38 0 0 20 0 1 0 408433161 1179480064 280909 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 287959 280909 840 493 0 281264 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1151836 KiB
Current children cumulated memory: 1123636 KiB

[startup+222.3 s]
/proc/loadavg: 2.04 2.10 2.07 3/203 11815
/proc/meminfo: memFree=24646052/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=1559452 memory=1535604 CPUtime=222.24 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 381966 0 0 0 22172 52 0 0 20 0 1 0 408433161 1596878848 383901 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 389863 383901 840 493 0 383168 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 1559452 KiB
Current children cumulated memory: 1535604 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.08 2.07 3/202 11819
/proc/meminfo: memFree=24231956/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=1977608 memory=1948844 CPUtime=282.24 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 484259 0 0 0 28157 67 0 0 20 0 1 0 408433161 2025070592 487211 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 494402 487211 840 493 0 487707 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 1977608 KiB
Current children cumulated memory: 1948844 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/202 11823
/proc/meminfo: memFree=23818468/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=2401100 memory=2361320 CPUtime=342.22 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 586468 0 0 0 34140 82 0 0 20 0 1 0 408433161 2458726400 590330 33554432000 4194304 6210612 140726259951120 140726259898920 140229748550538 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 600275 590330 840 493 0 593580 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 2401100 KiB
Current children cumulated memory: 2361320 KiB

[startup+402.3 s]
/proc/loadavg: 2.05 2.07 2.06 3/202 11829
/proc/meminfo: memFree=23403232/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=2808452 memory=2775436 CPUtime=402.22 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 688577 0 0 0 40122 100 0 0 20 0 1 0 408433161 2875854848 693859 33554432000 4194304 6210612 140726259951120 140726259898920 140229739529790 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 702113 693859 840 493 0 695418 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 2808452 KiB
Current children cumulated memory: 2775436 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.06 2.06 3/200 11833
/proc/meminfo: memFree=22989664/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=3216200 memory=3189264 CPUtime=462.22 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 790674 0 0 0 46105 117 0 0 20 0 1 0 408433161 3293388800 797316 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 804050 797316 840 493 0 797355 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 3216200 KiB
Current children cumulated memory: 3189264 KiB


################
# More data... #
################

Current children cumulated vsize: 11476424 KiB
Current children cumulated memory: 11449600 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12075
/proc/meminfo: memFree=7405908/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=11966424 memory=11862008 CPUtime=1722.04 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 2935537 0 0 0 171690 514 0 0 20 0 1 0 408433161 12253618176 2965502 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 2991606 2965502 840 493 0 2984911 0
Current children cumulated CPU time: 1722.04 s
Current children cumulated vsize: 11966424 KiB
Current children cumulated memory: 11862008 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12079
/proc/meminfo: memFree=6583392/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=12373512 memory=12275068 CPUtime=1782.03 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3037533 0 0 0 177668 535 0 0 20 0 1 0 408433161 12670476288 3068767 33554432000 4194304 6210612 140726259951120 140726259898920 140229739529779 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3093378 3068767 840 493 0 3086683 0
Current children cumulated CPU time: 1782.03 s
Current children cumulated vsize: 12373512 KiB
Current children cumulated memory: 12275068 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12086
/proc/meminfo: memFree=5758460/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=12780468 memory=12688388 CPUtime=1842.02 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3139606 0 0 0 183644 558 0 0 20 0 1 0 408433161 13087199232 3172097 33554432000 4194304 6210612 140726259951120 140726259898920 5440657 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3195117 3172097 840 493 0 3188422 0
Current children cumulated CPU time: 1842.02 s
Current children cumulated vsize: 12780468 KiB
Current children cumulated memory: 12688388 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12090
/proc/meminfo: memFree=4938796/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=13186896 memory=13098944 CPUtime=1902.02 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3241500 0 0 0 189621 581 0 0 20 0 1 0 408433161 13503381504 3274736 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3296724 3274736 840 493 0 3290029 0
Current children cumulated CPU time: 1902.02 s
Current children cumulated vsize: 13186896 KiB
Current children cumulated memory: 13098944 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12102
/proc/meminfo: memFree=4117308/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=13593060 memory=13510980 CPUtime=1962.01 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3343316 0 0 0 195594 607 0 0 20 0 1 0 408433161 13919293440 3377745 33554432000 4194304 6210612 140726259951120 140726259898920 140229738601278 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3398265 3377745 840 493 0 3391570 0
Current children cumulated CPU time: 1962.01 s
Current children cumulated vsize: 13593060 KiB
Current children cumulated memory: 13510980 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 12108
/proc/meminfo: memFree=3296044/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=13998960 memory=13923304 CPUtime=2022 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3445160 0 0 0 201563 637 0 0 20 0 1 0 408433161 14334935040 3480826 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3499740 3480826 840 493 0 3493045 0
Current children cumulated CPU time: 2022 s
Current children cumulated vsize: 13998960 KiB
Current children cumulated memory: 13923304 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12112
/proc/meminfo: memFree=2473588/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=14404860 memory=14335076 CPUtime=2081.98 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3546926 0 0 0 207530 668 0 0 20 0 1 0 408433161 14750576640 3583769 33554432000 4194304 6210612 140726259951120 140726259898920 5012698 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3601215 3583769 840 493 0 3594520 0
Current children cumulated CPU time: 2081.98 s
Current children cumulated vsize: 14404860 KiB
Current children cumulated memory: 14335076 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12116
/proc/meminfo: memFree=1654116/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=14810628 memory=14747112 CPUtime=2141.98 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3648681 0 0 0 213501 697 0 0 20 0 1 0 408433161 15166083072 3686778 33554432000 4194304 6210612 140726259951120 140726259898920 5012701 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3702657 3686778 840 493 0 3695962 0
Current children cumulated CPU time: 2141.98 s
Current children cumulated vsize: 14810628 KiB
Current children cumulated memory: 14747112 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 12123
/proc/meminfo: memFree=834308/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15216264 memory=15158864 CPUtime=2201.97 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3750407 0 0 0 219465 732 0 0 20 0 1 0 408433161 15581454336 3789716 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3804066 3789716 840 493 0 3797371 0
Current children cumulated CPU time: 2201.97 s
Current children cumulated vsize: 15216264 KiB
Current children cumulated memory: 15158864 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12127
/proc/meminfo: memFree=189824/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15622164 memory=15568884 CPUtime=2261.96 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3852216 0 0 0 225433 763 0 0 20 0 1 0 408433161 15997095936 3892221 33554432000 4194304 6210612 140726259951120 140726259898920 5446100 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3905541 3892221 840 493 0 3898846 0
Current children cumulated CPU time: 2261.96 s
Current children cumulated vsize: 15622164 KiB
Current children cumulated memory: 15568884 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2299.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12130
/proc/meminfo: memFree=205136/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15872436 memory=15823324 CPUtime=2298.96 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 4202496 3914964 0 0 0 229117 779 0 0 20 0 1 0 408433161 16253374464 3955831 33554432000 4194304 6210612 140726259951120 140726259898920 140229738605541 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3968109 3955831 840 493 0 3961414 0
Current children cumulated CPU time: 2298.96 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15823324 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2302.07 s]
# the end of solver process 11762 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2291.41 s, system=8.62829 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2300.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12131
/proc/meminfo: memFree=188108/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15872436 memory=15823324 CPUtime=2299.11 cores=4-7
/proc/11762/stat : 11762 (cosoco) S 11759 11762 9478 0 -1 512 3914968 0 0 0 229129 782 0 0 20 0 1 0 408433161 16253374464 3955831 33554432000 4194304 6210612 140726259951120 140726259898920 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3968109 3955831 840 493 0 3961414 0
Current children cumulated CPU time: 2299.11 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15823324 KiB

[startup+2301.1 s]
/proc/loadavg: 2.08 2.03 2.05 4/200 12131
/proc/meminfo: memFree=197856/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15872436 memory=15823324 CPUtime=2299.23 cores=4-7
/proc/11762/stat : 11762 (cosoco) R 11759 11762 9478 0 -1 512 3914968 0 0 0 229139 784 0 0 20 0 1 0 408433161 16253374464 3955831 33554432000 4194304 6210612 140726259951120 140726259898920 5188952 0 16384 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3968109 3955831 840 493 0 3961414 0
Current children cumulated CPU time: 2299.23 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15823324 KiB

[startup+2301.3 s]
/proc/loadavg: 2.08 2.03 2.05 4/200 12131
/proc/meminfo: memFree=197856/32770688 swapFree=66919992/67108860
[pid=11762] ppid=11759 vsize=15872436 memory=15823324 CPUtime=2299.27 cores=4-7
/proc/11762/stat : 11762 (cosoco) S 11759 11762 9478 0 -1 512 3914968 0 0 0 229141 786 0 0 20 0 1 0 408433161 16253374464 3955831 33554432000 4194304 6210612 140726259951120 140726259898920 5188952 0 16384 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 34213888 140726259958795 140726259958897 140726259958897 140726259961806 0
/proc/11762/statm: 3968109 3955831 840 493 0 3961414 0
Current children cumulated CPU time: 2299.27 s
Current children cumulated vsize: 15872436 KiB
Current children cumulated memory: 15823324 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2302.07
CPU time (s): 2300.04
CPU user time (s): 2291.41
CPU system time (s): 8.62829
CPU usage (%): 99.9119
Max. virtual memory (cumulated for all children) (KiB): 15872436
Max. memory (cumulated for all children) (KiB): 15823324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2291.41
system time used= 8.62829
maximum resident set size= 15823404
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3914968
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121398
involuntary context switches= 1982


# summary of solver processes directly reported to runsolver:
#   pid: 11762
#   total CPU time (s): 2300.04
#   total CPU user time (s): 2291.41
#   total CPU system time (s): 8.62829

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.89306 second user time and 17.5601 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-14 05:58:11
IDJOB=4389389
IDBENCH=123858
IDSOLVER=2829
FILE ID=node120/4389389-1568324267
RUNJOBID= node120-1323826654-9510
PBS_JOBID= 21701129
Free space on /tmp= 58660 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Bibd/Bibd-sum-lex/Bibd-sum-09-120-40-03-10.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389389-1568324267/watcher-4389389-1568324267 -o /tmp/evaluation-result-4389389-1568324267/solver-4389389-1568324267 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9510 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389389-1568324267.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 516a10ad09fd7e852a109bf36c14a2d3
RANDOM SEED=1400653929

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        25154376 kB
MemAvailable:   31790812 kB
Buffers:          146704 kB
Cached:          6760836 kB
SwapCached:        77548 kB
Active:          1217464 kB
Inactive:        5775240 kB
Active(anon):       8392 kB
Inactive(anon):   126516 kB
Active(file):    1209072 kB
Inactive(file):  5648724 kB
Unevictable:      108228 kB
Mlocked:          108228 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:            823516 kB
Writeback:         80776 kB
AnonPages:        117208 kB
Mapped:            49892 kB
Shmem:             41008 kB
Slab:             218484 kB
SReclaimable:     188948 kB
SUnreclaim:        29536 kB
KernelStack:        3520 kB
PageTables:         5796 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     548656 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 58680 MiB
End job on node120 at 2011-12-14 06:36:33