Trace number 4408468

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1528.41 1530.26

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_19_19.xml
MD5SUM96fe93baa9d8ae993bfc516e2d84a024
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1317.97
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":10,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15144 MiB free)
  memory of node 1: 16384 MiB (10508 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408468-1569812596/watcher-4408468-1569812596 -o /tmp/evaluation-result-4408468-1569812596/solver-4408468-1569812596 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node125-1569787350-17998 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408468-1569812596.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22873, runsolver pid=22870
Current StackSize limit: 8192 KiB


[startup+0.100205 s]*
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26256256/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=39148 memory=15344 CPUtime=0.1 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 4006 0 0 0 10 0 0 0 20 0 1 0 557526311 40087552 3836 33554432000 4194304 6211132 140732722223648 140732722220184 139856523043968 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 9787 3836 809 493 0 3092 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39148 KiB
Current children cumulated memory: 15344 KiB

[startup+0.20986 s]*
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26253404/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=40720 memory=16992 CPUtime=0.21 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 4428 0 0 0 21 0 0 0 20 0 1 0 557526311 41697280 4248 33554432000 4194304 6211132 140732722223648 140732722220184 139856507905037 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 10180 4248 819 493 0 3485 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40720 KiB
Current children cumulated memory: 16992 KiB

[startup+0.309152 s]*
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26251172/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=41708 memory=18048 CPUtime=0.31 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 4681 0 0 0 31 0 0 0 20 0 1 0 557526311 42708992 4512 33554432000 4194304 6211132 140732722223648 140732722220184 139856507905267 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 10427 4512 819 493 0 3732 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41708 KiB
Current children cumulated memory: 18048 KiB

[startup+0.700342 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26247452/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=45704 memory=21984 CPUtime=0.69 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 5668 0 0 0 69 0 0 0 20 0 1 0 557526311 46800896 5496 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 11426 5496 819 493 0 4731 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45704 KiB
Current children cumulated memory: 21984 KiB

[startup+1.50039 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26237488/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=54072 memory=30044 CPUtime=1.49 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 7735 0 0 0 149 0 0 0 20 0 1 0 557526311 55369728 7511 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 13518 7511 819 493 0 6823 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54072 KiB
Current children cumulated memory: 30044 KiB

[startup+3.1094 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26194024/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=70888 memory=46800 CPUtime=3.1 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 12064 0 0 0 309 1 0 0 20 0 1 0 557526311 72589312 11700 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 17722 11700 819 493 0 11027 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70888 KiB
Current children cumulated memory: 46800 KiB

[startup+6.30034 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26132396/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=104432 memory=79716 CPUtime=6.28 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 20473 0 0 0 627 1 0 0 20 0 1 0 557526311 106938368 19929 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 26108 19929 819 493 0 19413 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 104432 KiB
Current children cumulated memory: 79716 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22874
/proc/meminfo: memFree=26008784/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=169760 memory=145720 CPUtime=12.69 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 37162 0 0 0 1266 3 0 0 20 0 1 0 557526311 173834240 36430 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 42440 36430 819 493 0 35745 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 169760 KiB
Current children cumulated memory: 145720 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22876
/proc/meminfo: memFree=25735404/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=303200 memory=278912 CPUtime=25.49 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 70260 0 0 0 2541 8 0 0 20 0 1 0 557526311 310476800 69728 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 75800 69728 819 493 0 69105 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 303200 KiB
Current children cumulated memory: 278912 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 22877
/proc/meminfo: memFree=25193084/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=571300 memory=542268 CPUtime=51.1 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 135289 0 0 0 5093 17 0 0 20 0 1 0 557526311 585011200 135567 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 142825 135567 819 493 0 136130 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 571300 KiB
Current children cumulated memory: 542268 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 22881
/proc/meminfo: memFree=24131240/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=1110404 memory=1070420 CPUtime=102.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 264404 0 0 0 10196 33 0 0 20 0 1 0 557526311 1137053696 267605 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 277601 267605 819 493 0 270906 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1110404 KiB
Current children cumulated memory: 1070420 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22887
/proc/meminfo: memFree=22880816/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=1734816 memory=1691000 CPUtime=162.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 414933 0 0 0 16175 54 0 0 20 0 1 0 557526311 1776451584 422750 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 433704 422750 819 493 0 427009 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1734816 KiB
Current children cumulated memory: 1691000 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22891
/proc/meminfo: memFree=21631244/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=2334888 memory=2309468 CPUtime=222.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 564946 0 0 0 22157 72 0 0 20 0 1 0 557526311 2390925312 577367 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 583722 577367 819 493 0 577027 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2334888 KiB
Current children cumulated memory: 2309468 KiB

[startup+282.3 s]
/proc/loadavg: 2.67 2.20 2.11 3/199 22895
/proc/meminfo: memFree=20379332/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=2971740 memory=2930036 CPUtime=282.3 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 715671 0 0 0 28141 89 0 0 20 0 1 0 557526311 3043061760 732509 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 742935 732509 819 493 0 736240 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 2971740 KiB
Current children cumulated memory: 2930036 KiB

[startup+342.3 s]
/proc/loadavg: 2.25 2.16 2.10 3/199 22901
/proc/meminfo: memFree=19132536/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=3571416 memory=3547180 CPUtime=342.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 866266 0 0 0 34121 108 0 0 20 0 1 0 557526311 3657129984 886795 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 892854 886795 819 493 0 886159 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 3571416 KiB
Current children cumulated memory: 3547180 KiB

[startup+402.3 s]
/proc/loadavg: 2.09 2.13 2.09 3/199 22905
/proc/meminfo: memFree=17879716/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=4226456 memory=4168240 CPUtime=402.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 1016891 0 0 0 40100 129 0 0 20 0 1 0 557526311 4327890944 1042060 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 1056614 1042060 819 493 0 1049919 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 4226456 KiB
Current children cumulated memory: 4168240 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.11 2.09 3/200 22917
/proc/meminfo: memFree=16632984/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=4825868 memory=4785940 CPUtime=462.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 1167287 0 0 0 46077 152 0 0 20 0 1 0 557526311 4941688832 1196485 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 1206467 1196485 819 493 0 1199772 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 4825868 KiB
Current children cumulated memory: 4785940 KiB


################
# More data... #
################

Current children cumulated vsize: 9826796 KiB
Current children cumulated memory: 9734388 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 22959
/proc/meminfo: memFree=5396496/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=10425680 memory=10351488 CPUtime=1002.31 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 2523548 0 0 0 99843 388 0 0 20 0 1 0 557526311 10675896320 2587872 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 2606420 2587872 819 493 0 2599725 0
Current children cumulated CPU time: 1002.31 s
Current children cumulated vsize: 10425680 KiB
Current children cumulated memory: 10351488 KiB

[startup+1062.3 s]
/proc/loadavg: 2.43 2.16 2.10 3/201 23038
/proc/meminfo: memFree=19880420/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=11025620 memory=10972084 CPUtime=1062.29 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 2673951 0 0 0 105811 418 0 0 20 0 1 0 557526311 11290234880 2743021 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 2756405 2743021 819 493 0 2749710 0
Current children cumulated CPU time: 1062.29 s
Current children cumulated vsize: 11025620 KiB
Current children cumulated memory: 10972084 KiB

[startup+1122.3 s]
/proc/loadavg: 2.16 2.13 2.09 3/201 23042
/proc/meminfo: memFree=19203424/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=11627144 memory=11591908 CPUtime=1122.27 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 2824581 0 0 0 111778 449 0 0 20 0 1 0 557526311 11906195456 2897977 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 2906786 2897977 819 493 0 2900091 0
Current children cumulated CPU time: 1122.27 s
Current children cumulated vsize: 11627144 KiB
Current children cumulated memory: 11591908 KiB

[startup+1182.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/201 23046
/proc/meminfo: memFree=18557932/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=12415524 memory=12213244 CPUtime=1182.26 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 2975579 0 0 0 117746 480 0 0 20 0 1 0 557526311 12713496576 3053311 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3103881 3053311 819 493 0 3097186 0
Current children cumulated CPU time: 1182.26 s
Current children cumulated vsize: 12415524 KiB
Current children cumulated memory: 12213244 KiB

[startup+1242.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/201 23052
/proc/meminfo: memFree=17922104/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=13017048 memory=12833228 CPUtime=1242.25 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3126192 0 0 0 123714 511 0 0 20 0 1 0 557526311 13329457152 3208307 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3254262 3208307 819 493 0 3247567 0
Current children cumulated CPU time: 1242.25 s
Current children cumulated vsize: 13017048 KiB
Current children cumulated memory: 12833228 KiB

[startup+1302.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/201 23056
/proc/meminfo: memFree=17292476/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=13618440 memory=13455140 CPUtime=1302.23 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3276807 0 0 0 129682 541 0 0 20 0 1 0 557526311 13945282560 3363785 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3404610 3363785 819 493 0 3397915 0
Current children cumulated CPU time: 1302.23 s
Current children cumulated vsize: 13618440 KiB
Current children cumulated memory: 13455140 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/199 23061
/proc/meminfo: memFree=16661572/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=14219964 memory=14075228 CPUtime=1362.22 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3427441 0 0 0 135648 574 0 0 20 0 1 0 557526311 14561243136 3518807 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3554991 3518807 819 493 0 3548296 0
Current children cumulated CPU time: 1362.22 s
Current children cumulated vsize: 14219964 KiB
Current children cumulated memory: 14075228 KiB

[startup+1422.3 s]
/proc/loadavg: 2.16 2.08 2.07 3/199 23067
/proc/meminfo: memFree=16037920/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=14821356 memory=14697096 CPUtime=1422.2 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3578059 0 0 0 141613 607 0 0 20 0 1 0 557526311 15177068544 3674274 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3705339 3674274 819 493 0 3698644 0
Current children cumulated CPU time: 1422.2 s
Current children cumulated vsize: 14821356 KiB
Current children cumulated memory: 14697096 KiB

[startup+1482.3 s]
/proc/loadavg: 2.46 2.20 2.11 3/199 23071
/proc/meminfo: memFree=15417220/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15421560 memory=15315600 CPUtime=1482.18 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3728381 0 0 0 147575 643 0 0 20 0 1 0 557526311 15791677440 3828900 33554432000 4194304 6211132 140732722223648 140732722197208 5451514 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3855390 3828900 819 493 0 3848695 0
Current children cumulated CPU time: 1482.18 s
Current children cumulated vsize: 15421560 KiB
Current children cumulated memory: 15315600 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1527.4 s]
/proc/loadavg: 2.28 2.19 2.11 3/199 23074
/proc/meminfo: memFree=14953060/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15872340 memory=15780792 CPUtime=1527.27 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) R 22870 22873 17967 0 -1 4202496 3841291 0 0 0 152055 672 0 0 20 0 1 0 557526311 16253276160 3945198 33554432000 4194304 6211132 140732722223648 140732722197208 139856506981349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3968085 3945198 819 493 0 3961390 0
Current children cumulated CPU time: 1527.27 s
Current children cumulated vsize: 15872340 KiB
Current children cumulated memory: 15780792 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1530.26 s]
# the end of solver process 22873 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1520.81 s, system=7.6082 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1528 s]*
/proc/loadavg: 2.26 2.18 2.11 3/200 23075
/proc/meminfo: memFree=14655708/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15872340 memory=15780792 CPUtime=1527.36 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) S 22870 22873 17967 0 -1 512 3841297 0 0 0 152063 673 0 0 20 0 1 0 557526311 16253276160 3945198 33554432000 4194304 6211132 140732722223648 140732722197208 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3968085 3945198 819 493 0 3961390 0
Current children cumulated CPU time: 1527.36 s
Current children cumulated vsize: 15872340 KiB
Current children cumulated memory: 15780792 KiB

[startup+1528.8 s]
/proc/loadavg: 2.26 2.18 2.11 3/200 23075
/proc/meminfo: memFree=14655708/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15872340 memory=15780792 CPUtime=1527.47 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) S 22870 22873 17967 0 -1 512 3841297 0 0 0 152073 674 0 0 20 0 1 0 557526311 16253276160 3945198 33554432000 4194304 6211132 140732722223648 140732722197208 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3968085 3945198 819 493 0 3961390 0
Current children cumulated CPU time: 1527.47 s
Current children cumulated vsize: 15872340 KiB
Current children cumulated memory: 15780792 KiB

[startup+1529.2 s]
/proc/loadavg: 2.26 2.18 2.11 4/200 23076
/proc/meminfo: memFree=14169384/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15872340 memory=15780792 CPUtime=1527.51 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) S 22870 22873 17967 0 -1 512 3841297 0 0 0 152077 674 0 0 20 0 1 0 557526311 16253276160 3945198 33554432000 4194304 6211132 140732722223648 140732722197208 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3968085 3945198 819 493 0 3961390 0
Current children cumulated CPU time: 1527.51 s
Current children cumulated vsize: 15872340 KiB
Current children cumulated memory: 15780792 KiB

[startup+1529.4 s]
/proc/loadavg: 2.26 2.18 2.11 4/200 23076
/proc/meminfo: memFree=14169384/32770624 swapFree=66975648/67108860
[pid=22873] ppid=22870 vsize=15872340 memory=15780792 CPUtime=1527.54 cores=0,2,4,6
/proc/22873/stat : 22873 (cosoco) S 22870 22873 17967 0 -1 512 3841297 0 0 0 152080 674 0 0 20 0 1 0 557526311 16253276160 3945198 33554432000 4194304 6211132 140732722223648 140732722197208 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 9375744 140732722226187 140732722226289 140732722226289 140732722229198 0
/proc/22873/statm: 3968085 3945198 819 493 0 3961390 0
Current children cumulated CPU time: 1527.54 s
Current children cumulated vsize: 15872340 KiB
Current children cumulated memory: 15780792 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1530.26
CPU time (s): 1528.41
CPU user time (s): 1520.81
CPU system time (s): 7.6082
CPU usage (%): 99.8794
Max. virtual memory (cumulated for all children) (KiB): 15872340
Max. memory (cumulated for all children) (KiB): 15780792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1520.81
system time used= 7.6082
maximum resident set size= 15780984
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3841297
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121139
involuntary context switches= 1916


# summary of solver processes directly reported to runsolver:
#   pid: 22873
#   total CPU time (s): 1528.41
#   total CPU user time (s): 1520.81
#   total CPU system time (s): 7.6082

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.44994 second user time and 10.6032 second system time

The end

Launcher Data 

Begin job on node125 at 2019-09-30 05:02:32
IDJOB=4408468
IDBENCH=139614
IDSOLVER=2874
FILE ID=node125/4408468-1569812596
RUNJOBID= node125-1569787350-17998
PBS_JOBID= 21705828
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_19_19.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408468-1569812596/watcher-4408468-1569812596 -o /tmp/evaluation-result-4408468-1569812596/solver-4408468-1569812596 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node125-1569787350-17998 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408468-1569812596.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 96fe93baa9d8ae993bfc516e2d84a024
RANDOM SEED=122429216

node125.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26268744 kB
MemAvailable:   26651072 kB
Buffers:          203548 kB
Cached:           517252 kB
SwapCached:        29880 kB
Active:          5584488 kB
Inactive:         357264 kB
Active(anon):    5204100 kB
Inactive(anon):    97756 kB
Active(file):     380388 kB
Inactive(file):   259508 kB
Unevictable:      107476 kB
Mlocked:          107476 kB
SwapTotal:      67108860 kB
SwapFree:       66975648 kB
Dirty:              2804 kB
Writeback:             0 kB
AnonPages:       5304240 kB
Mapped:            28524 kB
Shmem:             72028 kB
Slab:             145772 kB
SReclaimable:     116532 kB
SUnreclaim:        29240 kB
KernelStack:        3760 kB
PageTables:        15816 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    5758180 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    813056 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61472 MiB
End job on node125 at 2019-09-30 05:28:03