Trace number 4397205

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1548.47 1550.54

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_17_11.xml
MD5SUMec43b711d2aa9c243757c5391c9c8921
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark25
Best CPU time to get the best result obtained on this benchmark2520.09
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":10,"count":111},{"size":51,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10744 MiB free)
  memory of node 1: 16384 MiB (15913 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397205-1568594146/watcher-4397205-1568594146 -o /tmp/evaluation-result-4397205-1568594146/solver-4397205-1568594146 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568594102-5382 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397205-1568594146.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5401, runsolver pid=5398

[startup+0.10012 s]*
/proc/loadavg: 0.92 1.23 1.66 3/200 5412
/proc/meminfo: memFree=27275536/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=39152 memory=15220 CPUtime=0.1 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 4007 0 0 0 10 0 0 0 20 0 1 0 435663246 40091648 3805 33554432000 4194304 6211092 140724393048320 140724393044856 5547718 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 9788 3805 809 493 0 3093 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15220 KiB

[startup+0.209934 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27271444/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=40728 memory=16868 CPUtime=0.21 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 4421 0 0 0 21 0 0 0 20 0 1 0 435663246 41705472 4217 33554432000 4194304 6211092 140724393048320 140724393044856 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 10182 4217 819 493 0 3487 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16868 KiB

[startup+0.30915 s]*
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27269568/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=41712 memory=17924 CPUtime=0.31 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 4673 0 0 0 31 0 0 0 20 0 1 0 435663246 42713088 4481 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 10428 4481 819 493 0 3733 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17924 KiB

[startup+0.700231 s]
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27265600/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=45708 memory=21728 CPUtime=0.69 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 5644 0 0 0 69 0 0 0 20 0 1 0 435663246 46804992 5432 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 11427 5432 819 493 0 4732 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45708 KiB
Current children cumulated memory: 21728 KiB

[startup+1.50023 s]
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27256052/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=53812 memory=30048 CPUtime=1.48 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 7675 0 0 0 148 0 0 0 20 0 1 0 435663246 55103488 7512 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 13453 7512 819 493 0 6758 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 53812 KiB
Current children cumulated memory: 30048 KiB

[startup+3.10937 s]
/proc/loadavg: 0.92 1.23 1.66 3/199 5412
/proc/meminfo: memFree=27215468/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=70364 memory=46280 CPUtime=3.1 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 11928 0 0 0 309 1 0 0 20 0 1 0 435663246 72052736 11570 33554432000 4194304 6211092 140724393048320 140724393021880 140085839942816 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 17591 11570 819 493 0 10896 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70364 KiB
Current children cumulated memory: 46280 KiB

[startup+6.30028 s]
/proc/loadavg: 0.85 1.21 1.65 3/199 5412
/proc/meminfo: memFree=27154792/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=103380 memory=78688 CPUtime=6.29 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 20202 0 0 0 627 2 0 0 20 0 1 0 435663246 105861120 19672 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 25845 19672 819 493 0 19150 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 103380 KiB
Current children cumulated memory: 78688 KiB

[startup+12.7003 s]
/proc/loadavg: 0.94 1.22 1.65 3/199 5413
/proc/meminfo: memFree=27033272/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=168048 memory=143900 CPUtime=12.69 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 36582 0 0 0 1265 4 0 0 20 0 1 0 435663246 172081152 35975 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 42012 35975 819 493 0 35317 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 168048 KiB
Current children cumulated memory: 143900 KiB

[startup+25.5003 s]
/proc/loadavg: 1.18 1.26 1.66 3/199 5413
/proc/meminfo: memFree=26767632/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=299904 memory=275476 CPUtime=25.47 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 69052 0 0 0 2539 8 0 0 20 0 1 0 435663246 307101696 68869 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 74976 68869 819 493 0 68281 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 299904 KiB
Current children cumulated memory: 275476 KiB

[startup+51.1095 s]
/proc/loadavg: 1.46 1.32 1.67 3/199 5415
/proc/meminfo: memFree=26242820/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=565100 memory=535760 CPUtime=51.08 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 133641 0 0 0 5091 17 0 0 20 0 1 0 435663246 578662400 133940 33554432000 4194304 6211092 140724393048320 140724393021880 5441120 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 141275 133940 819 493 0 134580 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 565100 KiB
Current children cumulated memory: 535760 KiB

[startup+102.3 s]
/proc/loadavg: 1.84 1.44 1.69 3/199 5419
/proc/meminfo: memFree=25208796/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=1081992 memory=1057872 CPUtime=102.26 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 261175 0 0 0 10192 34 0 0 20 0 1 0 435663246 1107959808 264468 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 270498 264468 819 493 0 263803 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1081992 KiB
Current children cumulated memory: 1057872 KiB

[startup+162.3 s]
/proc/loadavg: 1.94 1.54 1.71 3/199 5423
/proc/meminfo: memFree=23990056/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=1715944 memory=1672020 CPUtime=162.24 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 410070 0 0 0 16172 52 0 0 20 0 1 0 435663246 1757126656 418005 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 428986 418005 819 493 0 422291 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 1715944 KiB
Current children cumulated memory: 1672020 KiB

[startup+222.3 s]
/proc/loadavg: 1.98 1.62 1.72 3/199 5427
/proc/meminfo: memFree=22775824/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=2308888 memory=2283360 CPUtime=222.22 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 558328 0 0 0 22150 72 0 0 20 0 1 0 435663246 2364301312 570840 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 577222 570840 819 493 0 570527 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 2308888 KiB
Current children cumulated memory: 2283360 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.69 1.74 3/199 5433
/proc/meminfo: memFree=21560056/32770624 swapFree=67001936/67108860
[pid=5401] ppid=5398 vsize=2938876 memory=2894988 CPUtime=282.21 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 707188 0 0 0 28130 91 0 0 20 0 1 0 435663246 3009409024 723747 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 734719 723747 819 493 0 728024 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 2938876 KiB
Current children cumulated memory: 2894988 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.75 1.76 3/200 5445
/proc/meminfo: memFree=20344932/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=3531688 memory=3506388 CPUtime=342.19 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 855480 0 0 0 34108 111 0 0 20 0 1 0 435663246 3616448512 876597 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 882922 876597 819 493 0 876227 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3531688 KiB
Current children cumulated memory: 3506388 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.79 1.78 3/200 5449
/proc/meminfo: memFree=19126936/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=4179996 memory=4119656 CPUtime=402.18 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 1004310 0 0 0 40087 131 0 0 20 0 1 0 435663246 4280315904 1029914 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 1044999 1029914 819 493 0 1038304 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 4179996 KiB
Current children cumulated memory: 4119656 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.83 1.79 3/200 5455
/proc/meminfo: memFree=17912328/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=4772808 memory=4730964 CPUtime=462.16 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 1152667 0 0 0 46068 148 0 0 20 0 1 0 435663246 4887355392 1182741 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 1193202 1182741 819 493 0 1186507 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 4772808 KiB
Current children cumulated memory: 4730964 KiB


################
# More data... #
################

Current children cumulated vsize: 9720540 KiB
Current children cumulated memory: 9623964 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 1.98 1.88 3/200 5505
/proc/meminfo: memFree=6975116/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=10312692 memory=10236612 CPUtime=1002.03 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 2488940 0 0 0 99844 359 0 0 20 0 1 0 435663246 10560196608 2559153 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 2578173 2559153 819 493 0 2571478 0
Current children cumulated CPU time: 1002.03 s
Current children cumulated vsize: 10312692 KiB
Current children cumulated memory: 10236612 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/200 5509
/proc/meminfo: memFree=5761432/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=10904844 memory=10847216 CPUtime=1062.01 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 2637245 0 0 0 105820 381 0 0 20 0 1 0 435663246 11166560256 2711804 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 2726211 2711804 819 493 0 2719516 0
Current children cumulated CPU time: 1062.01 s
Current children cumulated vsize: 10904844 KiB
Current children cumulated memory: 10847216 KiB

[startup+1122.3 s]
/proc/loadavg: 2.05 2.00 1.90 3/200 5513
/proc/meminfo: memFree=4549240/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=11496864 memory=11457556 CPUtime=1122 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 2785481 0 0 0 111792 408 0 0 20 0 1 0 435663246 11772788736 2864389 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 2874216 2864389 819 493 0 2867521 0
Current children cumulated CPU time: 1122 s
Current children cumulated vsize: 11496864 KiB
Current children cumulated memory: 11457556 KiB

[startup+1182.3 s]
/proc/loadavg: 2.02 2.00 1.91 3/200 5519
/proc/meminfo: memFree=3336904/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=12275476 memory=12069228 CPUtime=1181.99 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 2934048 0 0 0 117761 438 0 0 20 0 1 0 435663246 12570087424 3017307 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3068869 3017307 819 493 0 3062174 0
Current children cumulated CPU time: 1181.99 s
Current children cumulated vsize: 12275476 KiB
Current children cumulated memory: 12069228 KiB

[startup+1242.3 s]
/proc/loadavg: 2.01 2.00 1.91 3/199 5524
/proc/meminfo: memFree=2125916/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=12867232 memory=12679304 CPUtime=1241.97 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3082266 0 0 0 123731 466 0 0 20 0 1 0 435663246 13176045568 3169826 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3216808 3169826 819 493 0 3210113 0
Current children cumulated CPU time: 1241.97 s
Current children cumulated vsize: 12867232 KiB
Current children cumulated memory: 12679304 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/199 5528
/proc/meminfo: memFree=917992/32770624 swapFree=67001940/67108860
[pid=5401] ppid=5398 vsize=13458988 memory=13289644 CPUtime=1301.97 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3230453 0 0 0 129700 497 0 0 20 0 1 0 435663246 13782003712 3322411 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3364747 3322411 819 493 0 3358052 0
Current children cumulated CPU time: 1301.97 s
Current children cumulated vsize: 13458988 KiB
Current children cumulated memory: 13289644 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/199 5534
/proc/meminfo: memFree=184792/32770624 swapFree=66766968/67108860
[pid=5401] ppid=5398 vsize=14049820 memory=13899752 CPUtime=1361.95 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3378437 0 0 0 135666 529 0 0 20 0 1 0 435663246 14387015680 3417000 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3512455 3417000 514 493 0 3505760 0
Current children cumulated CPU time: 1361.95 s
Current children cumulated vsize: 14049820 KiB
Current children cumulated memory: 13899752 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.93 4/199 5539
/proc/meminfo: memFree=1841836/32770624 swapFree=66156664/67108860
[pid=5401] ppid=5398 vsize=14638804 memory=14507248 CPUtime=1421.96 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3526453 0 0 0 141633 563 0 0 20 0 1 0 435663246 14990135296 3416274 33554432000 4194304 6211092 140724393048320 140724393021880 5478409 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3659701 3416274 514 493 0 3653006 0
Current children cumulated CPU time: 1421.96 s
Current children cumulated vsize: 14638804 KiB
Current children cumulated memory: 14507248 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/199 5543
/proc/meminfo: memFree=2195628/32770624 swapFree=66156728/67108860
[pid=5401] ppid=5398 vsize=15229768 memory=15116564 CPUtime=1481.96 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3674957 0 0 0 147594 602 0 0 20 0 1 0 435663246 15595282432 3568603 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3807442 3568603 514 493 0 3800747 0
Current children cumulated CPU time: 1481.96 s
Current children cumulated vsize: 15229768 KiB
Current children cumulated memory: 15116564 KiB

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/200 5556
/proc/meminfo: memFree=998220/32770624 swapFree=66157352/67108860
[pid=5401] ppid=5398 vsize=15819808 memory=15726944 CPUtime=1541.97 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3822784 0 0 0 153547 650 0 0 20 0 1 0 435663246 16199483392 3721198 33554432000 4194304 6211092 140724393048320 140724393021880 5451482 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3954952 3721198 514 493 0 3948257 0
Current children cumulated CPU time: 1541.97 s
Current children cumulated vsize: 15819808 KiB
Current children cumulated memory: 15726944 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1547.6 s]
/proc/loadavg: 2.00 2.00 1.94 3/200 5556
/proc/meminfo: memFree=898792/32770624 swapFree=66157352/67108860
[pid=5401] ppid=5398 vsize=15872080 memory=15779216 CPUtime=1547.27 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) R 5398 5401 5350 0 -1 4202496 3835835 0 0 0 154074 653 0 0 20 0 1 0 435663246 16253009920 3734266 33554432000 4194304 6211092 140724393048320 140724393021880 140085830609893 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3968020 3734266 514 493 0 3961325 0
Current children cumulated CPU time: 1547.27 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15779216 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1550.54 s]
# the end of solver process 5401 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1540.84 s, system=7.62511 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1548.8 s]
/proc/loadavg: 2.00 2.00 1.94 2/201 5557
/proc/meminfo: memFree=876408/32770624 swapFree=66157360/67108860
[pid=5401] ppid=5398 vsize=15873004 memory=15780344 CPUtime=1547.62 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) D 5398 5401 5350 0 -1 512 3851469 0 2208 0 154084 678 0 0 20 0 1 0 435663246 16253956096 3752083 33554432000 4194304 6211092 140724393048320 140724393021880 5189768 0 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 67 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3968251 3752083 519 493 0 3961556 0
Current children cumulated CPU time: 1547.62 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15780344 KiB

[startup+1549.2 s]
/proc/loadavg: 2.00 2.00 1.94 2/201 5557
/proc/meminfo: memFree=612644/32770624 swapFree=66157364/67108860
[pid=5401] ppid=5398 vsize=15873004 memory=15780344 CPUtime=1547.67 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) D 5398 5401 5350 0 -1 512 3855716 0 2815 0 154084 683 0 0 20 0 1 0 435663246 16253956096 3756967 33554432000 4194304 6211092 140724393048320 140724393021880 5189768 0 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 103 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3968251 3756967 519 493 0 3961556 0
Current children cumulated CPU time: 1547.67 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15780344 KiB

[startup+1549.6 s]
/proc/loadavg: 2.00 2.00 1.94 2/201 5557
/proc/meminfo: memFree=612644/32770624 swapFree=66157364/67108860
[pid=5401] ppid=5398 vsize=15873004 memory=15780344 CPUtime=1547.67 cores=1,3,5,7
/proc/5401/stat : 5401 (cosoco) D 5398 5401 5350 0 -1 512 3857983 0 3140 0 154084 683 0 0 20 0 1 0 435663246 16253956096 3759541 33554432000 4194304 6211092 140724393048320 140724393021880 5189768 0 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 140 0 0 8312316 8317760 40038400 140724393055243 140724393055345 140724393055345 140724393058254 0
/proc/5401/statm: 3968251 3759541 519 493 0 3961556 0
Current children cumulated CPU time: 1547.67 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15780344 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1550.54
CPU time (s): 1548.47
CPU user time (s): 1540.84
CPU system time (s): 7.62511
CPU usage (%): 99.8663
Max. virtual memory (cumulated for all children) (KiB): 15873004
Max. memory (cumulated for all children) (KiB): 15780344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1540.84
system time used= 7.62511
maximum resident set size= 15038412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3857990
page faults= 3142
swaps= 0
block input operations= 206248
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5306
involuntary context switches= 1195


# summary of solver processes directly reported to runsolver:
#   pid: 5401
#   total CPU time (s): 1548.47
#   total CPU user time (s): 1540.84
#   total CPU system time (s): 7.62511

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.46862 second user time and 7.64574 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-16 02:35:02
IDJOB=4397205
IDBENCH=139487
IDSOLVER=2848
FILE ID=node136/4397205-1568594146
RUNJOBID= node136-1568594102-5382
PBS_JOBID= 21703347
Free space on /tmp= 61172 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_17_11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397205-1568594146/watcher-4397205-1568594146 -o /tmp/evaluation-result-4397205-1568594146/solver-4397205-1568594146 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568594102-5382 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397205-1568594146.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ec43b711d2aa9c243757c5391c9c8921
RANDOM SEED=166266287

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27302408 kB
MemAvailable:   31887984 kB
Buffers:           60144 kB
Cached:          4812104 kB
SwapCached:         3600 kB
Active:          1860484 kB
Inactive:        3016764 kB
Active(anon):       4984 kB
Inactive(anon):    48948 kB
Active(file):    1855500 kB
Inactive(file):  2967816 kB
Unevictable:      110020 kB
Mlocked:          110020 kB
SwapTotal:      67108860 kB
SwapFree:       67001936 kB
Dirty:              2724 kB
Writeback:             0 kB
AnonPages:        112452 kB
Mapped:            45844 kB
Shmem:             40216 kB
Slab:             185356 kB
SReclaimable:     156188 kB
SUnreclaim:        29168 kB
KernelStack:        3296 kB
PageTables:         6072 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     510940 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61064 MiB
End job on node136 at 2019-09-16 03:00:53