Trace number 4397869

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1518.02 1520.29

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_14_1.xml
MD5SUM25e4edec3d9f4a5618481cbfa250deb6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark261
Best CPU time to get the best result obtained on this benchmark2400.07
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":11,"count":111},{"size":48,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12461 MiB free)
  memory of node 1: 16384 MiB (12246 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397869-1568589731/watcher-4397869-1568589731 -o /tmp/evaluation-result-4397869-1568589731/solver-4397869-1568589731 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568572747-19565 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397869-1568589731.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22785, runsolver pid=22782

[startup+0.100111 s]*
/proc/loadavg: 2.00 2.03 2.05 3/199 22786
/proc/meminfo: memFree=25289440/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=39152 memory=15356 CPUtime=0.09 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 4008 0 0 0 9 0 0 0 20 0 1 0 435240864 40091648 3839 33554432000 4194304 6211092 140729503772544 140729503769080 5734816 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 9788 3839 809 493 0 3093 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15356 KiB

[startup+0.209641 s]*
/proc/loadavg: 2.00 2.03 2.05 3/199 22786
/proc/meminfo: memFree=25287580/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=40728 memory=16872 CPUtime=0.2 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 4433 0 0 0 20 0 0 0 20 0 1 0 435240864 41705472 4218 33554432000 4194304 6211092 140729503772544 140729503769080 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 10182 4218 819 493 0 3487 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16872 KiB

[startup+0.308939 s]*
/proc/loadavg: 2.00 2.03 2.05 3/199 22786
/proc/meminfo: memFree=25285840/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=41712 memory=17928 CPUtime=0.3 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 4689 0 0 0 30 0 0 0 20 0 1 0 435240864 42713088 4482 33554432000 4194304 6211092 140729503772544 140729503769080 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 10428 4482 819 493 0 3733 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17928 KiB

[startup+0.700231 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 22786
/proc/meminfo: memFree=25283980/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=45840 memory=21992 CPUtime=0.7 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 5678 0 0 0 69 1 0 0 20 0 1 0 435240864 46940160 5498 33554432000 4194304 6211092 140729503772544 140729503769080 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 11460 5498 819 493 0 4765 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 45840 KiB
Current children cumulated memory: 21992 KiB

[startup+1.50024 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 22786
/proc/meminfo: memFree=25278772/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=54076 memory=30316 CPUtime=1.49 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 7748 0 0 0 148 1 0 0 20 0 1 0 435240864 55373824 7579 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 13519 7579 819 493 0 6824 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54076 KiB
Current children cumulated memory: 30316 KiB

[startup+3.10945 s]
/proc/loadavg: 1.84 2.00 2.03 3/199 22786
/proc/meminfo: memFree=25257608/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=70892 memory=46932 CPUtime=3.1 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 12078 0 0 0 308 2 0 0 20 0 1 0 435240864 72593408 11733 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 17723 11733 819 493 0 11028 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70892 KiB
Current children cumulated memory: 46932 KiB

[startup+6.30022 s]
/proc/loadavg: 1.84 2.00 2.03 3/199 22786
/proc/meminfo: memFree=25226640/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=104568 memory=79848 CPUtime=6.29 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 20508 0 0 0 626 3 0 0 20 0 1 0 435240864 107077632 19962 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 26142 19962 819 493 0 19447 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104568 KiB
Current children cumulated memory: 79848 KiB

[startup+12.7002 s]
/proc/loadavg: 1.87 2.00 2.03 3/199 22786
/proc/meminfo: memFree=25165076/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=170160 memory=146248 CPUtime=12.69 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 37241 0 0 0 1264 5 0 0 20 0 1 0 435240864 174243840 36562 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 42540 36562 819 493 0 35845 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170160 KiB
Current children cumulated memory: 146248 KiB

[startup+25.5002 s]
/proc/loadavg: 1.89 2.00 2.03 3/199 22853
/proc/meminfo: memFree=24946304/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=303864 memory=279500 CPUtime=25.49 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 70424 0 0 0 2539 10 0 0 20 0 1 0 435240864 311156736 69875 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 75966 69875 819 493 0 69271 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 303864 KiB
Current children cumulated memory: 279500 KiB

[startup+51.1092 s]
/proc/loadavg: 1.93 2.00 2.03 3/199 22853
/proc/meminfo: memFree=24409180/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=572624 memory=543756 CPUtime=51.09 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 135606 0 0 0 5090 19 0 0 20 0 1 0 435240864 586366976 135939 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 143156 135939 819 493 0 136461 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 572624 KiB
Current children cumulated memory: 543756 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.00 2.03 3/199 22857
/proc/meminfo: memFree=23354448/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=1113972 memory=1074148 CPUtime=102.27 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 265113 0 0 0 10191 36 0 0 20 0 1 0 435240864 1140707328 268537 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 278493 268537 819 493 0 271798 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1113972 KiB
Current children cumulated memory: 1074148 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.03 3/200 22863
/proc/meminfo: memFree=22107528/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=1743532 memory=1699552 CPUtime=162.25 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 416971 0 0 0 16169 56 0 0 20 0 1 0 435240864 1785376768 424888 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 435883 424888 819 493 0 429188 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1743532 KiB
Current children cumulated memory: 1699552 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/199 22868
/proc/meminfo: memFree=20863464/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=2348752 memory=2323256 CPUtime=222.23 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 568284 0 0 0 22149 74 0 0 20 0 1 0 435240864 2405122048 580814 33554432000 4194304 6211092 140729503772544 140729503746104 140203449219902 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 587188 580814 819 493 0 580493 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 2348752 KiB
Current children cumulated memory: 2323256 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/199 22872
/proc/meminfo: memFree=19617420/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=2990488 memory=2948776 CPUtime=282.21 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 720168 0 0 0 28127 94 0 0 20 0 1 0 435240864 3062259712 737194 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 747622 737194 819 493 0 740927 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 2990488 KiB
Current children cumulated memory: 2948776 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/200 22878
/proc/meminfo: memFree=18371976/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=3650940 memory=3572192 CPUtime=342.19 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 872015 0 0 0 34108 111 0 0 20 0 1 0 435240864 3738562560 893048 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 912735 893048 819 493 0 906040 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3650940 KiB
Current children cumulated memory: 3572192 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/199 22883
/proc/meminfo: memFree=17125876/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=4255896 memory=4197804 CPUtime=402.17 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 1023420 0 0 0 40086 131 0 0 20 0 1 0 435240864 4358037504 1049451 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 1063974 1049451 819 493 0 1057279 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 4255896 KiB
Current children cumulated memory: 4197804 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/199 22887
/proc/meminfo: memFree=15880712/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=4860852 memory=4823040 CPUtime=462.15 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 1174784 0 0 0 46064 151 0 0 20 0 1 0 435240864 4977512448 1205760 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 1215213 1205760 819 493 0 1208518 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 4860852 KiB
Current children cumulated memory: 4823040 KiB


################
# More data... #
################

Current children cumulated vsize: 9905076 KiB
Current children cumulated memory: 9814636 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 22937
/proc/meminfo: memFree=4686960/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=10509108 memory=10439320 CPUtime=1002 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 2538117 0 0 0 99834 366 0 0 20 0 1 0 435240864 10761326592 2609830 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 2627277 2609830 819 493 0 2620582 0
Current children cumulated CPU time: 1002 s
Current children cumulated vsize: 10509108 KiB
Current children cumulated memory: 10439320 KiB

[startup+1062.3 s]
/proc/loadavg: 1.95 2.02 2.04 3/201 22943
/proc/meminfo: memFree=3447888/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=11113272 memory=11061848 CPUtime=1062 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 2689382 0 0 0 105809 391 0 0 20 0 1 0 435240864 11379990528 2765462 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 2778318 2765462 819 493 0 2771623 0
Current children cumulated CPU time: 1062 s
Current children cumulated vsize: 11113272 KiB
Current children cumulated memory: 11061848 KiB

[startup+1122.3 s]
/proc/loadavg: 1.98 2.01 2.04 3/199 22954
/proc/meminfo: memFree=2201532/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=11717436 memory=11686376 CPUtime=1121.98 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 2840695 0 0 0 111780 418 0 0 20 0 1 0 435240864 11998654464 2921594 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 2929359 2921594 819 493 0 2922664 0
Current children cumulated CPU time: 1121.98 s
Current children cumulated vsize: 11717436 KiB
Current children cumulated memory: 11686376 KiB

[startup+1182.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/200 22959
/proc/meminfo: memFree=960272/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=12508324 memory=12308452 CPUtime=1181.96 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 2992304 0 0 0 117749 447 0 0 20 0 1 0 435240864 12808523776 3077113 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3127081 3077113 819 493 0 3120386 0
Current children cumulated CPU time: 1181.96 s
Current children cumulated vsize: 12508324 KiB
Current children cumulated memory: 12308452 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 22965
/proc/meminfo: memFree=180612/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=13112224 memory=12931376 CPUtime=1241.96 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3144737 0 0 0 123717 479 0 0 20 0 1 0 435240864 13426917376 3232844 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3278056 3232844 819 493 0 3271361 0
Current children cumulated CPU time: 1241.96 s
Current children cumulated vsize: 13112224 KiB
Current children cumulated memory: 12931376 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 22969
/proc/meminfo: memFree=191416/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=13715992 memory=13554732 CPUtime=1301.97 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3300802 0 0 0 129686 511 0 0 20 0 1 0 435240864 14045175808 3388683 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3428998 3388683 819 493 0 3422303 0
Current children cumulated CPU time: 1301.97 s
Current children cumulated vsize: 13715992 KiB
Current children cumulated memory: 13554732 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 22973
/proc/meminfo: memFree=208700/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=14319232 memory=14178552 CPUtime=1361.97 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3456516 0 0 0 135649 548 0 0 20 0 1 0 435240864 14662893568 3544638 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3579808 3544638 819 493 0 3573113 0
Current children cumulated CPU time: 1361.97 s
Current children cumulated vsize: 14319232 KiB
Current children cumulated memory: 14178552 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 22979
/proc/meminfo: memFree=195336/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=14921416 memory=14799140 CPUtime=1421.96 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3609300 0 0 0 141599 597 0 0 20 0 1 0 435240864 15279529984 3699785 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3730354 3699785 819 493 0 3723659 0
Current children cumulated CPU time: 1421.96 s
Current children cumulated vsize: 14921416 KiB
Current children cumulated memory: 14799140 KiB

[startup+1482.3 s]
/proc/loadavg: 1.97 2.00 2.03 3/199 22983
/proc/meminfo: memFree=199260/32770624 swapFree=67004768/67108860
[pid=22785] ppid=22782 vsize=15521092 memory=15418064 CPUtime=1481.97 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3760707 0 0 0 147535 662 0 0 20 0 1 0 435240864 15893598208 3854516 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3880273 3854516 819 493 0 3873578 0
Current children cumulated CPU time: 1481.97 s
Current children cumulated vsize: 15521092 KiB
Current children cumulated memory: 15418064 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1517.5 s]
/proc/loadavg: 1.98 2.00 2.03 3/199 22985
/proc/meminfo: memFree=300116/32770624 swapFree=66690736/67108860
[pid=22785] ppid=22782 vsize=15873004 memory=15781508 CPUtime=1517.16 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 4202496 3849657 0 0 0 151016 700 0 0 20 0 1 0 435240864 16253956096 3945377 33554432000 4194304 6211092 140729503772544 140729503746104 140203449224165 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3968251 3945377 818 493 0 3961556 0
Current children cumulated CPU time: 1517.16 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15781508 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1520.29 s]
# the end of solver process 22785 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1510.22 s, system=7.80688 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1518.4 s]
/proc/loadavg: 1.98 2.00 2.03 2/200 22986
/proc/meminfo: memFree=274612/32770624 swapFree=66690744/67108860
[pid=22785] ppid=22782 vsize=15873004 memory=15781508 CPUtime=1517.16 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) S 22782 22785 19533 0 -1 512 3849661 0 1 0 151016 700 0 0 20 0 1 0 435240864 16253956096 3945377 33554432000 4194304 6211092 140729503772544 140729503746104 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3968251 3945377 818 493 0 3961556 0
Current children cumulated CPU time: 1517.16 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15781508 KiB

[startup+1519.2 s]
/proc/loadavg: 1.98 2.00 2.03 2/200 22986
/proc/meminfo: memFree=256928/32770624 swapFree=66690744/67108860
[pid=22785] ppid=22782 vsize=15873004 memory=15781508 CPUtime=1517.17 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) S 22782 22785 19533 0 -1 512 3849661 0 1 0 151017 700 0 0 20 0 1 0 435240864 16253956096 3945377 33554432000 4194304 6211092 140729503772544 140729503746104 5189768 0 16384 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3968251 3945377 818 493 0 3961556 0
Current children cumulated CPU time: 1517.17 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15781508 KiB

[startup+1519.4 s]
/proc/loadavg: 1.98 2.00 2.03 2/200 22986
/proc/meminfo: memFree=256928/32770624 swapFree=66690744/67108860
[pid=22785] ppid=22782 vsize=15873004 memory=15781508 CPUtime=1517.21 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) R 22782 22785 19533 0 -1 512 3849661 0 1 0 151020 701 0 0 20 0 1 0 435240864 16253956096 3945377 33554432000 4194304 6211092 140729503772544 140729503746104 5189768 0 16384 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3968251 3945377 818 493 0 3961556 0
Current children cumulated CPU time: 1517.21 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15781508 KiB

[startup+1519.5 s]
/proc/loadavg: 1.98 2.00 2.03 2/200 22986
/proc/meminfo: memFree=256928/32770624 swapFree=66690744/67108860
[pid=22785] ppid=22782 vsize=15873004 memory=15781508 CPUtime=1517.23 cores=1,3,5,7
/proc/22785/stat : 22785 (cosoco) S 22782 22785 19533 0 -1 512 3849661 0 1 0 151021 702 0 0 20 0 1 0 435240864 16253956096 3945377 33554432000 4194304 6211092 140729503772544 140729503746104 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 15007744 140729503777803 140729503777905 140729503777905 140729503780814 0
/proc/22785/statm: 3968251 3945377 818 493 0 3961556 0
Current children cumulated CPU time: 1517.23 s
Current children cumulated vsize: 15873004 KiB
Current children cumulated memory: 15781508 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1520.29
CPU time (s): 1518.02
CPU user time (s): 1510.22
CPU system time (s): 7.80688
CPU usage (%): 99.8512
Max. virtual memory (cumulated for all children) (KiB): 15873004
Max. memory (cumulated for all children) (KiB): 15781508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1510.22
system time used= 7.80687
maximum resident set size= 15781636
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3849661
page faults= 1
swaps= 0
block input operations= 10024
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25227
involuntary context switches= 1095


# summary of solver processes directly reported to runsolver:
#   pid: 22785
#   total CPU time (s): 1518.02
#   total CPU user time (s): 1510.22
#   total CPU system time (s): 7.80688

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.30404 second user time and 10.1378 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-16 01:21:33
IDJOB=4397869
IDBENCH=139368
IDSOLVER=2850
FILE ID=node126/4397869-1568589731
RUNJOBID= node126-1568572747-19565
PBS_JOBID= 21703324
Free space on /tmp= 55704 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_14_1.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397869-1568589731/watcher-4397869-1568589731 -o /tmp/evaluation-result-4397869-1568589731/solver-4397869-1568589731 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568572747-19565 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397869-1568589731.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 25e4edec3d9f4a5618481cbfa250deb6
RANDOM SEED=163220726

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25300956 kB
MemAvailable:   31854760 kB
Buffers:          181120 kB
Cached:          6631932 kB
SwapCached:         2912 kB
Active:          2784328 kB
Inactive:        4038376 kB
Active(anon):       7672 kB
Inactive(anon):    51868 kB
Active(file):    2776656 kB
Inactive(file):  3986508 kB
Unevictable:      108736 kB
Mlocked:          108736 kB
SwapTotal:      67108860 kB
SwapFree:       67004768 kB
Dirty:              5700 kB
Writeback:             0 kB
AnonPages:        117220 kB
Mapped:            49352 kB
Shmem:             41008 kB
Slab:             242916 kB
SReclaimable:     212948 kB
SUnreclaim:        29968 kB
KernelStack:        3568 kB
PageTables:         5328 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538820 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 55604 MiB
End job on node126 at 2019-09-16 01:46:54