Trace number 4408455

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1557.38 1559.85

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_13_6.xml
MD5SUM0b4cdd9f2ac3a0985a9efe7e14eeda02
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark268
Best CPU time to get the best result obtained on this benchmark20083.5
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":12,"count":111},{"size":49,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14030 MiB free)
  memory of node 1: 16384 MiB (15050 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408455-1569811958/watcher-4408455-1569811958 -o /tmp/evaluation-result-4408455-1569811958/solver-4408455-1569811958 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1569787350-1893 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408455-1569811958.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=6963, runsolver pid=6960

[startup+0.100165 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29767008/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=39152 memory=15356 CPUtime=0.09 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 4007 0 0 0 9 0 0 0 20 0 1 0 557458321 40091648 3839 33554432000 4194304 6211132 140733499388960 140733499385496 5522961 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 9788 3839 809 493 0 3093 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39152 KiB
Current children cumulated memory: 15356 KiB

[startup+0.209701 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29765520/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=40728 memory=16872 CPUtime=0.2 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 4430 0 0 0 20 0 0 0 20 0 1 0 557458321 41705472 4218 33554432000 4194304 6211132 140733499388960 140733499385496 5013250 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 10182 4218 819 493 0 3487 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40728 KiB
Current children cumulated memory: 16872 KiB

[startup+0.309035 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29764404/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=41712 memory=17928 CPUtime=0.3 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 4678 0 0 0 30 0 0 0 20 0 1 0 557458321 42713088 4482 33554432000 4194304 6211132 140733499388960 140733499385496 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 10428 4482 819 493 0 3733 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17928 KiB

[startup+0.70028 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29762360/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=45708 memory=21732 CPUtime=0.69 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 5645 0 0 0 69 0 0 0 20 0 1 0 557458321 46804992 5433 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 11427 5433 819 493 0 4732 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45708 KiB
Current children cumulated memory: 21732 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29757304/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=53812 memory=29788 CPUtime=1.49 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 7665 0 0 0 148 1 0 0 20 0 1 0 557458321 55103488 7447 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 13453 7447 819 493 0 6758 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 53812 KiB
Current children cumulated memory: 29788 KiB

[startup+3.1095 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29737092/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=70232 memory=46012 CPUtime=3.1 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 11901 0 0 0 309 1 0 0 20 0 1 0 557458321 71917568 11503 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 17558 11503 819 493 0 10863 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70232 KiB
Current children cumulated memory: 46012 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 6964
/proc/meminfo: memFree=29706064/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=103116 memory=78416 CPUtime=6.29 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 20131 0 0 0 627 2 0 0 20 0 1 0 557458321 105590784 19604 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 25779 19604 819 493 0 19084 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 103116 KiB
Current children cumulated memory: 78416 KiB

[startup+12.7003 s]
/proc/loadavg: 2.08 2.04 2.05 3/200 6964
/proc/meminfo: memFree=29645180/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=167124 memory=143088 CPUtime=12.69 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 36458 0 0 0 1265 4 0 0 20 0 1 0 557458321 171134976 35772 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 41781 35772 819 493 0 35086 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 167124 KiB
Current children cumulated memory: 143088 KiB

[startup+25.5003 s]
/proc/loadavg: 2.07 2.04 2.05 3/200 6966
/proc/meminfo: memFree=29513408/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=297660 memory=272136 CPUtime=25.49 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 69101 0 0 0 2540 9 0 0 20 0 1 0 557458321 304803840 68034 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 74415 68034 819 493 0 67720 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 297660 KiB
Current children cumulated memory: 272136 KiB

[startup+51.1095 s]
/proc/loadavg: 2.18 2.07 2.06 3/200 6966
/proc/meminfo: memFree=29248120/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=560348 memory=532768 CPUtime=51.09 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 133372 0 0 0 5092 17 0 0 20 0 1 0 557458321 573796352 133192 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 140087 133192 819 493 0 133392 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 560348 KiB
Current children cumulated memory: 532768 KiB

[startup+102.3 s]
/proc/loadavg: 2.16 2.09 2.06 3/200 7031
/proc/meminfo: memFree=29571444/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=1073016 memory=1048812 CPUtime=102.26 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 259395 0 0 0 10194 32 0 0 20 0 1 0 557458321 1098768384 262203 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 268254 262203 819 493 0 261559 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1073016 KiB
Current children cumulated memory: 1048812 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.07 2.06 3/200 7037
/proc/meminfo: memFree=28337888/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=1703272 memory=1658628 CPUtime=162.23 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 407743 0 0 0 16171 52 0 0 20 0 1 0 557458321 1744150528 414657 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 425818 414657 819 493 0 419123 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 1703272 KiB
Current children cumulated memory: 1658628 KiB

[startup+222.3 s]
/proc/loadavg: 2.07 2.07 2.06 3/199 7042
/proc/meminfo: memFree=27103464/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=2292388 memory=2266008 CPUtime=222.21 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 555023 0 0 0 22150 71 0 0 20 0 1 0 557458321 2347405312 566502 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 573097 566502 819 493 0 566402 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2292388 KiB
Current children cumulated memory: 2266008 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.06 2.05 3/199 7046
/proc/meminfo: memFree=25868908/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=2918680 memory=2874196 CPUtime=282.19 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 702989 0 0 0 28130 89 0 0 20 0 1 0 557458321 2988728320 718549 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 729670 718549 819 493 0 722975 0
Current children cumulated CPU time: 282.19 s
Current children cumulated vsize: 2918680 KiB
Current children cumulated memory: 2874196 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/199 7052
/proc/meminfo: memFree=24637304/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=3507796 memory=3481584 CPUtime=342.15 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 850339 0 0 0 34107 108 0 0 20 0 1 0 557458321 3591983104 870396 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 876949 870396 819 493 0 870254 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 3507796 KiB
Current children cumulated memory: 3481584 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 7057
/proc/meminfo: memFree=23403352/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=4152408 memory=4091448 CPUtime=402.13 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 998285 0 0 0 40084 129 0 0 20 0 1 0 557458321 4252065792 1022862 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 1038102 1022862 819 493 0 1031407 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 4152408 KiB
Current children cumulated memory: 4091448 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 7061
/proc/meminfo: memFree=22168964/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=4741656 memory=4699044 CPUtime=462.11 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 1145733 0 0 0 46061 150 0 0 20 0 1 0 557458321 4855455744 1174761 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 1185414 1174761 819 493 0 1178719 0
Current children cumulated CPU time: 462.11 s
Current children cumulated vsize: 4741656 KiB
Current children cumulated memory: 4699044 KiB


################
# More data... #
################

Current children cumulated vsize: 10247880 KiB
Current children cumulated memory: 10169108 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7139
/proc/meminfo: memFree=9845148/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=10836204 memory=10775648 CPUtime=1061.86 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 2620428 0 0 0 105786 400 0 0 20 0 1 0 557458321 11096272896 2693912 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 2709051 2693912 819 493 0 2702356 0
Current children cumulated CPU time: 1061.86 s
Current children cumulated vsize: 10836204 KiB
Current children cumulated memory: 10775648 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7150
/proc/meminfo: memFree=8613080/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=11424396 memory=11382260 CPUtime=1121.84 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 2767750 0 0 0 111754 430 0 0 20 0 1 0 557458321 11698581504 2845565 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 2856099 2845565 819 493 0 2849404 0
Current children cumulated CPU time: 1121.84 s
Current children cumulated vsize: 11424396 KiB
Current children cumulated memory: 11382260 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7154
/proc/meminfo: memFree=7383208/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=12199312 memory=11989108 CPUtime=1181.81 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 2915682 0 0 0 117722 459 0 0 20 0 1 0 557458321 12492095488 2997277 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3049828 2997277 819 493 0 3043133 0
Current children cumulated CPU time: 1181.81 s
Current children cumulated vsize: 12199312 KiB
Current children cumulated memory: 11989108 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7160
/proc/meminfo: memFree=6150772/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=12787504 memory=12597032 CPUtime=1241.79 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3063297 0 0 0 123690 489 0 0 20 0 1 0 557458321 13094404096 3149258 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3196876 3149258 819 493 0 3190181 0
Current children cumulated CPU time: 1241.79 s
Current children cumulated vsize: 12787504 KiB
Current children cumulated memory: 12597032 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7164
/proc/meminfo: memFree=4919224/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=13375696 memory=13203636 CPUtime=1301.76 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3210587 0 0 0 129657 519 0 0 20 0 1 0 557458321 13696712704 3300909 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3343924 3300909 819 493 0 3337229 0
Current children cumulated CPU time: 1301.76 s
Current children cumulated vsize: 13375696 KiB
Current children cumulated memory: 13203636 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7168
/proc/meminfo: memFree=3688204/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=13963756 memory=13812180 CPUtime=1361.73 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3357834 0 0 0 135624 549 0 0 20 0 1 0 557458321 14298886144 3453045 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3490939 3453045 819 493 0 3484244 0
Current children cumulated CPU time: 1361.73 s
Current children cumulated vsize: 13963756 KiB
Current children cumulated memory: 13812180 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7174
/proc/meminfo: memFree=2458300/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=14551684 memory=14418360 CPUtime=1421.71 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3505140 0 0 0 141590 581 0 0 20 0 1 0 557458321 14900924416 3604590 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3637921 3604590 819 493 0 3631226 0
Current children cumulated CPU time: 1421.71 s
Current children cumulated vsize: 14551684 KiB
Current children cumulated memory: 14418360 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7178
/proc/meminfo: memFree=1227492/32770624 swapFree=66993544/67108860
[pid=6963] ppid=6960 vsize=15139348 memory=15024436 CPUtime=1481.69 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3652318 0 0 0 147558 611 0 0 20 0 1 0 557458321 15502692352 3756109 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3784837 3756109 819 493 0 3778142 0
Current children cumulated CPU time: 1481.69 s
Current children cumulated vsize: 15139348 KiB
Current children cumulated memory: 15024436 KiB

[startup+1542.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7182
/proc/meminfo: memFree=181888/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15727012 memory=15630568 CPUtime=1541.66 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3799555 0 0 0 153522 644 0 0 20 0 1 0 557458321 16104460288 3907642 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3931753 3907642 819 493 0 3925058 0
Current children cumulated CPU time: 1541.66 s
Current children cumulated vsize: 15727012 KiB
Current children cumulated memory: 15630568 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1557.11 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7184
/proc/meminfo: memFree=510936/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15872080 memory=15780312 CPUtime=1556.47 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) R 6960 6963 1861 0 -1 4202496 3837035 0 0 0 154992 655 0 0 20 0 1 0 557458321 16253009920 3945078 33554432000 4194304 6211132 140733499388960 140733499362520 140030843943909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3968020 3945078 819 493 0 3961325 0
Current children cumulated CPU time: 1556.47 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780312 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1559.85 s]
# the end of solver process 6963 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1550.07 s, system=7.31779 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1558.4 s]
/proc/loadavg: 2.00 2.01 2.05 4/200 7186
/proc/meminfo: memFree=299624/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15872080 memory=15780312 CPUtime=1556.59 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) S 6960 6963 1861 0 -1 512 3837039 0 0 0 155002 657 0 0 20 0 1 0 557458321 16253009920 3945078 33554432000 4194304 6211132 140733499388960 140733499362520 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3968020 3945078 819 493 0 3961325 0
Current children cumulated CPU time: 1556.59 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780312 KiB

[startup+1558.8 s]
/proc/loadavg: 2.00 2.01 2.05 4/200 7186
/proc/meminfo: memFree=299624/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15872080 memory=15780312 CPUtime=1556.63 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) S 6960 6963 1861 0 -1 512 3837039 0 0 0 155005 658 0 0 20 0 1 0 557458321 16253009920 3945078 33554432000 4194304 6211132 140733499388960 140733499362520 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3968020 3945078 819 493 0 3961325 0
Current children cumulated CPU time: 1556.63 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780312 KiB

[startup+1559 s]*
/proc/loadavg: 2.00 2.01 2.05 2/200 7186
/proc/meminfo: memFree=191300/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15872080 memory=15780312 CPUtime=1556.64 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) S 6960 6963 1861 0 -1 512 3837039 0 0 0 155006 658 0 0 20 0 1 0 557458321 16253009920 3945078 33554432000 4194304 6211132 140733499388960 140733499362520 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3968020 3945078 819 493 0 3961325 0
Current children cumulated CPU time: 1556.64 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780312 KiB

[startup+1559.11 s]
/proc/loadavg: 2.00 2.01 2.05 2/200 7186
/proc/meminfo: memFree=191300/32770624 swapFree=66993536/67108860
[pid=6963] ppid=6960 vsize=15872080 memory=15780312 CPUtime=1556.64 cores=1,3,5,7
/proc/6963/stat : 6963 (cosoco) S 6960 6963 1861 0 -1 512 3837039 0 0 0 155006 658 0 0 20 0 1 0 557458321 16253009920 3945078 33554432000 4194304 6211132 140733499388960 140733499362520 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 20213760 140733499397131 140733499397233 140733499397233 140733499400142 0
/proc/6963/statm: 3968020 3945078 819 493 0 3961325 0
Current children cumulated CPU time: 1556.64 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780312 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1559.85
CPU time (s): 1557.38
CPU user time (s): 1550.07
CPU system time (s): 7.31779
CPU usage (%): 99.8421
Max. virtual memory (cumulated for all children) (KiB): 15872080
Max. memory (cumulated for all children) (KiB): 15780312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1550.07
system time used= 7.31779
maximum resident set size= 15780500
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3837039
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 66845
involuntary context switches= 1939


# summary of solver processes directly reported to runsolver:
#   pid: 6963
#   total CPU time (s): 1557.38
#   total CPU user time (s): 1550.07
#   total CPU system time (s): 7.31779

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.55012 second user time and 10.5059 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-30 04:51:55
IDJOB=4408455
IDBENCH=139563
IDSOLVER=2874
FILE ID=node121/4408455-1569811958
RUNJOBID= node121-1569787350-1893
PBS_JOBID= 21705831
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_13_6.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408455-1569811958/watcher-4408455-1569811958 -o /tmp/evaluation-result-4408455-1569811958/solver-4408455-1569811958 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1569787350-1893 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408455-1569811958.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0b4cdd9f2ac3a0985a9efe7e14eeda02
RANDOM SEED=699778926

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29779280 kB
MemAvailable:   30648376 kB
Buffers:          212236 kB
Cached:           980488 kB
SwapCached:         4540 kB
Active:          1900472 kB
Inactive:         520720 kB
Active(anon):    1222368 kB
Inactive(anon):    80912 kB
Active(file):     678104 kB
Inactive(file):   439808 kB
Unevictable:      109048 kB
Mlocked:          109048 kB
SwapTotal:      67108860 kB
SwapFree:       66993544 kB
Dirty:              2740 kB
Writeback:             0 kB
AnonPages:       1333472 kB
Mapped:            28620 kB
Shmem:             66188 kB
Slab:             163692 kB
SReclaimable:     134040 kB
SUnreclaim:        29652 kB
KernelStack:        3536 kB
PageTables:         7932 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1788828 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1271808 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61768 MiB
End job on node121 at 2019-09-30 05:17:55