Trace number 4240838

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.06 2401.12

General information on the benchmark

NameCutstock/Cutstock-zinc-s1/
Cutstock-t16-1.xml
MD5SUM36688640cc45f0157406ded158d596cc
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1216
Best CPU time to get the best result obtained on this benchmark3375.2
Satisfiable
(Un)Satisfiability was proved
Number of variables31773
Number of constraints1535
Number of domains17
Minimum domain size2
Maximum domain size195
Distribution of domain sizes[{"size":2,"count":1513},{"size":4,"count":1513},{"size":25,"count":3026},{"size":44,"count":1513},{"size":45,"count":1513},{"size":73,"count":1513},{"size":78,"count":1513},{"size":87,"count":3026},{"size":102,"count":1513},{"size":107,"count":1513},{"size":130,"count":1513},{"size":131,"count":1513},{"size":132,"count":3026},{"size":139,"count":3026},{"size":170,"count":1513},{"size":175,"count":1513},{"size":195,"count":1513}]
Minimum variable degree3
Maximum variable degree3
Distribution of variable degrees[{"degree":3,"count":31773}]
Minimum constraint arity21
Maximum constraint arity30260
Distribution of constraint arities[{"arity":21,"count":1513},{"arity":1513,"count":21},{"arity":30260,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"ordered","count":1},{"type":"lex","count":1},{"type":"sum","count":1533}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

0.89/0.96	c best=?? lower=0 upper=1513

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4240838-1500640611/watcher-4240838-1500640611 -o /tmp/evaluation-result-4240838-1500640611/solver-4240838-1500640611 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1500635808-9681 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4240838-1500640611.xml 

pid=10123
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.05 2/186 10126
/proc/meminfo: memFree=31438468/32770624 swapFree=6172/403268
[pid=10126] ppid=10123 vsize=27120 CPUtime=0 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 975 0 0 0 0 0 0 0 20 0 1 0 17486935 27770880 801 33554432000 4194304 5970956 140721076503968 140721076500568 139878458477541 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 6780 801 698 434 0 144 0

[startup+0.100117 s]
/proc/loadavg: 2.00 2.01 2.05 2/186 10126
/proc/meminfo: memFree=31438468/32770624 swapFree=6172/403268
[pid=10126] ppid=10123 vsize=31068 CPUtime=0.09 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 2006 0 0 0 9 0 0 0 20 0 1 0 17486935 31813632 1804 33554432000 4194304 5970956 140721076503968 140721076498536 5406012 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 7767 1804 705 434 0 1131 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31068

[startup+0.200277 s]
/proc/loadavg: 2.00 2.01 2.05 2/186 10126
/proc/meminfo: memFree=31438468/32770624 swapFree=6172/403268
[pid=10126] ppid=10123 vsize=62220 CPUtime=0.19 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 9754 0 0 0 18 1 0 0 20 0 1 0 17486935 63713280 9532 33554432000 4194304 5970956 140721076503968 140721076499256 139878458477541 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 15555 9532 705 434 0 8919 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 62220

[startup+0.300273 s]
/proc/loadavg: 2.00 2.01 2.05 2/186 10126
/proc/meminfo: memFree=31438468/32770624 swapFree=6172/403268
[pid=10126] ppid=10123 vsize=68588 CPUtime=0.29 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 11386 0 0 0 27 2 0 0 20 0 1 0 17486935 70234112 11182 33554432000 4194304 5970956 140721076503968 140721076497720 5472368 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 17147 11182 735 434 0 10511 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 68588

[startup+0.700208 s]
/proc/loadavg: 2.00 2.01 2.05 2/186 10126
/proc/meminfo: memFree=31438468/32770624 swapFree=6172/403268
[pid=10126] ppid=10123 vsize=181264 CPUtime=0.69 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 39583 0 0 0 64 5 0 0 20 0 1 0 17486935 185614336 39364 33554432000 4194304 5970956 140721076503968 140721076497832 139878458477541 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 45377 39364 737 434 0 38741 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 181264

[startup+1.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30821488/32770624 swapFree=6172/403320
[pid=10126] ppid=10123 vsize=640424 CPUtime=1.49 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 154481 0 0 0 131 18 0 0 20 0 1 0 17486935 655794176 154187 33554432000 4194304 5970956 140721076503968 140721076491288 5327847 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 160106 154187 757 434 0 153470 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 640424

[startup+3.10017 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30820500/32770624 swapFree=6172/403320
[pid=10126] ppid=10123 vsize=640424 CPUtime=3.09 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 164622 0 0 0 290 19 0 0 20 0 1 0 17486935 655794176 154229 33554432000 4194304 5970956 140721076503968 140721076491288 5327981 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 160106 154229 795 434 0 153470 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 640424

[startup+6.30025 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30734408/32770624 swapFree=6172/403332
[pid=10126] ppid=10123 vsize=801360 CPUtime=6.28 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 237504 0 0 0 603 25 0 0 20 0 1 0 17486935 820592640 194382 33554432000 4194304 5970956 140721076503968 140721076500680 139878458477541 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 200340 194382 795 434 0 193704 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 801360

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30402584/32770624 swapFree=6172/403332
[pid=10126] ppid=10123 vsize=1056836 CPUtime=12.68 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 380792 0 0 0 1231 37 0 0 20 0 1 0 17486935 1082200064 258284 33554432000 4194304 5970956 140721076503968 140721076500680 5040494 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 264209 258284 795 434 0 257573 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1056836

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30097024/32770624 swapFree=6172/403348
[pid=10126] ppid=10123 vsize=1381632 CPUtime=25.46 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 558980 0 0 0 2493 53 0 0 20 0 1 0 17486935 1414791168 334662 33554432000 4194304 5970956 140721076503968 140721076500712 5038188 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 345408 334662 795 434 0 338772 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 1381632

[startup+51.1003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10127
/proc/meminfo: memFree=30068640/32770624 swapFree=6172/403360
[pid=10126] ppid=10123 vsize=1411264 CPUtime=51.05 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 629201 0 0 0 5047 58 0 0 20 0 1 0 17486935 1445134336 341674 33554432000 4194304 5970956 140721076503968 140721076500840 5093168 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 352816 341674 795 434 0 346180 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 1411264

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10128
/proc/meminfo: memFree=28417252/32770624 swapFree=6172/403376
[pid=10126] ppid=10123 vsize=3246360 CPUtime=102.22 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1231113 0 0 0 10103 119 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5040461 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 3246360

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 10150
/proc/meminfo: memFree=28415272/32770624 swapFree=6172/403392
[pid=10126] ppid=10123 vsize=3246360 CPUtime=162.18 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1294677 0 0 0 16095 123 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5039662 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 3246360

[startup+222.306 s]
/proc/loadavg: 2.08 2.04 2.05 3/188 10160
/proc/meminfo: memFree=28417240/32770624 swapFree=6172/403400
[pid=10126] ppid=10123 vsize=3246360 CPUtime=222.16 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1345680 0 0 0 22091 125 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5093168 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 222.16
Current children cumulated vsize (KiB) 3246360

[startup+282.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/188 10161
/proc/meminfo: memFree=28417268/32770624 swapFree=6172/403416
[pid=10126] ppid=10123 vsize=3246360 CPUtime=282.13 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1381651 0 0 0 28085 128 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5337501 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 282.13
Current children cumulated vsize (KiB) 3246360

[startup+342.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/188 10162
/proc/meminfo: memFree=28417668/32770624 swapFree=6172/403436
[pid=10126] ppid=10123 vsize=3246360 CPUtime=342.11 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1414030 0 0 0 34081 130 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5038183 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 342.11
Current children cumulated vsize (KiB) 3246360

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 10163
/proc/meminfo: memFree=28417212/32770624 swapFree=6172/403460
[pid=10126] ppid=10123 vsize=3246360 CPUtime=402.08 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1452249 0 0 0 40075 133 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5038183 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 402.08
Current children cumulated vsize (KiB) 3246360

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 10164
/proc/meminfo: memFree=28417636/32770624 swapFree=6172/403496
[pid=10126] ppid=10123 vsize=3246360 CPUtime=462.05 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1491088 0 0 0 46070 135 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5337492 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 462.05
Current children cumulated vsize (KiB) 3246360

[startup+522.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 10165
/proc/meminfo: memFree=28417704/32770624 swapFree=6172/403508
[pid=10126] ppid=10123 vsize=3246360 CPUtime=522.02 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1524754 0 0 0 52066 136 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5337492 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 522.02
Current children cumulated vsize (KiB) 3246360

[startup+582.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 10166
/proc/meminfo: memFree=28417540/32770624 swapFree=6172/403528
[pid=10126] ppid=10123 vsize=3246360 CPUtime=581.99 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1541520 0 0 0 58061 138 0 0 20 0 1 0 17486935 3324272640 753394 33554432000 4194304 5970956 140721076503968 140721076500712 5337497 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 753394 795 434 0 804954 0
Current children cumulated CPU time (s) 581.99
Current children cumulated vsize (KiB) 3246360


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.03 2.03 2.05 3/188 10222
/proc/meminfo: memFree=28313772/32770624 swapFree=6172/403852
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1541.57 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1790707 0 0 0 154002 155 0 0 20 0 1 0 17486935 3324272640 779077 33554432000 4194304 5970956 140721076503968 140721076500712 5038770 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 779077 795 434 0 804954 0
Current children cumulated CPU time (s) 1541.57
Current children cumulated vsize (KiB) 3246360

[startup+1602.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 10223
/proc/meminfo: memFree=28313916/32770624 swapFree=6172/403884
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1601.54 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1794497 0 0 0 159999 155 0 0 20 0 1 0 17486935 3324272640 779077 33554432000 4194304 5970956 140721076503968 140721076500712 5038144 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 779077 795 434 0 804954 0
Current children cumulated CPU time (s) 1601.54
Current children cumulated vsize (KiB) 3246360

[startup+1662.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 10224
/proc/meminfo: memFree=28313892/32770624 swapFree=6172/403904
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1661.53 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1798050 0 0 0 165997 156 0 0 20 0 1 0 17486935 3324272640 779077 33554432000 4194304 5970956 140721076503968 140721076500712 5098896 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 779077 795 434 0 804954 0
Current children cumulated CPU time (s) 1661.53
Current children cumulated vsize (KiB) 3246360

[startup+1722.3 s]
/proc/loadavg: 2.09 2.04 2.05 3/187 10225
/proc/meminfo: memFree=28313748/32770624 swapFree=6172/403916
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1721.5 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1801165 0 0 0 171994 156 0 0 20 0 1 0 17486935 3324272640 779116 33554432000 4194304 5970956 140721076503968 140721076500712 5038725 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 779116 795 434 0 804954 0
Current children cumulated CPU time (s) 1721.5
Current children cumulated vsize (KiB) 3246360

[startup+1782.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 10226
/proc/meminfo: memFree=28291364/32770624 swapFree=6172/403940
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1781.48 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1803071 0 0 0 177992 156 0 0 20 0 1 0 17486935 3324272640 784564 33554432000 4194304 5970956 140721076503968 140721076500712 5093168 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 784564 795 434 0 804954 0
Current children cumulated CPU time (s) 1781.48
Current children cumulated vsize (KiB) 3246360

[startup+1842.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 10227
/proc/meminfo: memFree=28268392/32770624 swapFree=6172/403968
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1841.44 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1806821 0 0 0 183988 156 0 0 20 0 1 0 17486935 3324272640 790449 33554432000 4194304 5970956 140721076503968 140721076500712 5038183 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 790449 795 434 0 804954 0
Current children cumulated CPU time (s) 1841.44
Current children cumulated vsize (KiB) 3246360

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 10228
/proc/meminfo: memFree=28243248/32770624 swapFree=6172/403976
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1901.43 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1809668 0 0 0 189986 157 0 0 20 0 1 0 17486935 3324272640 796715 33554432000 4194304 5970956 140721076503968 140721076500712 5038183 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 796715 795 434 0 804954 0
Current children cumulated CPU time (s) 1901.43
Current children cumulated vsize (KiB) 3246360

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 10229
/proc/meminfo: memFree=28217728/32770624 swapFree=6172/404000
[pid=10126] ppid=10123 vsize=3246360 CPUtime=1961.4 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1811998 0 0 0 195983 157 0 0 20 0 1 0 17486935 3324272640 803119 33554432000 4194304 5970956 140721076503968 140721076500712 5039162 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 803119 795 434 0 804954 0
Current children cumulated CPU time (s) 1961.4
Current children cumulated vsize (KiB) 3246360

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10238
/proc/meminfo: memFree=28211248/32770624 swapFree=6172/404012
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2021.38 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1815965 0 0 0 201980 158 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5093168 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2021.38
Current children cumulated vsize (KiB) 3246360

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10239
/proc/meminfo: memFree=28211940/32770624 swapFree=6172/404036
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2081.36 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1818788 0 0 0 207978 158 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5098910 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2081.36
Current children cumulated vsize (KiB) 3246360

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 10240
/proc/meminfo: memFree=28211460/32770624 swapFree=6172/404060
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2141.33 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1821648 0 0 0 213975 158 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5038640 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2141.33
Current children cumulated vsize (KiB) 3246360

[startup+2202.31 s]
/proc/loadavg: 2.18 2.06 2.06 3/188 10241
/proc/meminfo: memFree=28211676/32770624 swapFree=6172/404072
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2201.32 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1824498 0 0 0 219973 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5038183 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2201.32
Current children cumulated vsize (KiB) 3246360

[startup+2262.3 s]
/proc/loadavg: 2.06 2.05 2.05 3/188 10242
/proc/meminfo: memFree=28211768/32770624 swapFree=6172/404092
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2261.29 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1827463 0 0 0 225970 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5039178 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2261.29
Current children cumulated vsize (KiB) 3246360

[startup+2322.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/187 10243
/proc/meminfo: memFree=28211840/32770624 swapFree=6172/404116
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2321.26 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1830319 0 0 0 231967 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5038725 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2321.26
Current children cumulated vsize (KiB) 3246360

[startup+2382.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 10244
/proc/meminfo: memFree=28211592/32770624 swapFree=6172/404144
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2381.23 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1833402 0 0 0 237964 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5098910 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2381.23
Current children cumulated vsize (KiB) 3246360



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2401.1 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 10244
/proc/meminfo: memFree=28211592/32770624 swapFree=6172/404152
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2400.03 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1833898 0 0 0 239844 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5038188 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 3246360

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 10126 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2401.1 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 10244
/proc/meminfo: memFree=28211592/32770624 swapFree=6172/404152
[pid=10126] ppid=10123 vsize=3246360 CPUtime=2400.03 cores=1,3,5,7
/proc/10126/stat : 10126 (cosoco) R 10123 10126 6087 0 -1 4202496 1833898 0 0 0 239844 159 0 0 20 0 1 0 17486935 3324272640 804596 33554432000 4194304 5970956 140721076503968 140721076500712 5038188 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 32985088 140721076511937 140721076512067 140721076512067 140721076514766 0
/proc/10126/statm: 811590 804596 795 434 0 804954 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 3246360

Child status: 1
Real time (s): 2401.12
CPU time (s): 2400.06
CPU user time (s): 2398.44
CPU system time (s): 1.61433
CPU usage (%): 99.9559
Max. virtual memory (cumulated for all children) (KiB): 3246360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.44
system time used= 1.61433
maximum resident set size= 3218428
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1833925
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 114
involuntary context switches= 120678

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.2249 second user time and 10.0943 second system time

The end

Launcher Data 

Begin job on node150 at 2017-07-21 14:36:51
IDJOB=4240838
IDBENCH=124244
IDSOLVER=2620
FILE ID=node150/4240838-1500640611
RUNJOBID= node150-1500635808-9681
PBS_JOBID= 20622986
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Cutstock/Cutstock-zinc-s1/Cutstock-t16-1.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4240838-1500640611/watcher-4240838-1500640611 -o /tmp/evaluation-result-4240838-1500640611/solver-4240838-1500640611 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1500635808-9681 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4240838-1500640611.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 36688640cc45f0157406ded158d596cc
RANDOM SEED=1012220202

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1733.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31442192 kB
MemAvailable:   31992736 kB
Buffers:          236056 kB
Cached:           601316 kB
SwapCached:            0 kB
Active:           483120 kB
Inactive:         420580 kB
Active(anon):      68868 kB
Inactive(anon):    17052 kB
Active(file):     414252 kB
Inactive(file):   403528 kB
Unevictable:        6172 kB
Mlocked:            6180 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              4596 kB
Writeback:             0 kB
AnonPages:         72304 kB
Mapped:            33384 kB
Shmem:             17040 kB
Slab:             122824 kB
SReclaimable:      97196 kB
SUnreclaim:        25628 kB
KernelStack:        3328 kB
PageTables:         6076 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     347056 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 62028 MiB
End job on node150 at 2017-07-21 15:16:52