Trace number 4253391

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
miniBTD 2017-06-30? (TO) 2400.09 2400

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-spng/
Pb-NG-K145.xml
MD5SUM5e6b89adf4cff092dc7bbd8ab430815e
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables17255
Number of constraints17547
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":17255}]
Minimum variable degree3
Maximum variable degree12
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":273},{"degree":5,"count":1771},{"degree":6,"count":7755},{"degree":7,"count":4732},{"degree":8,"count":1862},{"degree":9,"count":574},{"degree":10,"count":143},{"degree":11,"count":1},{"degree":12,"count":143}]
Minimum constraint arity1
Maximum constraint arity145
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":1872},{"arity":3,"count":7776},{"arity":4,"count":4752},{"arity":5,"count":2016},{"arity":6,"count":432},{"arity":7,"count":144},{"arity":9,"count":144},{"arity":119,"count":290},{"arity":145,"count":119}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":17547}]
Optimization problemNO
Type of objective

Solver Data 

18.49/18.52	c Version: 2017-06-30
2399.98/2399.92	s UNKNOWN
2399.98/2399.92	c Solving # Nodes: 446846
2399.98/2399.92	c Global Time: 2400 s

Verifier Data


Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4253391-1500936214/watcher-4253391-1500936214 -o /tmp/evaluation-result-4253391-1500936214/solver-4253391-1500936214 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1500930934-4156 --watchdog 2560 miniBTD 2400 HOME/instance-4253391-1500936214.xml 

pid=6839
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 1.99 2.00 2/182 6842
/proc/meminfo: memFree=31967552/32770624 swapFree=5836/140580
[pid=6842] ppid=6839 vsize=26136 CPUtime=0 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 821 0 0 0 0 0 0 0 20 0 1 0 3160318 26763264 642 33554432000 4194304 4832315 140723748553824 140723748550824 140591244909541 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 6534 642 507 156 0 176 0

[startup+0.100199 s]
/proc/loadavg: 2.00 1.99 2.00 2/182 6842
/proc/meminfo: memFree=31967552/32770624 swapFree=5836/140580
[pid=6842] ppid=6839 vsize=32068 CPUtime=0.09 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 2995 0 0 0 9 0 0 0 20 0 1 0 3160318 32837632 2125 33554432000 4194304 4832315 140723748553824 140723748550824 4444363 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 8017 2125 513 156 0 1659 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 32068

[startup+0.20038 s]
/proc/loadavg: 2.00 1.99 2.00 2/182 6842
/proc/meminfo: memFree=31967552/32770624 swapFree=5836/140580
[pid=6842] ppid=6839 vsize=33256 CPUtime=0.19 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 18332 0 0 0 17 2 0 0 20 0 1 0 3160318 34054144 2459 33554432000 4194304 4832315 140723748553824 140723748550824 140591245370348 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 8367 2459 513 156 0 2009 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 33256

[startup+0.300319 s]
/proc/loadavg: 2.00 1.99 2.00 2/182 6842
/proc/meminfo: memFree=31967552/32770624 swapFree=5836/140580
[pid=6842] ppid=6839 vsize=34408 CPUtime=0.28 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 41101 0 0 0 24 4 0 0 20 0 1 0 3160318 35233792 2683 33554432000 4194304 4832315 140723748553824 140723748550824 4444363 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 8602 2683 513 156 0 2244 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 34408

[startup+0.700281 s]
/proc/loadavg: 2.00 1.99 2.00 2/182 6842
/proc/meminfo: memFree=31967552/32770624 swapFree=5836/140580
[pid=6842] ppid=6839 vsize=37100 CPUtime=0.69 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 155214 0 0 0 52 17 0 0 20 0 1 0 3160318 37990400 3324 33554432000 4194304 4832315 140723748553824 140723748550056 4444363 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 9275 3324 513 156 0 2917 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 37100

[startup+1.50028 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31953628/32770624 swapFree=5836/140608
[pid=6842] ppid=6839 vsize=39988 CPUtime=1.49 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 249475 0 0 0 122 27 0 0 20 0 1 0 3160318 40947712 4075 33554432000 4194304 4832315 140723748553824 140723748550056 4274733 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 9997 4075 543 156 0 3639 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 39988

[startup+3.10028 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31951600/32770624 swapFree=5836/140608
[pid=6842] ppid=6839 vsize=41440 CPUtime=3.09 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 252176 0 0 0 282 27 0 0 20 0 1 0 3160318 42434560 4509 33554432000 4194304 4832315 140723748553824 140723748548104 4274577 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 10360 4509 543 156 0 4002 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41440

[startup+6.30028 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31948176/32770624 swapFree=5836/140608
[pid=6842] ppid=6839 vsize=45800 CPUtime=6.29 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 256758 0 0 0 602 27 0 0 20 0 1 0 3160318 46899200 5595 33554432000 4194304 4832315 140723748553824 140723748548488 4274733 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 11450 5595 546 156 0 5092 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 45800

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31935484/32770624 swapFree=5836/140616
[pid=6842] ppid=6839 vsize=57256 CPUtime=12.69 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 263452 0 0 0 1241 28 0 0 20 0 1 0 3160318 58630144 8437 33554432000 4194304 4832315 140723748553824 140723748548520 4274814 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 14314 8437 546 156 0 7956 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 57256

[startup+25.5004 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31769832/32770624 swapFree=5836/140624
[pid=6842] ppid=6839 vsize=222648 CPUtime=25.49 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 321721 0 0 0 2515 34 0 0 20 0 1 0 3160318 227991552 49634 33554432000 4194304 4832315 140723748553824 140723748551544 140591245173116 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55662 49634 586 156 0 49304 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 222648

[startup+51.1004 s]
/proc/loadavg: 2.00 1.99 2.00 3/183 6843
/proc/meminfo: memFree=31769924/32770624 swapFree=5836/140644
[pid=6842] ppid=6839 vsize=222648 CPUtime=51.08 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 327188 0 0 0 5073 35 0 0 20 0 1 0 3160318 227991552 49660 33554432000 4194304 4832315 140723748553824 140723748551544 4362112 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55662 49660 586 156 0 49304 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 222648

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 2.00 3/182 6844
/proc/meminfo: memFree=31769396/32770624 swapFree=5836/140680
[pid=6842] ppid=6839 vsize=222804 CPUtime=102.29 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 327616 0 0 0 10191 38 0 0 20 0 1 0 3160318 228151296 49686 33554432000 4194304 4832315 140723748553824 140723748551544 4362039 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55701 49686 586 156 0 49343 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 222804

[startup+162.3 s]
/proc/loadavg: 2.00 1.99 2.00 3/182 6845
/proc/meminfo: memFree=31768944/32770624 swapFree=5836/140708
[pid=6842] ppid=6839 vsize=223112 CPUtime=162.28 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328111 0 0 0 16187 41 0 0 20 0 1 0 3160318 228466688 49918 33554432000 4194304 4832315 140723748553824 140723748551544 4362025 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55778 49918 586 156 0 49420 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 223112

[startup+222.306 s]
/proc/loadavg: 2.00 1.99 2.00 3/182 6846
/proc/meminfo: memFree=31768944/32770624 swapFree=5836/140736
[pid=6842] ppid=6839 vsize=223404 CPUtime=222.29 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328219 0 0 0 22186 43 0 0 20 0 1 0 3160318 228765696 50006 33554432000 4194304 4832315 140723748553824 140723748551544 4323747 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55851 50006 586 156 0 49493 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 223404

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.00 3/182 6847
/proc/meminfo: memFree=31768688/32770624 swapFree=5836/140772
[pid=6842] ppid=6839 vsize=223536 CPUtime=282.29 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328363 0 0 0 28183 46 0 0 20 0 1 0 3160318 228900864 50071 33554432000 4194304 4832315 140723748553824 140723748551544 4362122 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55884 50071 586 156 0 49526 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 223536

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.00 3/182 6848
/proc/meminfo: memFree=31768392/32770624 swapFree=5836/140800
[pid=6842] ppid=6839 vsize=223840 CPUtime=342.29 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328423 0 0 0 34180 49 0 0 20 0 1 0 3160318 229212160 50102 33554432000 4194304 4832315 140723748553824 140723748551544 4362017 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 55960 50102 586 156 0 49602 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 223840

[startup+402.3 s]
/proc/loadavg: 2.03 2.00 2.01 3/182 6856
/proc/meminfo: memFree=31766804/32770624 swapFree=5836/140832
[pid=6842] ppid=6839 vsize=224280 CPUtime=402.3 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328721 0 0 0 40178 52 0 0 20 0 1 0 3160318 229662720 50275 33554432000 4194304 4832315 140723748553824 140723748551544 140591245173116 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 56070 50275 586 156 0 49712 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 224280

[startup+462.3 s]
/proc/loadavg: 2.06 2.02 2.01 3/182 6857
/proc/meminfo: memFree=31767384/32770624 swapFree=5836/140868
[pid=6842] ppid=6839 vsize=224572 CPUtime=462.3 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 328793 0 0 0 46174 56 0 0 20 0 1 0 3160318 229961728 50341 33554432000 4194304 4832315 140723748553824 140723748551544 4362009 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 56143 50341 586 156 0 49785 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 224572

[startup+522.3 s]
/proc/loadavg: 2.02 2.01 2.01 3/182 6858
/proc/meminfo: memFree=31766568/32770624 swapFree=5836/140900
[pid=6842] ppid=6839 vsize=225036 CPUtime=522.3 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 329012 0 0 0 52171 59 0 0 20 0 1 0 3160318 230436864 50406 33554432000 4194304 4832315 140723748553824 140723748551544 4362032 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 56259 50406 586 156 0 49901 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 225036

[startup+582.3 s]
/proc/loadavg: 2.01 2.01 2.01 3/182 6859
/proc/meminfo: memFree=31766428/32770624 swapFree=5836/140932
[pid=6842] ppid=6839 vsize=225184 CPUtime=582.3 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 329076 0 0 0 58169 61 0 0 20 0 1 0 3160318 230588416 50472 33554432000 4194304 4832315 140723748553824 140723748551544 4362028 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 56296 50472 586 156 0 49938 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 225184


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6908
/proc/meminfo: memFree=31759080/32770624 swapFree=5836/141420
[pid=6842] ppid=6839 vsize=231976 CPUtime=1482.34 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 331994 0 0 0 148124 110 0 0 20 0 1 0 3160318 237543424 52145 33554432000 4194304 4832315 140723748553824 140723748551544 4362025 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 57994 52145 586 156 0 51636 0
Current children cumulated CPU time (s) 1482.34
Current children cumulated vsize (KiB) 231976

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6909
/proc/meminfo: memFree=31758840/32770624 swapFree=5836/141448
[pid=6842] ppid=6839 vsize=232324 CPUtime=1542.35 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332096 0 0 0 154121 114 0 0 20 0 1 0 3160318 237899776 52263 33554432000 4194304 4832315 140723748553824 140723748551544 4362025 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58081 52263 586 156 0 51723 0
Current children cumulated CPU time (s) 1542.35
Current children cumulated vsize (KiB) 232324

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6917
/proc/meminfo: memFree=31757884/32770624 swapFree=5836/141488
[pid=6842] ppid=6839 vsize=232804 CPUtime=1602.35 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332325 0 0 0 160118 117 0 0 20 0 1 0 3160318 238391296 52352 33554432000 4194304 4832315 140723748553824 140723748551544 4323259 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58201 52352 586 156 0 51843 0
Current children cumulated CPU time (s) 1602.35
Current children cumulated vsize (KiB) 232804

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6918
/proc/meminfo: memFree=31758416/32770624 swapFree=5836/141520
[pid=6842] ppid=6839 vsize=233168 CPUtime=1662.35 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332415 0 0 0 166114 121 0 0 20 0 1 0 3160318 238764032 52484 33554432000 4194304 4832315 140723748553824 140723748551544 4362107 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58292 52484 586 156 0 51934 0
Current children cumulated CPU time (s) 1662.35
Current children cumulated vsize (KiB) 233168

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6919
/proc/meminfo: memFree=31757928/32770624 swapFree=5836/141548
[pid=6842] ppid=6839 vsize=233516 CPUtime=1722.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332542 0 0 0 172113 123 0 0 20 0 1 0 3160318 239120384 52575 33554432000 4194304 4832315 140723748553824 140723748551544 4362025 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58379 52575 586 156 0 52021 0
Current children cumulated CPU time (s) 1722.36
Current children cumulated vsize (KiB) 233516

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6920
/proc/meminfo: memFree=31757244/32770624 swapFree=5836/141588
[pid=6842] ppid=6839 vsize=233516 CPUtime=1782.35 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332571 0 0 0 178109 126 0 0 20 0 1 0 3160318 239120384 52575 33554432000 4194304 4832315 140723748553824 140723748551544 4323742 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58379 52575 586 156 0 52021 0
Current children cumulated CPU time (s) 1782.35
Current children cumulated vsize (KiB) 233516

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/182 6921
/proc/meminfo: memFree=31757244/32770624 swapFree=5836/141616
[pid=6842] ppid=6839 vsize=233832 CPUtime=1842.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332731 0 0 0 184107 129 0 0 20 0 1 0 3160318 239443968 52645 33554432000 4194304 4832315 140723748553824 140723748551544 4323147 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58458 52645 586 156 0 52100 0
Current children cumulated CPU time (s) 1842.36
Current children cumulated vsize (KiB) 233832

[startup+1902.3 s]
/proc/loadavg: 2.04 2.03 2.02 3/182 6922
/proc/meminfo: memFree=31757060/32770624 swapFree=5836/141644
[pid=6842] ppid=6839 vsize=233832 CPUtime=1902.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332731 0 0 0 190106 130 0 0 20 0 1 0 3160318 239443968 52645 33554432000 4194304 4832315 140723748553824 140723748551544 4322189 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58458 52645 586 156 0 52100 0
Current children cumulated CPU time (s) 1902.36
Current children cumulated vsize (KiB) 233832

[startup+1962.3 s]
/proc/loadavg: 2.01 2.02 2.02 3/182 6923
/proc/meminfo: memFree=31756688/32770624 swapFree=5836/141672
[pid=6842] ppid=6839 vsize=233832 CPUtime=1962.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332767 0 0 0 196106 130 0 0 20 0 1 0 3160318 239443968 52645 33554432000 4194304 4832315 140723748553824 140723748551544 4322254 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58458 52645 586 156 0 52100 0
Current children cumulated CPU time (s) 1962.36
Current children cumulated vsize (KiB) 233832

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.02 2/175 6970
/proc/meminfo: memFree=31815464/32770624 swapFree=5836/141440
[pid=6842] ppid=6839 vsize=233996 CPUtime=2022.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332875 0 0 0 202104 132 0 0 20 0 1 0 3160318 239611904 52710 33554432000 4194304 4832315 140723748553824 140723748551544 4362039 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58499 52710 586 156 0 52141 0
Current children cumulated CPU time (s) 2022.36
Current children cumulated vsize (KiB) 233996

[startup+2082.3 s]
/proc/loadavg: 1.37 1.83 1.96 2/175 6971
/proc/meminfo: memFree=31816400/32770624 swapFree=5836/141268
[pid=6842] ppid=6839 vsize=233996 CPUtime=2082.37 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 332933 0 0 0 208104 133 0 0 20 0 1 0 3160318 239611904 52710 33554432000 4194304 4832315 140723748553824 140723748551544 4322189 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58499 52710 586 156 0 52141 0
Current children cumulated CPU time (s) 2082.37
Current children cumulated vsize (KiB) 233996

[startup+2142.3 s]
/proc/loadavg: 1.14 1.68 1.90 2/175 6972
/proc/meminfo: memFree=31816508/32770624 swapFree=5836/141292
[pid=6842] ppid=6839 vsize=234316 CPUtime=2142.36 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333113 0 0 0 214101 135 0 0 20 0 1 0 3160318 239939584 52793 33554432000 4194304 4832315 140723748553824 140723748551544 4362032 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58579 52793 586 156 0 52221 0
Current children cumulated CPU time (s) 2142.36
Current children cumulated vsize (KiB) 234316

[startup+2202.31 s]
/proc/loadavg: 1.05 1.56 1.84 2/175 6980
/proc/meminfo: memFree=31815872/32770624 swapFree=5836/141320
[pid=6842] ppid=6839 vsize=234628 CPUtime=2202.38 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333240 0 0 0 220100 138 0 0 20 0 1 0 3160318 240259072 52832 33554432000 4194304 4832315 140723748553824 140723748551544 4362028 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58657 52832 586 156 0 52299 0
Current children cumulated CPU time (s) 2202.38
Current children cumulated vsize (KiB) 234628

[startup+2262.3 s]
/proc/loadavg: 1.02 1.45 1.79 2/175 6981
/proc/meminfo: memFree=31815940/32770624 swapFree=5836/141340
[pid=6842] ppid=6839 vsize=234628 CPUtime=2262.38 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333352 0 0 0 226097 141 0 0 20 0 1 0 3160318 240259072 52876 33554432000 4194304 4832315 140723748553824 140723748551544 4323747 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58657 52876 586 156 0 52299 0
Current children cumulated CPU time (s) 2262.38
Current children cumulated vsize (KiB) 234628

[startup+2322.3 s]
/proc/loadavg: 1.01 1.37 1.74 2/175 6982
/proc/meminfo: memFree=31816656/32770624 swapFree=5836/141344
[pid=6842] ppid=6839 vsize=234628 CPUtime=2322.38 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333413 0 0 0 232096 142 0 0 20 0 1 0 3160318 240259072 52876 33554432000 4194304 4832315 140723748553824 140723748551544 4362025 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58657 52876 586 156 0 52299 0
Current children cumulated CPU time (s) 2322.38
Current children cumulated vsize (KiB) 234628

[startup+2382.3 s]
/proc/loadavg: 1.04 1.32 1.70 2/175 6983
/proc/meminfo: memFree=31816324/32770624 swapFree=5836/141388
[pid=6842] ppid=6839 vsize=234768 CPUtime=2382.37 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333528 0 0 0 238094 143 0 0 20 0 1 0 3160318 240402432 52911 33554432000 4194304 4832315 140723748553824 140723748551544 4322254 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 58692 52911 586 156 0 52334 0
Current children cumulated CPU time (s) 2382.37
Current children cumulated vsize (KiB) 234768



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400 s]
/proc/loadavg: 1.03 1.30 1.68 2/175 6983
/proc/meminfo: memFree=31816684/32770624 swapFree=5836/141392
[pid=6842] ppid=6839 vsize=212588 CPUtime=2400.08 cores=0,2,4,6
/proc/6842/stat : 6842 (miniBTD) R 6839 6842 4125 0 -1 4202496 333898 0 0 0 239864 144 0 0 20 0 1 0 3160318 217690112 47378 33554432000 4194304 4832315 140723748553824 140723748551544 4441740 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 6932504 6936608 10891264 140723748558066 140723748558146 140723748558146 140723748560845 0
/proc/6842/statm: 53147 47378 598 156 0 46789 0
Current children cumulated CPU time (s) 2400.08
Current children cumulated vsize (KiB) 212588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6842 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400
CPU time (s): 2400.09
CPU user time (s): 2398.64
CPU system time (s): 1.44706
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 234768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.64
system time used= 1.44706
maximum resident set size= 211692
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 333898
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30
involuntary context switches= 737

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.69397 second user time and 9.50605 second system time

The end

Launcher Data 

Begin job on node103 at 2017-07-25 00:43:34
IDJOB=4253391
IDBENCH=134763
IDSOLVER=2632
FILE ID=node103/4253391-1500936214
RUNJOBID= node103-1500930934-4156
PBS_JOBID= 20625427
Free space on /tmp= 61692 MiB

SOLVER NAME= miniBTD 2017-06-30
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-spng/Pb-NG-K145.xml
COMMAND LINE= miniBTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4253391-1500936214/watcher-4253391-1500936214 -o /tmp/evaluation-result-4253391-1500936214/solver-4253391-1500936214 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1500930934-4156 --watchdog 2560  miniBTD 2400 HOME/instance-4253391-1500936214.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5e6b89adf4cff092dc7bbd8ab430815e
RANDOM SEED=345372653

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31967356 kB
MemAvailable:   32010960 kB
Buffers:           36412 kB
Cached:           321716 kB
SwapCached:            0 kB
Active:           301608 kB
Inactive:         149164 kB
Active(anon):      95904 kB
Inactive(anon):     8584 kB
Active(file):     205704 kB
Inactive(file):   140580 kB
Unevictable:        5836 kB
Mlocked:            5836 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              8280 kB
Writeback:             0 kB
AnonPages:         98692 kB
Mapped:            28508 kB
Shmem:              8848 kB
Slab:              52116 kB
SReclaimable:      26308 kB
SUnreclaim:        25808 kB
KernelStack:        3280 kB
PageTables:         4516 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     334724 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 61692 MiB
End job on node103 at 2017-07-25 01:23:34