Trace number 4265617

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12? (TO) 2520 2520.01

General information on the benchmark

NameBinPacking/
BinPacking-tab-fu/BinPacking-tab-fu0500-12.xml
MD5SUMc3cbaa9ce8e56a4446daa69c64b890b7
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark73
Best CPU time to get the best result obtained on this benchmark2520.0801
Satisfiable
(Un)Satisfiability was proved
Number of variables1919
Number of constraints277
Number of domains2
Minimum domain size82
Maximum domain size275
Distribution of domain sizes[{"size":82,"count":1918},{"size":275,"count":1}]
Minimum variable degree2
Maximum variable degree4
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":1644},{"degree":4,"count":274}]
Minimum constraint arity7
Maximum constraint arity1918
Distribution of constraint arities[{"arity":7,"count":274},{"arity":275,"count":1},{"arity":1918,"count":2}]
Number of extensional constraints274
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":274},{"type":"lex","count":1},{"type":"count","count":1},{"type":"cardinality","count":1}]
Optimization problemYES
Type of objectivemax VAR

Solver Data

1.00/1.03	c Create Cardinality(vars,values,occurs) constraint using 1918 Exactly/AtMost.. constraint 
1.00/1.03	c
1.79/1.81	c SAT : Variables: 157551 -- Clauses: 6409272
1.79/1.81	c best=?? lower=0 upper=274 
2519.99/2520.01	c
2519.99/2520.01	c This is cosoco 1.12 --  
2519.99/2520.01	c
2519.99/2520.01	c command line: cosoco -lc -model -restarts -sat HOME/instance-4265617-1502588503.xml 
2519.99/2520.01	c enable optimization
2519.99/2520.01	c ========================================[ Problem Statistics ]===========================================
2519.99/2520.01	c |                                                                                                       
2519.99/2520.01	c |  Parse time        :         1.63 s 
2519.99/2520.01	c |
2519.99/2520.01	c |               Variables: 1919
2519.99/2520.01	c |            Domain Sizes: 82..275
2519.99/2520.01	c |
2519.99/2520.01	c |             Constraints: 631
2519.99/2520.01	c |                   Arity: 1..1918  -- Unary: 1
2519.99/2520.01	c | 
2519.99/2520.01	c |                   Types: 
2519.99/2520.01	c |                          Exactly K: 82
2519.99/2520.01	c |                          Exactly K variable: 1
2519.99/2520.01	c |                          Extension: 274  (nb tuples: 135171..135171) -- (shared: 273)
2519.99/2520.01	c |                          Intension: 1
2519.99/2520.01	c |                          Lex: 273
2519.99/2520.01	c |                          
2519.99/2520.01	c =========================================================================================================
2519.99/2520.01	
2519.99/2520.01	c *** INTERRUPTED ***
2519.99/2520.01	c restarts              : 57          
2519.99/2520.01	c conflicts             : 534          (0 /sec)
2519.99/2520.01	c decisions             : 72024        (29 /sec)
2519.99/2520.01	c propagations          : 3749598     (1488 /sec)
2519.99/2520.01	c root propagations     : 99462       
2519.99/2520.01	c filter calls          : 16118106       (6397 /sec)
2519.99/2520.01	c useless filter calls  : 15934338       (98 %)
2519.99/2520.01	c
2519.99/2520.01	c clauses               : 6409640
2519.99/2520.01	c SAT propagations      : 0
2519.99/2520.01	c SAT conflicts         : 0 (0 learnts)
2519.99/2520.01	c Memory used           : 688.92 MB
2519.99/2520.01	c CPU time              : 2519.45 s
2519.99/2520.01	
2519.99/2520.01	c No Bound found!
2519.99/2520.01	
2519.99/2520.01	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14227 MiB free)
  memory of node 1: 16384 MiB (14858 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265617-1502588503/watcher-4265617-1502588503 -o /tmp/evaluation-result-4265617-1502588503/solver-4265617-1502588503 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580 cosoco -lc -model -restarts -sat HOME/instance-4265617-1502588503.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=26901, runsolver pid=26898

[startup+0.100209 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29771176/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=38516 memory=14488 CPUtime=0.09 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 3858 0 0 0 9 0 0 0 20 0 1 0 91938534 39440384 3622 33554432000 4194304 5972588 140731123259504 140731123256072 140274414124005 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 9629 3622 716 435 0 2992 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 38516 KiB
Current children cumulated memory: 14488 KiB

[startup+0.209817 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29770432/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=39692 memory=15588 CPUtime=0.2 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 4229 0 0 0 20 0 0 0 20 0 1 0 91938534 40644608 3897 33554432000 4194304 5972588 140731123259504 140731123256072 5418902 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 9923 3897 716 435 0 3286 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 39692 KiB
Current children cumulated memory: 15588 KiB

[startup+0.309096 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29768944/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=41120 memory=16476 CPUtime=0.3 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 4669 0 0 0 30 0 0 0 20 0 1 0 91938534 42106880 4119 33554432000 4194304 5972588 140731123259504 140731123256072 140274414124005 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 10280 4119 716 435 0 3643 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41120 KiB
Current children cumulated memory: 16476 KiB

[startup+0.700272 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29766748/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=45164 memory=20364 CPUtime=0.69 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 6029 0 0 0 68 1 0 0 20 0 1 0 91938534 46247936 5091 33554432000 4194304 5972588 140731123259504 140731123256072 5674097 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 11291 5091 716 435 0 4654 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45164 KiB
Current children cumulated memory: 20364 KiB

[startup+1.50039 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29756728/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=487432 memory=456072 CPUtime=1.49 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 101743 0 0 0 136 13 0 0 20 0 1 0 91938534 499130368 114018 33554432000 4194304 5972588 140731123259504 140731123255080 140274414124005 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 121858 114018 840 435 0 115221 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 487432 KiB
Current children cumulated memory: 456072 KiB

[startup+3.10975 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26902
/proc/meminfo: memFree=29155148/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=687620 memory=630136 CPUtime=3.09 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 132732 0 0 0 292 17 0 0 20 0 1 0 91938534 704122880 157534 33554432000 4194304 5972588 140731123259504 140731123256152 5139312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 171905 157534 854 435 0 165268 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 687620 KiB
Current children cumulated memory: 630136 KiB

[startup+6.30038 s]
/proc/loadavg: 1.92 2.00 2.04 3/188 26902
/proc/meminfo: memFree=29154476/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=687936 memory=630368 CPUtime=6.29 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 160099 0 0 0 610 19 0 0 20 0 1 0 91938534 704446464 157592 33554432000 4194304 5972588 140731123259504 140731123256152 4935408 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 171984 157592 854 435 0 165347 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 687936 KiB
Current children cumulated memory: 630368 KiB

[startup+12.7004 s]
/proc/loadavg: 1.93 2.00 2.04 3/188 26902
/proc/meminfo: memFree=29154104/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=688464 memory=630904 CPUtime=12.69 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 212556 0 0 0 1247 22 0 0 20 0 1 0 91938534 704987136 157726 33554432000 4194304 5972588 140731123259504 140731123256264 5032455 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 172116 157726 856 435 0 165479 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 688464 KiB
Current children cumulated memory: 630904 KiB

[startup+25.5004 s]
/proc/loadavg: 1.95 2.00 2.04 3/188 26902
/proc/meminfo: memFree=29149268/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=693496 memory=635928 CPUtime=25.49 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 316546 0 0 0 2520 29 0 0 20 0 1 0 91938534 710139904 158982 33554432000 4194304 5972588 140731123259504 140731123256264 5139312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 173374 158982 856 435 0 166737 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 693496 KiB
Current children cumulated memory: 635928 KiB

[startup+51.1098 s]
/proc/loadavg: 1.96 2.00 2.04 3/187 26903
/proc/meminfo: memFree=29140852/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=701736 memory=644124 CPUtime=51.09 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 383561 0 0 0 5077 32 0 0 20 0 1 0 91938534 718577664 161031 33554432000 4194304 5972588 140731123259504 140731123256216 5032400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 175434 161031 856 435 0 168797 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 701736 KiB
Current children cumulated memory: 644124 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/187 26904
/proc/meminfo: memFree=29137768/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=704472 memory=647532 CPUtime=102.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 471287 0 0 0 10190 37 0 0 20 0 1 0 91938534 721379328 161883 33554432000 4194304 5972588 140731123259504 140731123256168 5032400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176118 161883 856 435 0 169481 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 704472 KiB
Current children cumulated memory: 647532 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/188 26913
/proc/meminfo: memFree=29136324/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=704880 memory=647908 CPUtime=162.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 502533 0 0 0 16188 39 0 0 20 0 1 0 91938534 721797120 161977 33554432000 4194304 5972588 140731123259504 140731123256168 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176220 161977 856 435 0 169583 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 704880 KiB
Current children cumulated memory: 647908 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26914
/proc/meminfo: memFree=29136372/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=704880 memory=647944 CPUtime=222.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 533019 0 0 0 22185 42 0 0 20 0 1 0 91938534 721797120 161986 33554432000 4194304 5972588 140731123259504 140731123256168 5139312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176220 161986 856 435 0 169583 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 704880 KiB
Current children cumulated memory: 647944 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26915
/proc/meminfo: memFree=29136848/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=704880 memory=647964 CPUtime=282.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 540754 0 0 0 28183 44 0 0 20 0 1 0 91938534 721797120 161991 33554432000 4194304 5972588 140731123259504 140731123256168 5139327 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176220 161991 856 435 0 169583 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 704880 KiB
Current children cumulated memory: 647964 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26916
/proc/meminfo: memFree=29135888/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705012 memory=649096 CPUtime=342.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 549384 0 0 0 34183 44 0 0 20 0 1 0 91938534 721932288 162274 33554432000 4194304 5972588 140731123259504 140731123256264 5139312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176253 162274 856 435 0 169616 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 705012 KiB
Current children cumulated memory: 649096 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26917
/proc/meminfo: memFree=29136044/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705304 memory=649248 CPUtime=402.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 551444 0 0 0 40182 45 0 0 20 0 1 0 91938534 722231296 162312 33554432000 4194304 5972588 140731123259504 140731123256216 4935663 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176326 162312 856 435 0 169689 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 705304 KiB
Current children cumulated memory: 649248 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 26982
/proc/meminfo: memFree=28712848/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705304 memory=650092 CPUtime=462.27 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 552742 0 0 0 46182 45 0 0 20 0 1 0 91938534 722231296 162523 33554432000 4194304 5972588 140731123259504 140731123256360 4935463 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176326 162523 856 435 0 169689 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 705304 KiB
Current children cumulated memory: 650092 KiB


################
# More data... #
################

/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 1722.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27021
/proc/meminfo: memFree=28697524/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=1782.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 574095 0 0 0 178175 53 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27023
/proc/meminfo: memFree=28697224/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=1842.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 575162 0 0 0 184175 53 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5032400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27024
/proc/meminfo: memFree=28697452/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=1902.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 575573 0 0 0 190175 53 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 4935454 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 1902.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27032
/proc/meminfo: memFree=28696684/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=1962.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 575901 0 0 0 196174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 1962.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 27056
/proc/meminfo: memFree=28696444/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2022.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 576210 0 0 0 202174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2022.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 27057
/proc/meminfo: memFree=28696740/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2082.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 576491 0 0 0 208174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2082.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 27058
/proc/meminfo: memFree=28696600/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2142.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 576721 0 0 0 214174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 4935502 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2142.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 27059
/proc/meminfo: memFree=28697012/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2202.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 576975 0 0 0 220174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 4935568 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2202.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2262.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 27060
/proc/meminfo: memFree=28697020/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2262.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 577881 0 0 0 226174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139327 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2262.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 27061
/proc/meminfo: memFree=28696868/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2322.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 578983 0 0 0 232174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2322.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 27062
/proc/meminfo: memFree=28696820/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2382.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 579534 0 0 0 238174 54 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 4935692 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2382.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27063
/proc/meminfo: memFree=28696776/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2442.29 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 580366 0 0 0 244174 55 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139329 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2442.29 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27064
/proc/meminfo: memFree=28696848/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2502.28 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 581474 0 0 0 250173 55 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5032400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2502.28 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 27064
/proc/meminfo: memFree=28696848/32770624 swapFree=67108860/67108860
[pid=26901] ppid=26898 vsize=705452 memory=652316 CPUtime=2519.99 cores=1,3,5,7
/proc/26901/stat : 26901 (cosoco) R 26898 26901 24168 0 -1 4202496 581485 0 0 0 251944 55 0 0 20 0 1 0 91938534 722382848 163079 33554432000 4194304 5972588 140731123259504 140731123256248 5139327 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41353216 140731123266746 140731123266846 140731123266846 140731123269582 0
/proc/26901/statm: 176363 163079 856 435 0 169726 0
Current children cumulated CPU time: 2519.99 s
Current children cumulated vsize: 705452 KiB
Current children cumulated memory: 652316 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 26901 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.45 s, system=0.555002 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520
CPU user time (s): 2519.45
CPU system time (s): 0.555002
CPU usage (%): 99.9996
Max. virtual memory (cumulated for all children) (KiB): 705452
Max. memory (cumulated for all children) (KiB): 652316

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.45
system time used= 0.555002
maximum resident set size= 652392
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 581531
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 708


# summary of solver processes directly reported to runsolver:
#   pid: 26901
#   total CPU time (s): 2520
#   total CPU user time (s): 2519.45
#   total CPU system time (s): 0.555002

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.79272 second user time and 19.0651 second system time

The end

Launcher Data

Begin job on node103 at 2017-08-13 03:27:25
IDJOB=4265617
IDBENCH=137017
IDSOLVER=2655
FILE ID=node103/4265617-1502588503
RUNJOBID= node103-1502567255-24253
PBS_JOBID= 20628288
Free space on /tmp= 61788 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/BinPacking/BinPacking-tab-fu/BinPacking-tab-fu0500-12.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265617-1502588503/watcher-4265617-1502588503 -o /tmp/evaluation-result-4265617-1502588503/solver-4265617-1502588503 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580  cosoco -lc -model -restarts -sat HOME/instance-4265617-1502588503.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c3cbaa9ce8e56a4446daa69c64b890b7
RANDOM SEED=297127395

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29783264 kB
MemAvailable:   31951192 kB
Buffers:          129096 kB
Cached:          2334208 kB
SwapCached:            0 kB
Active:           549236 kB
Inactive:        2014920 kB
Active(anon):     103416 kB
Inactive(anon):    25212 kB
Active(file):     445820 kB
Inactive(file):  1989708 kB
Unevictable:        6344 kB
Mlocked:            6344 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              5044 kB
Writeback:             0 kB
AnonPages:        104844 kB
Mapped:            44120 kB
Shmem:             25228 kB
Slab:             121556 kB
SReclaimable:      96468 kB
SUnreclaim:        25088 kB
KernelStack:        3376 kB
PageTables:         5360 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     401460 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     47104 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61788 MiB
End job on node103 at 2017-08-13 04:09:25