Trace number 4299188

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 1.12? (TO) 2520.07 2519.9

General information on the benchmark

NameCrosswordDesign/
CrosswordDesign-10-4-rom_c18.xml
MD5SUM1ce90bfeea193be77ab92ac06e9a3657
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables340
Number of constraints80
Number of domains5
Minimum domain size2
Maximum domain size102325
Distribution of domain sizes[{"size":2,"count":20},{"size":11,"count":140},{"size":27,"count":100},{"size":102325,"count":80}]
Minimum variable degree1
Maximum variable degree8
Distribution of variable degrees[{"degree":1,"count":100},{"degree":2,"count":140},{"degree":8,"count":100}]
Minimum constraint arity13
Maximum constraint arity14
Distribution of constraint arities[{"arity":13,"count":20},{"arity":14,"count":60}]
Number of extensional constraints80
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":80}]
Optimization problemYES
Type of objectivemax SUM

Solver Data 

10.20/10.24	c best=?? lower=0 upper=800 
2520.06/2519.90	c
2520.06/2519.90	c This is cosoco 1.12 --  
2520.06/2519.90	c
2520.06/2519.90	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4299188-1532791801.xml 
2520.06/2519.90	c enable optimization
2520.06/2519.90	c ========================================[ Problem Statistics ]===========================================
2520.06/2519.90	c |                                                                                                       
2520.06/2519.90	c |  Parse time        :        10.15 s 
2520.06/2519.90	c |
2520.06/2519.90	c |               Variables: 340
2520.06/2519.90	c |            Domain Sizes: 2..102325
2520.06/2519.90	c |
2520.06/2519.90	c |             Constraints: 81
2520.06/2519.90	c |                   Arity: 13..80
2520.06/2519.90	c | 
2520.06/2519.90	c |                   Types: 
2520.06/2519.90	c |                          Extension: 80  (nb tuples: 5921..186809) -- (shared: 72)
2520.06/2519.90	c |                          Sum: 1
2520.06/2519.90	c |                          
2520.06/2519.90	c |               Objective: Maximize Sum
2520.06/2519.90	
2520.06/2519.90	c =========================================================================================================
2520.06/2519.90	
2520.06/2519.90	c *** INTERRUPTED ***
2520.06/2519.90	c restarts              : 51          
2520.06/2519.90	c conflicts             : 130723       (52 /sec)
2520.06/2519.90	c decisions             : 311174       (123 /sec)
2520.06/2519.90	c propagations          : 6325199476  (2510158 /sec)
2520.06/2519.90	c root propagations     : 4348320     
2520.06/2519.90	c filter calls          : 39107798       (15520 /sec)
2520.06/2519.90	c useless filter calls  : 27273399       (69 %)
2520.06/2519.90	c Memory used           : 271.68 MB
2520.06/2519.90	c CPU time              : 2519.84 s
2520.06/2519.90	
2520.06/2519.90	c No Bound found!
2520.06/2519.90	
2520.06/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8278 MiB free)
  memory of node 1: 16384 MiB (11507 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299188-1532791801/watcher-4299188-1532791801 -o /tmp/evaluation-result-4299188-1532791801/solver-4299188-1532791801 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1532776049-11498 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4299188-1532791801.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=13291, runsolver pid=13288

[startup+0.100162 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 13292
/proc/meminfo: memFree=20195996/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=91908 memory=68092 CPUtime=0.1 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 17198 0 0 0 8 2 0 0 20 0 1 0 96743270 94113792 17023 33554432000 4194304 6142532 140721212075328 140721212071960 5801711 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 22977 17023 782 476 0 16299 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 91908 KiB
Current children cumulated memory: 68092 KiB

[startup+0.209658 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 13292
/proc/meminfo: memFree=20195252/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=92628 memory=68664 CPUtime=0.21 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 17421 0 0 0 19 2 0 0 20 0 1 0 96743270 94851072 17166 33554432000 4194304 6142532 140721212075328 140721212071960 140170150644709 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 23157 17166 782 476 0 16479 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 92628 KiB
Current children cumulated memory: 68664 KiB

[startup+0.308802 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20193152/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=93408 memory=69368 CPUtime=0.31 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 17679 0 0 0 29 2 0 0 20 0 1 0 96743270 95649792 17342 33554432000 4194304 6142532 140721212075328 140721212071976 140170150644709 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 23352 17342 782 476 0 16674 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 93408 KiB
Current children cumulated memory: 69368 KiB

[startup+0.700287 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20191292/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=96024 memory=71832 CPUtime=0.69 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 18500 0 0 0 67 2 0 0 20 0 1 0 96743270 98328576 17958 33554432000 4194304 6142532 140721212075328 140721212071976 5802565 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 24006 17958 782 476 0 17328 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 96024 KiB
Current children cumulated memory: 71832 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.05 4/188 13300
/proc/meminfo: memFree=20187296/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=101388 memory=77356 CPUtime=1.49 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 19760 0 0 0 147 2 0 0 20 0 1 0 96743270 103821312 19339 33554432000 4194304 6142532 140721212075328 140721212071976 5802609 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 25347 19339 782 476 0 18669 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 101388 KiB
Current children cumulated memory: 77356 KiB

[startup+3.11026 s]
/proc/loadavg: 2.00 2.01 2.05 4/188 13300
/proc/meminfo: memFree=20133956/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=136368 memory=111932 CPUtime=3.1 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 30945 0 0 0 306 4 0 0 20 0 1 0 96743270 139640832 27983 33554432000 4194304 6142532 140721212075328 140721212071976 5461019 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 34092 27983 791 476 0 27414 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 136368 KiB
Current children cumulated memory: 111932 KiB

[startup+6.30025 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20141504/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=146264 memory=121032 CPUtime=6.29 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 39373 0 0 0 625 4 0 0 20 0 1 0 96743270 149774336 30258 33554432000 4194304 6142532 140721212075328 140721212071976 5800110 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 36566 30258 791 476 0 29888 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 146264 KiB
Current children cumulated memory: 121032 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20009996/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=252752 CPUtime=12.69 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 99320 0 0 0 1260 9 0 0 20 0 1 0 96743270 284712960 63188 33554432000 4194304 6142532 140721212075328 140721212072184 5017759 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63188 844 476 0 62832 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 252752 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20009996/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=252796 CPUtime=25.49 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 194943 0 0 0 2535 14 0 0 20 0 1 0 96743270 284712960 63199 33554432000 4194304 6142532 140721212075328 140721212072120 5318922 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63199 844 476 0 62832 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 252796 KiB

[startup+51.1003 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 13300
/proc/meminfo: memFree=20010244/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=252796 CPUtime=51.1 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 253099 0 0 0 5093 17 0 0 20 0 1 0 96743270 284712960 63199 33554432000 4194304 6142532 140721212075328 140721212072120 5333269 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63199 844 476 0 62832 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 252796 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13301
/proc/meminfo: memFree=20009184/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=253852 CPUtime=102.29 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 299895 0 0 0 10210 19 0 0 20 0 1 0 96743270 284712960 63463 33554432000 4194304 6142532 140721212075328 140721212072120 5017799 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63463 844 476 0 62832 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 253852 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13302
/proc/meminfo: memFree=20009212/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=253856 CPUtime=162.29 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 329054 0 0 0 16209 20 0 0 20 0 1 0 96743270 284712960 63464 33554432000 4194304 6142532 140721212075328 140721212072120 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63464 844 476 0 62832 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 253856 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13303
/proc/meminfo: memFree=20008268/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=254656 CPUtime=222.3 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 336739 0 0 0 22209 21 0 0 20 0 1 0 96743270 284712960 63664 33554432000 4194304 6142532 140721212075328 140721212072120 5017870 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63664 844 476 0 62832 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 254656 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 13304
/proc/meminfo: memFree=20008252/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=254656 CPUtime=282.3 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 336739 0 0 0 28209 21 0 0 20 0 1 0 96743270 284712960 63664 33554432000 4194304 6142532 140721212075328 140721212072120 5017909 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63664 844 476 0 62832 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 254656 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 13305
/proc/meminfo: memFree=20008252/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=254660 CPUtime=342.3 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 338274 0 0 0 34209 21 0 0 20 0 1 0 96743270 284712960 63665 33554432000 4194304 6142532 140721212075328 140721212072120 5017927 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63665 844 476 0 62832 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 254660 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 13306
/proc/meminfo: memFree=20008760/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=254660 CPUtime=402.31 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 338280 0 0 0 40210 21 0 0 20 0 1 0 96743270 284712960 63665 33554432000 4194304 6142532 140721212075328 140721212072120 5017816 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63665 844 476 0 62832 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 254660 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 13307
/proc/meminfo: memFree=20008264/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278040 memory=254660 CPUtime=462.31 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 339366 0 0 0 46210 21 0 0 20 0 1 0 96743270 284712960 63665 33554432000 4194304 6142532 140721212075328 140721212072120 5017816 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69510 63665 844 476 0 62832 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 278040 KiB
Current children cumulated memory: 254660 KiB


################
# More data... #
################

/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 1722.4 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/187 13346
/proc/meminfo: memFree=20008172/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=1782.41 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 355480 0 0 0 178219 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5016509 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 1782.41 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+1842.3 s]
/proc/loadavg: 2.41 2.16 2.10 3/187 13354
/proc/meminfo: memFree=20006944/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=1842.41 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 356169 0 0 0 184219 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017759 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+1902.3 s]
/proc/loadavg: 2.15 2.13 2.10 3/187 13377
/proc/meminfo: memFree=20006940/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=1902.41 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 357158 0 0 0 190219 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017979 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 1902.41 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+1962.3 s]
/proc/loadavg: 2.06 2.10 2.09 3/187 13378
/proc/meminfo: memFree=20007640/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=1962.42 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 357705 0 0 0 196220 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/187 13379
/proc/meminfo: memFree=20007240/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2022.42 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 358523 0 0 0 202220 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017799 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2022.42 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.07 2.08 3/187 13380
/proc/meminfo: memFree=20007188/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2082.43 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 358523 0 0 0 208221 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5333239 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2082.43 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/187 13381
/proc/meminfo: memFree=20007824/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2142.43 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 360324 0 0 0 214221 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5016509 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2142.43 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/187 13506
/proc/meminfo: memFree=19493972/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2202.43 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 360324 0 0 0 220221 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2202.43 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2262.3 s]
/proc/loadavg: 2.05 2.05 2.07 3/187 13507
/proc/meminfo: memFree=19494476/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2262.44 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 360796 0 0 0 226222 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017759 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2262.44 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.04 2.06 3/187 13508
/proc/meminfo: memFree=19493052/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2322.44 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 360802 0 0 0 232222 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017816 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2322.44 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 13509
/proc/meminfo: memFree=19493100/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2382.45 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 362337 0 0 0 238223 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017816 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2382.45 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 13518
/proc/meminfo: memFree=19492944/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2442.45 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 362337 0 0 0 244223 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017909 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2442.45 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 13519
/proc/meminfo: memFree=19492848/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2502.45 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 363152 0 0 0 250223 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017895 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2502.45 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 13520
/proc/meminfo: memFree=19493080/32770624 swapFree=67108860/67108860
[pid=13291] ppid=13288 vsize=278196 memory=254688 CPUtime=2520.06 cores=1,3,5,7
/proc/13291/stat : 13291 (cosoco) R 13288 13291 11466 0 -1 4202496 363152 0 0 0 251984 22 0 0 20 0 1 0 96743270 284872704 63672 33554432000 4194304 6142532 140721212075328 140721212072280 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 9814016 140721212081286 140721212081416 140721212081416 140721212084174 0
/proc/13291/statm: 69549 63672 844 476 0 62871 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 278196 KiB
Current children cumulated memory: 254688 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 13291 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.84 s, system=0.227015 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.07
CPU user time (s): 2519.84
CPU system time (s): 0.227015
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 278196
Max. memory (cumulated for all children) (KiB): 254688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.84
system time used= 0.227015
maximum resident set size= 254752
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 363203
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24
involuntary context switches= 669


# summary of solver processes directly reported to runsolver:
#   pid: 13291
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2519.84
#   total CPU system time (s): 0.227015

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.026 second user time and 18.2958 second system time

The end

Launcher Data 

Begin job on node105 at 2018-07-28 17:30:01
IDJOB=4299188
IDBENCH=141306
IDSOLVER=2761
FILE ID=node105/4299188-1532791801
RUNJOBID= node105-1532776049-11498
PBS_JOBID= 21022469
Free space on /tmp= 44576 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/CrosswordDesign/CrosswordDesign-10-4-rom_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299188-1532791801/watcher-4299188-1532791801 -o /tmp/evaluation-result-4299188-1532791801/solver-4299188-1532791801 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1532776049-11498 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4299188-1532791801.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1ce90bfeea193be77ab92ac06e9a3657
RANDOM SEED=834229719

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20261064 kB
MemAvailable:   31760832 kB
Buffers:          269704 kB
Cached:         11368988 kB
SwapCached:            0 kB
Active:          2605396 kB
Inactive:        9256992 kB
Active(anon):     178264 kB
Inactive(anon):    73344 kB
Active(file):    2427132 kB
Inactive(file):  9183648 kB
Unevictable:        7296 kB
Mlocked:            7296 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             30504 kB
Writeback:             0 kB
AnonPages:        231168 kB
Mapped:            45700 kB
Shmem:             25228 kB
Slab:             344904 kB
SReclaimable:     317448 kB
SUnreclaim:        27456 kB
KernelStack:        3360 kB
PageTables:         5212 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     523756 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    169984 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 44504 MiB
End job on node105 at 2018-07-28 18:12:01