Trace number 4386785

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 19.07.01? (TO) 2520.01 2519.8

General information on the benchmark

NameCarSequencing/CarSequencing-m1-jcr/
CarSequencing-60-01.xml
MD5SUM78ce7b18c2bc9eefd2fccfc0b2746318
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark3.47115
Satisfiable
(Un)Satisfiability was proved
Number of variables1200
Number of constraints1379
Number of domains2
Minimum domain size2
Maximum domain size24
Distribution of domain sizes[{"size":2,"count":1000},{"size":24,"count":200}]
Minimum variable degree2
Maximum variable degree62
Distribution of variable degrees[{"degree":2,"count":200},{"degree":3,"count":5},{"degree":4,"count":5},{"degree":5,"count":6},{"degree":6,"count":10},{"degree":7,"count":10},{"degree":8,"count":18},{"degree":9,"count":18},{"degree":10,"count":18},{"degree":11,"count":18},{"degree":12,"count":18},{"degree":13,"count":18},{"degree":14,"count":18},{"degree":15,"count":18},{"degree":16,"count":18},{"degree":17,"count":18},{"degree":18,"count":18},{"degree":19,"count":18},{"degree":20,"count":19},{"degree":21,"count":19},{"degree":22,"count":19},{"degree":23,"count":19},{"degree":24,"count":125},{"degree":25,"count":14},{"degree":26,"count":14},"...",{"degree":38,"count":8}, {"degree":39,"count":8}, {"degree":40,"count":8}, {"degree":41,"count":8}, {"degree":42,"count":8}, {"degree":43,"count":9}, {"degree":44,"count":125}, {"degree":45,"count":6}, {"degree":46,"count":6}, {"degree":47,"count":6}, {"degree":48,"count":6}, {"degree":49,"count":6}, {"degree":50,"count":6}, {"degree":51,"count":6}, {"degree":52,"count":6}, {"degree":53,"count":6}, {"degree":54,"count":7}, {"degree":55,"count":7}, {"degree":56,"count":48}, {"degree":57,"count":3}, {"degree":58,"count":3}, {"degree":59,"count":3}, {"degree":60,"count":4}, {"degree":61,"count":4}, {"degree":62,"count":27}]
Minimum constraint arity2
Maximum constraint arity200
Distribution of constraint arities[{"arity":2,"count":199},{"arity":3,"count":396},{"arity":5,"count":392},{"arity":6,"count":200},{"arity":29,"count":1},{"arity":32,"count":1},{"arity":35,"count":1},{"arity":38,"count":1},{"arity":41,"count":1},{"arity":44,"count":1},{"arity":47,"count":2},{"arity":50,"count":2},{"arity":53,"count":2},{"arity":56,"count":2},{"arity":59,"count":2},{"arity":62,"count":2},{"arity":65,"count":2},{"arity":68,"count":2},{"arity":71,"count":2},{"arity":74,"count":2},{"arity":77,"count":2},{"arity":80,"count":2},{"arity":83,"count":2},{"arity":86,"count":2},{"arity":89,"count":2},"...",{"arity":167,"count":2}, {"arity":168,"count":1}, {"arity":170,"count":5}, {"arity":172,"count":1}, {"arity":173,"count":2}, {"arity":174,"count":1}, {"arity":175,"count":2}, {"arity":176,"count":3}, {"arity":178,"count":1}, {"arity":179,"count":2}, {"arity":180,"count":3}, {"arity":182,"count":3}, {"arity":184,"count":1}, {"arity":185,"count":4}, {"arity":186,"count":1}, {"arity":188,"count":3}, {"arity":190,"count":3}, {"arity":191,"count":2}, {"arity":192,"count":1}, {"arity":194,"count":3}, {"arity":195,"count":2}, {"arity":196,"count":1}, {"arity":197,"count":2}, {"arity":198,"count":1}, {"arity":200,"count":6}]
Number of extensional constraints200
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":200},{"type":"sum","count":1178},{"type":"cardinality","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 19.07.01

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15288 MiB free)
  memory of node 1: 16384 MiB (14820 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4386785-1568281000/watcher-4386785-1568281000 -o /tmp/evaluation-result-4386785-1568281000/solver-4386785-1568281000 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node146-1568280857-31873 --watchdog 2580 BTD 2520 HOME/instance-4386785-1568281000.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=32764, runsolver pid=32761

[startup+0.100203 s]*
/proc/loadavg: 1.71 0.61 0.25 3/199 32765
/proc/meminfo: memFree=30827420/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=36440 memory=6064 CPUtime=0.1 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 1643 0 0 0 10 0 0 0 20 0 1 0 404013997 37314560 1516 33554432000 4194304 36700936 140730828372448 140730828372448 4225508 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 9110 1516 470 7937 0 1138 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 36440 KiB
Current children cumulated memory: 6064 KiB

[startup+0.209581 s]*
/proc/loadavg: 1.71 0.61 0.25 3/199 32765
/proc/meminfo: memFree=30824568/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=38684 memory=8176 CPUtime=0.21 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 2205 0 0 0 21 0 0 0 20 0 1 0 404013997 39612416 2044 33554432000 4194304 36700936 140730828372448 140730828366744 8045103 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 9671 2044 470 7937 0 1699 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38684 KiB
Current children cumulated memory: 8176 KiB

[startup+0.30906 s]*
/proc/loadavg: 1.71 0.61 0.25 3/199 32765
/proc/meminfo: memFree=30820104/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=44532 memory=14248 CPUtime=0.31 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 3709 0 0 0 31 0 0 0 20 0 1 0 404013997 45600768 3562 33554432000 4194304 36700936 140730828372448 140730828366744 7949654 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 11133 3562 491 7937 0 3161 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 44532 KiB
Current children cumulated memory: 14248 KiB

[startup+0.70037 s]
/proc/loadavg: 1.71 0.61 0.25 3/199 32765
/proc/meminfo: memFree=30810308/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=50560 memory=20056 CPUtime=0.69 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 5179 0 0 0 69 0 0 0 20 0 1 0 404013997 51773440 5014 33554432000 4194304 36700936 140730828372448 140730828366744 4468768 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12640 5014 512 7937 0 4668 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 50560 KiB
Current children cumulated memory: 20056 KiB

[startup+1.50036 s]
/proc/loadavg: 1.71 0.61 0.25 3/199 32765
/proc/meminfo: memFree=30805632/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51024 memory=20576 CPUtime=1.49 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 5333 0 0 0 149 0 0 0 20 0 1 0 404013997 52248576 5144 33554432000 4194304 36700936 140730828372448 140730828371496 4645696 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12756 5144 527 7937 0 4784 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 51024 KiB
Current children cumulated memory: 20576 KiB

[startup+3.10962 s]
/proc/loadavg: 1.65 0.61 0.26 3/199 32765
/proc/meminfo: memFree=30765836/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51156 memory=20804 CPUtime=3.1 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 7414 0 0 0 310 0 0 0 20 0 1 0 404013997 52383744 5201 33554432000 4194304 36700936 140730828372448 140730828371496 4788027 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12789 5201 527 7937 0 4817 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 51156 KiB
Current children cumulated memory: 20804 KiB

[startup+6.30031 s]
/proc/loadavg: 1.65 0.61 0.26 3/199 32765
/proc/meminfo: memFree=30771368/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51156 memory=20844 CPUtime=6.29 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 9509 0 0 0 629 0 0 0 20 0 1 0 404013997 52383744 5211 33554432000 4194304 36700936 140730828372448 140730828371496 4645831 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12789 5211 527 7937 0 4817 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 51156 KiB
Current children cumulated memory: 20844 KiB

[startup+12.7003 s]
/proc/loadavg: 1.68 0.64 0.27 3/199 32765
/proc/meminfo: memFree=30723828/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51288 memory=20876 CPUtime=12.69 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 11658 0 0 0 1267 2 0 0 20 0 1 0 404013997 52518912 5219 33554432000 4194304 36700936 140730828372448 140730828371496 4468794 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12822 5219 527 7937 0 4850 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 51288 KiB
Current children cumulated memory: 20876 KiB

[startup+25.5092 s]
/proc/loadavg: 1.75 0.70 0.30 3/199 32767
/proc/meminfo: memFree=30646244/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51420 memory=21092 CPUtime=25.5 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 15695 0 0 0 2546 4 0 0 20 0 1 0 404013997 52654080 5273 33554432000 4194304 36700936 140730828372448 140730828371496 6947488 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12855 5273 527 7937 0 4883 0
Current children cumulated CPU time: 25.5 s
Current children cumulated vsize: 51420 KiB
Current children cumulated memory: 21092 KiB

[startup+51.1003 s]
/proc/loadavg: 1.84 0.81 0.34 3/199 32767
/proc/meminfo: memFree=30521308/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51420 memory=21144 CPUtime=51.09 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 17995 0 0 0 5099 10 0 0 20 0 1 0 404013997 52654080 5286 33554432000 4194304 36700936 140730828372448 140730828371496 4468779 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12855 5286 527 7937 0 4883 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 51420 KiB
Current children cumulated memory: 21144 KiB

[startup+102.3 s]
/proc/loadavg: 1.93 0.99 0.43 3/199 304
/proc/meminfo: memFree=30315024/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51552 memory=21308 CPUtime=102.3 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 20273 0 0 0 10210 20 0 0 20 0 1 0 404013997 52789248 5327 33554432000 4194304 36700936 140730828372448 140730828371496 8340231 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12888 5327 528 7937 0 4916 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 51552 KiB
Current children cumulated memory: 21308 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 1.18 0.53 3/199 310
/proc/meminfo: memFree=30116860/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21368 CPUtime=162.31 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 22485 0 0 0 16189 42 0 0 20 0 1 0 404013997 52924416 5342 33554432000 4194304 36700936 140730828372448 140730828371496 4468779 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5342 528 7937 0 4949 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21368 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.33 0.62 3/199 314
/proc/meminfo: memFree=29945584/32770624 swapFree=66999488/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21436 CPUtime=222.31 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 24585 0 0 0 22177 54 0 0 20 0 1 0 404013997 52924416 5359 33554432000 4194304 36700936 140730828372448 140730828371496 4468794 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5359 528 7937 0 4949 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21436 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.45 0.70 3/200 326
/proc/meminfo: memFree=29790580/32770624 swapFree=66999492/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21436 CPUtime=282.32 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 24585 0 0 0 28170 62 0 0 20 0 1 0 404013997 52924416 5359 33554432000 4194304 36700936 140730828372448 140730828371496 4787740 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5359 528 7937 0 4949 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21436 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.55 0.79 3/200 332
/proc/meminfo: memFree=29646364/32770624 swapFree=66999492/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21448 CPUtime=342.32 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 26821 0 0 0 34164 68 0 0 20 0 1 0 404013997 52924416 5362 33554432000 4194304 36700936 140730828372448 140730828371496 4787885 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5362 528 7937 0 4949 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21448 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.63 0.86 3/200 336
/proc/meminfo: memFree=29512112/32770624 swapFree=66999492/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21448 CPUtime=402.32 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 26827 0 0 0 40157 75 0 0 20 0 1 0 404013997 52924416 5362 33554432000 4194304 36700936 140730828372448 140730828371496 4789291 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5362 528 7937 0 4949 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21448 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 1.71 0.94 3/200 342
/proc/meminfo: memFree=29385856/32770624 swapFree=66999492/67108860
[pid=32764] ppid=32761 vsize=51684 memory=21464 CPUtime=462.33 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 28458 0 0 0 46149 84 0 0 20 0 1 0 404013997 52924416 5366 33554432000 4194304 36700936 140730828372448 140730828371496 4787882 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 12921 5366 528 7937 0 4949 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 51684 KiB
Current children cumulated memory: 21464 KiB


################
# More data... #
################

/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 1722.43 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.75 3/199 490
/proc/meminfo: memFree=27331348/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=1782.44 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 49155 0 0 0 177957 287 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4463683 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 1782.44 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 1.77 3/199 495
/proc/meminfo: memFree=27253884/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=1842.45 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 49155 0 0 0 183947 298 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4788660 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 1842.45 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 1.78 3/199 500
/proc/meminfo: memFree=27178064/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=1902.46 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 50815 0 0 0 189938 308 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 8340231 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 1902.46 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+1962.3 s]
/proc/loadavg: 2.44 2.11 1.83 3/199 506
/proc/meminfo: memFree=27102136/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=1962.46 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 50817 0 0 0 195928 318 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4788109 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 1962.46 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2022.3 s]
/proc/loadavg: 2.27 2.13 1.86 3/199 510
/proc/meminfo: memFree=27027204/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2022.46 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 52591 0 0 0 201918 328 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4787906 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2022.46 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2082.3 s]
/proc/loadavg: 2.10 2.11 1.87 3/200 522
/proc/meminfo: memFree=26953132/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2082.47 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 52591 0 0 0 207906 341 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4468768 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2082.47 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2142.3 s]
/proc/loadavg: 2.04 2.09 1.87 3/200 532
/proc/meminfo: memFree=26879544/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2142.47 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 54223 0 0 0 213895 352 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4468774 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2142.47 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.07 1.88 3/200 536
/proc/meminfo: memFree=26806760/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2202.48 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 54223 0 0 0 219884 364 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4787906 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2202.48 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.06 1.88 3/200 540
/proc/meminfo: memFree=26734396/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2262.48 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 55854 0 0 0 225874 374 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4265738 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.05 1.89 3/200 547
/proc/meminfo: memFree=26661912/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2322.49 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 55854 0 0 0 231864 385 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 6947511 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2322.49 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 1.90 3/199 552
/proc/meminfo: memFree=26589576/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2382.5 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 57483 0 0 0 237853 397 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4462456 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2382.5 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 1.90 3/199 556
/proc/meminfo: memFree=26519340/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21912 CPUtime=2442.5 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 57483 0 0 0 243844 406 0 0 20 0 1 0 404013997 53469184 5478 33554432000 4194304 36700936 140730828372448 140730828371496 4414010 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5478 528 7937 0 5082 0
Current children cumulated CPU time: 2442.5 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21912 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 1.91 3/199 647
/proc/meminfo: memFree=31447068/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=21972 CPUtime=2502.5 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 59121 0 0 0 249832 418 0 0 20 0 1 0 404013997 53469184 5493 33554432000 4194304 36700936 140730828372448 140730828371496 6947484 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5493 528 7937 0 5082 0
Current children cumulated CPU time: 2502.5 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 21972 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.03 1.91 3/199 647
/proc/meminfo: memFree=31443396/32770624 swapFree=66999500/67108860
[pid=32764] ppid=32761 vsize=52216 memory=22104 CPUtime=2520 cores=0,2,4,6
/proc/32764/stat : 32764 (BTD) R 32761 32764 31842 0 -1 4202496 59292 0 0 0 251579 421 0 0 20 0 1 0 404013997 53469184 5526 33554432000 4194304 36700936 140730828372448 140730828371496 4468772 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 38800048 38936640 47439872 140730828379176 140730828379252 140730828379252 140730828382161 0
/proc/32764/statm: 13054 5526 528 7937 0 5082 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 52216 KiB
Current children cumulated memory: 22104 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 32764 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2515.8 s, system=4.21636 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2515.8
CPU system time (s): 4.21636
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 52216
Max. memory (cumulated for all children) (KiB): 22104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2515.8
system time used= 4.21636
maximum resident set size= 22104
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 59292
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 3173


# summary of solver processes directly reported to runsolver:
#   pid: 32764
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2515.8
#   total CPU system time (s): 4.21636

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.96755 second user time and 16.554 second system time

The end

Launcher Data 

Begin job on node146 at 2019-09-12 11:35:59
IDJOB=4386785
IDBENCH=128073
IDSOLVER=2822
FILE ID=node146/4386785-1568281000
RUNJOBID= node146-1568280857-31873
PBS_JOBID= 21701065
Free space on /tmp= 54212 MiB

SOLVER NAME= BTD 19.07.01
BENCH NAME= XCSP17/CarSequencing/CarSequencing-m1-jcr/CarSequencing-60-01.xml
COMMAND LINE= BTD TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4386785-1568281000/watcher-4386785-1568281000 -o /tmp/evaluation-result-4386785-1568281000/solver-4386785-1568281000 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node146-1568280857-31873 --watchdog 2580  BTD 2520 HOME/instance-4386785-1568281000.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 78ce7b18c2bc9eefd2fccfc0b2746318
RANDOM SEED=1486364990

node146.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30832292 kB
MemAvailable:   31102436 kB
Buffers:           84380 kB
Cached:           463664 kB
SwapCached:         5468 kB
Active:          1168248 kB
Inactive:         181216 kB
Active(anon):     818328 kB
Inactive(anon):    20832 kB
Active(file):     349920 kB
Inactive(file):   160384 kB
Unevictable:      110908 kB
Mlocked:          110908 kB
SwapTotal:      67108860 kB
SwapFree:       66999488 kB
Dirty:             62224 kB
Writeback:             0 kB
AnonPages:        908936 kB
Mapped:            41428 kB
Shmem:             28864 kB
Slab:             180640 kB
SReclaimable:     151352 kB
SUnreclaim:        29288 kB
KernelStack:        3456 kB
PageTables:         7080 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1327260 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    104448 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      109952 kB
DirectMap2M:    33435648 kB

Free space on /tmp at the end= 54232 MiB
End job on node146 at 2019-09-12 12:17:59