Trace number 4391760

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5? (TO) 2400.09 2400.42

General information on the benchmark

NameSubisomorphism/Subisomorphism-m1-SF/
Subisomorphism-F-20.xml
MD5SUM82ee18a9f0b9eb8094027018544c12e6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark233.201
Satisfiable
(Un)Satisfiability was proved
Number of variables270
Number of constraints5395
Number of domains1
Minimum domain size300
Maximum domain size300
Distribution of domain sizes[{"size":300,"count":270}]
Minimum variable degree16
Maximum variable degree224
Distribution of variable degrees[{"degree":16,"count":1},{"degree":17,"count":7},{"degree":18,"count":6},{"degree":19,"count":13},{"degree":20,"count":22},{"degree":21,"count":13},{"degree":23,"count":10},{"degree":24,"count":13},{"degree":25,"count":12},{"degree":26,"count":12},{"degree":27,"count":11},{"degree":28,"count":11},{"degree":29,"count":8},{"degree":30,"count":4},{"degree":31,"count":7},{"degree":32,"count":10},{"degree":33,"count":3},{"degree":34,"count":8},{"degree":35,"count":5},{"degree":36,"count":7},{"degree":37,"count":4},{"degree":38,"count":2},{"degree":39,"count":5},{"degree":40,"count":2},{"degree":41,"count":2},"...",{"degree":69,"count":2}, {"degree":71,"count":1}, {"degree":72,"count":1}, {"degree":77,"count":1}, {"degree":78,"count":1}, {"degree":95,"count":1}, {"degree":97,"count":1}, {"degree":100,"count":2}, {"degree":103,"count":1}, {"degree":105,"count":1}, {"degree":107,"count":1}, {"degree":110,"count":1}, {"degree":111,"count":1}, {"degree":122,"count":1}, {"degree":124,"count":1}, {"degree":131,"count":2}, {"degree":133,"count":1}, {"degree":137,"count":1}, {"degree":142,"count":1}, {"degree":167,"count":1}, {"degree":173,"count":1}, {"degree":183,"count":1}, {"degree":187,"count":1}, {"degree":220,"count":1}, {"degree":224,"count":1}]
Minimum constraint arity1
Maximum constraint arity270
Distribution of constraint arities[{"arity":1,"count":208},{"arity":2,"count":5186},{"arity":270,"count":1}]
Number of extensional constraints5394
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":5394},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

20.58/20.65	c NACRE 1.0.5
2400.06/2400.40	c
2400.06/2400.40	c # time = 2400.06
2400.06/2400.40	c # Dec = 561630
2400.06/2400.40	c # Propagate Calls = 17343987326
2400.06/2400.40	c # assignAt Calls = 561630
2400.06/2400.40	c # removeAt Calls = 753171338
2400.06/2400.40	c # Run = 1148
2400.06/2400.40	c # Conflicts = 546789
2400.06/2400.40	c # Memory used = 3936.29 Mb
2400.06/2400.40	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15086 MiB free)
  memory of node 1: 16384 MiB (15329 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391760-1568311715/watcher-4391760-1568311715 -o /tmp/evaluation-result-4391760-1568311715/solver-4391760-1568311715 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568305658-21707 --watchdog 2560 nacre_mini_release HOME/instance-4391760-1568311715.xml -complete -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23521, runsolver pid=23518

[startup+0.100114 s]*
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=31115788/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=60536 memory=34464 CPUtime=0.1 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 9770 0 0 0 9 1 0 0 20 0 1 0 407442980 61988864 8616 33554432000 4194304 4935366 140730451068368 140730451063000 140159322315749 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 15167 8616 574 181 0 8784 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 60536 KiB
Current children cumulated memory: 34464 KiB

[startup+0.209762 s]*
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=31091112/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=85848 memory=59808 CPUtime=0.21 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 16097 0 0 0 19 2 0 0 20 0 1 0 407442980 87908352 14952 33554432000 4194304 4935366 140730451068368 140730451063000 4322320 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 21462 14952 574 181 0 15079 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 85848 KiB
Current children cumulated memory: 59808 KiB

[startup+0.309686 s]*
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=31068156/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=108500 memory=82512 CPUtime=0.31 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 21728 0 0 0 28 3 0 0 20 0 1 0 407442980 111104000 20628 33554432000 4194304 4935366 140730451068368 140730451063000 140159322306537 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 27125 20628 574 181 0 20742 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 108500 KiB
Current children cumulated memory: 82512 KiB

[startup+0.700327 s]
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=31022524/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=195336 memory=168840 CPUtime=0.69 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 43314 0 0 0 64 5 0 0 20 0 1 0 407442980 200024064 42210 33554432000 4194304 4935366 140730451068368 140730451063000 140159328506944 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 48834 42210 574 181 0 42451 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 195336 KiB
Current children cumulated memory: 168840 KiB

[startup+1.50033 s]
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=30911700/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=375804 memory=348096 CPUtime=1.49 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 88176 0 0 0 138 11 0 0 20 0 1 0 407442980 384823296 87024 33554432000 4194304 4935366 140730451068368 140730451063000 140159328514972 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 93951 87024 574 181 0 87568 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 375804 KiB
Current children cumulated memory: 348096 KiB

[startup+3.10964 s]
/proc/loadavg: 1.87 1.98 2.03 3/199 23522
/proc/meminfo: memFree=30473440/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=725772 memory=695868 CPUtime=3.1 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 177724 0 0 0 287 23 0 0 20 0 1 0 407442980 743190528 173967 33554432000 4194304 4935366 140730451068368 140730451063000 140159322315749 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 181443 173967 574 181 0 175060 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 725772 KiB
Current children cumulated memory: 695868 KiB

[startup+6.30029 s]
/proc/loadavg: 1.88 1.98 2.03 3/199 23522
/proc/meminfo: memFree=29854028/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=1383856 memory=1350548 CPUtime=6.28 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 343965 0 0 0 585 43 0 0 20 0 1 0 407442980 1417068544 337637 33554432000 4194304 4935366 140730451068368 140730451063000 4271828 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 345964 337637 574 181 0 339581 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 1383856 KiB
Current children cumulated memory: 1350548 KiB

[startup+12.7003 s]
/proc/loadavg: 1.81 1.96 2.02 3/199 23522
/proc/meminfo: memFree=28714176/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=2595028 memory=2554892 CPUtime=12.69 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 649144 0 0 0 1188 81 0 0 20 0 1 0 407442980 2657308672 638723 33554432000 4194304 4935366 140730451068368 140730451063000 4322593 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 648757 638723 574 181 0 642374 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2595028 KiB
Current children cumulated memory: 2554892 KiB

[startup+25.5004 s]
/proc/loadavg: 1.85 1.96 2.02 3/199 23522
/proc/meminfo: memFree=27225308/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3913980 CPUtime=25.49 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1586728 0 0 0 2402 147 0 0 20 0 1 0 407442980 4056522752 978495 33554432000 4194304 4935366 140730451068368 140730451066888 140159323170828 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 978495 593 181 0 983979 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3913980 KiB

[startup+51.1098 s]
/proc/loadavg: 1.90 1.97 2.02 3/199 23524
/proc/meminfo: memFree=27223524/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3914520 CPUtime=51.09 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1620191 0 0 0 4961 148 0 0 20 0 1 0 407442980 4056522752 978630 33554432000 4194304 4935366 140730451068368 140730451066616 4329710 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 978630 606 181 0 983979 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3914520 KiB

[startup+102.3 s]
/proc/loadavg: 1.96 1.97 2.02 3/199 23528
/proc/meminfo: memFree=27221876/32770624 swapFree=66933312/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3915076 CPUtime=102.26 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1650153 0 0 0 10076 150 0 0 20 0 1 0 407442980 4056522752 978769 33554432000 4194304 4935366 140730451068368 140730451066616 4390489 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 978769 606 181 0 983979 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3915076 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 1.99 2.03 3/200 23540
/proc/meminfo: memFree=27220528/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3915632 CPUtime=162.26 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1678169 0 0 0 16074 152 0 0 20 0 1 0 407442980 4056522752 978908 33554432000 4194304 4935366 140730451068368 140730451066616 4390325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 978908 606 181 0 983979 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3915632 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 1.99 2.03 3/200 23546
/proc/meminfo: memFree=27219896/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3916188 CPUtime=222.26 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1704579 0 0 0 22072 154 0 0 20 0 1 0 407442980 4056522752 979047 33554432000 4194304 4935366 140730451068368 140730451066616 4420601 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 979047 606 181 0 983979 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3916188 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 23550
/proc/meminfo: memFree=27218992/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3916748 CPUtime=282.24 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1731095 0 0 0 28069 155 0 0 20 0 1 0 407442980 4056522752 979187 33554432000 4194304 4935366 140730451068368 140730451066616 4389978 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 979187 606 181 0 983979 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3916748 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 23554
/proc/meminfo: memFree=27218292/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3917308 CPUtime=342.24 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1758328 0 0 0 34067 157 0 0 20 0 1 0 407442980 4056522752 979327 33554432000 4194304 4935366 140730451068368 140730451066616 4451939 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 979327 606 181 0 983979 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3917308 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 23560
/proc/meminfo: memFree=27217636/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3917864 CPUtime=402.23 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1785293 0 0 0 40064 159 0 0 20 0 1 0 407442980 4056522752 979466 33554432000 4194304 4935366 140730451068368 140730451066616 4451756 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 979466 606 181 0 983979 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3917864 KiB

[startup+462.3 s]
/proc/loadavg: 2.34 2.07 2.06 3/199 23564
/proc/meminfo: memFree=27216732/32770624 swapFree=66933324/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3918420 CPUtime=462.22 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 1809340 0 0 0 46061 161 0 0 20 0 1 0 407442980 4056522752 979605 33554432000 4194304 4935366 140730451068368 140730451066616 4420601 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 979605 606 181 0 983979 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3918420 KiB


################
# More data... #
################

/proc/23521/statm: 990362 982228 606 181 0 983979 0
Current children cumulated CPU time: 1602.05 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3928912 KiB

[startup+1662.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/199 23676
/proc/meminfo: memFree=27205688/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3929468 CPUtime=1662.05 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2164693 0 0 0 166020 185 0 0 20 0 1 0 407442980 4056522752 982367 33554432000 4194304 4935366 140730451068368 140730451066616 4390011 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 982367 606 181 0 983979 0
Current children cumulated CPU time: 1662.05 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3929468 KiB

[startup+1722.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 23680
/proc/meminfo: memFree=27204628/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3930020 CPUtime=1722.04 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2175760 0 0 0 172019 185 0 0 20 0 1 0 407442980 4056522752 982505 33554432000 4194304 4935366 140730451068368 140730451066616 4451012 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 982505 606 181 0 983979 0
Current children cumulated CPU time: 1722.04 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3930020 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 23684
/proc/meminfo: memFree=27203760/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3930576 CPUtime=1782.03 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2187374 0 0 0 178017 186 0 0 20 0 1 0 407442980 4056522752 982644 33554432000 4194304 4935366 140730451068368 140730451066616 4390325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 982644 606 181 0 983979 0
Current children cumulated CPU time: 1782.03 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3930576 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23690
/proc/meminfo: memFree=27203376/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3931128 CPUtime=1842.02 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2198050 0 0 0 184015 187 0 0 20 0 1 0 407442980 4056522752 982782 33554432000 4194304 4935366 140730451068368 140730451066616 4451756 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 982782 606 181 0 983979 0
Current children cumulated CPU time: 1842.02 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3931128 KiB

[startup+1902.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/199 23755
/proc/meminfo: memFree=27319156/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3931684 CPUtime=1902.01 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2208084 0 0 0 190013 188 0 0 20 0 1 0 407442980 4056522752 982921 33554432000 4194304 4935366 140730451068368 140730451066616 4420682 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 982921 606 181 0 983979 0
Current children cumulated CPU time: 1902.01 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3931684 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/199 23766
/proc/meminfo: memFree=27318512/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3932236 CPUtime=1962 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2217508 0 0 0 196011 189 0 0 20 0 1 0 407442980 4056522752 983059 33554432000 4194304 4935366 140730451068368 140730451066616 4450992 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983059 606 181 0 983979 0
Current children cumulated CPU time: 1962 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3932236 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 23773
/proc/meminfo: memFree=27318208/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3932788 CPUtime=2022 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2225699 0 0 0 202010 190 0 0 20 0 1 0 407442980 4056522752 983197 33554432000 4194304 4935366 140730451068368 140730451066616 4420768 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983197 606 181 0 983979 0
Current children cumulated CPU time: 2022 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3932788 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23777
/proc/meminfo: memFree=27317408/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3933340 CPUtime=2081.99 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2232802 0 0 0 208009 190 0 0 20 0 1 0 407442980 4056522752 983335 33554432000 4194304 4935366 140730451068368 140730451066616 4390485 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983335 606 181 0 983979 0
Current children cumulated CPU time: 2081.99 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3933340 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23781
/proc/meminfo: memFree=27317152/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3933896 CPUtime=2141.98 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2239255 0 0 0 214008 190 0 0 20 0 1 0 407442980 4056522752 983474 33554432000 4194304 4935366 140730451068368 140730451066616 4390079 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983474 606 181 0 983979 0
Current children cumulated CPU time: 2141.98 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3933896 KiB

[startup+2202.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/200 23787
/proc/meminfo: memFree=27316328/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3934448 CPUtime=2201.99 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2244915 0 0 0 220008 191 0 0 20 0 1 0 407442980 4056522752 983612 33554432000 4194304 4935366 140730451068368 140730451066616 4390079 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983612 606 181 0 983979 0
Current children cumulated CPU time: 2201.99 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3934448 KiB

[startup+2262.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/200 23791
/proc/meminfo: memFree=27315952/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3935000 CPUtime=2261.98 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2250245 0 0 0 226007 191 0 0 20 0 1 0 407442980 4056522752 983750 33554432000 4194304 4935366 140730451068368 140730451066616 4329710 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983750 606 181 0 983979 0
Current children cumulated CPU time: 2261.98 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3935000 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 23795
/proc/meminfo: memFree=27314604/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3935552 CPUtime=2321.97 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2254525 0 0 0 232006 191 0 0 20 0 1 0 407442980 4056522752 983888 33554432000 4194304 4935366 140730451068368 140730451066616 4390079 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 983888 606 181 0 983979 0
Current children cumulated CPU time: 2321.97 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3935552 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23801
/proc/meminfo: memFree=27314836/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3936104 CPUtime=2381.96 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2258174 0 0 0 238005 191 0 0 20 0 1 0 407442980 4056522752 984026 33554432000 4194304 4935366 140730451068368 140730451066616 4390325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 984026 606 181 0 983979 0
Current children cumulated CPU time: 2381.96 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3936104 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23801
/proc/meminfo: memFree=27314284/32770624 swapFree=66933340/67108860
[pid=23521] ppid=23518 vsize=3961448 memory=3936292 CPUtime=2400.06 cores=0,2,4,6
/proc/23521/stat : 23521 (nacre_mini_rele) R 23518 23521 19999 0 -1 4202496 2258821 0 0 0 239815 191 0 0 20 0 1 0 407442980 4056522752 984073 33554432000 4194304 4935366 140730451068368 140730451066616 4390474 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11653120 140730451076091 140730451076197 140730451076197 140730451079106 0
/proc/23521/statm: 990362 984073 606 181 0 983979 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 3961448 KiB
Current children cumulated memory: 3936292 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.42 s]
# the end of solver process 23521 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2398.16 s, system=1.93202 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2400.42
CPU time (s): 2400.09
CPU user time (s): 2398.16
CPU system time (s): 1.93202
CPU usage (%): 99.9863
Max. virtual memory (cumulated for all children) (KiB): 3961448
Max. memory (cumulated for all children) (KiB): 3936292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.16
system time used= 1.93202
maximum resident set size= 3936352
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2258871
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 803
involuntary context switches= 689


# summary of solver processes directly reported to runsolver:
#   pid: 23521
#   total CPU time (s): 2400.09
#   total CPU user time (s): 2398.16
#   total CPU system time (s): 1.93202

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0412 second user time and 17.9493 second system time

The end

Launcher Data 

Begin job on node151 at 2019-09-12 20:07:56
IDJOB=4391760
IDBENCH=131293
IDSOLVER=2835
FILE ID=node151/4391760-1568311715
RUNJOBID= node151-1568305658-21707
PBS_JOBID= 21701104
Free space on /tmp= 56968 MiB

SOLVER NAME= NACRE 1.0.5
BENCH NAME= XCSP17/Subisomorphism/Subisomorphism-m1-SF/Subisomorphism-F-20.xml
COMMAND LINE= nacre_mini_release BENCHNAME -complete -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391760-1568311715/watcher-4391760-1568311715 -o /tmp/evaluation-result-4391760-1568311715/solver-4391760-1568311715 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568305658-21707 --watchdog 2560  nacre_mini_release HOME/instance-4391760-1568311715.xml -complete -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 82ee18a9f0b9eb8094027018544c12e6
RANDOM SEED=892513448

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31145968 kB
MemAvailable:   31665388 kB
Buffers:          121504 kB
Cached:           688784 kB
SwapCached:        72804 kB
Active:           617996 kB
Inactive:         458336 kB
Active(anon):     200776 kB
Inactive(anon):    96364 kB
Active(file):     417220 kB
Inactive(file):   361972 kB
Unevictable:      111232 kB
Mlocked:          111232 kB
SwapTotal:      67108860 kB
SwapFree:       66933312 kB
Dirty:               832 kB
Writeback:             4 kB
AnonPages:        305696 kB
Mapped:            34876 kB
Shmem:             22576 kB
Slab:             140776 kB
SReclaimable:     112124 kB
SUnreclaim:        28652 kB
KernelStack:        3552 kB
PageTables:         6168 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     722408 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    212992 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 57000 MiB
End job on node151 at 2019-09-12 20:47:57