Trace number 4309870

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.11 2520.04

General information on the benchmark

NameFapp/Fapp-m2s/
Fapp-m2s-08-0700_c18.xml
MD5SUM1726f38b1078149b3b3b5e51280bc638
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark542126384
Best CPU time to get the best result obtained on this benchmark2521
Satisfiable
(Un)Satisfiability was proved
Number of variables11265
Number of constraints7122
Number of domains159
Minimum domain size1
Maximum domain size141
Distribution of domain sizes[{"size":1,"count":4},{"size":2,"count":3984},{"size":11,"count":3288},{"size":12,"count":1},{"size":21,"count":10},{"size":23,"count":9},{"size":27,"count":51},{"size":31,"count":72},{"size":34,"count":11},{"size":35,"count":15},{"size":37,"count":59},{"size":38,"count":4},{"size":39,"count":29},{"size":40,"count":1},{"size":41,"count":17},{"size":42,"count":10},{"size":43,"count":1},{"size":44,"count":7},{"size":45,"count":25},{"size":47,"count":11},{"size":49,"count":70},{"size":51,"count":80},{"size":52,"count":2},{"size":53,"count":2},{"size":54,"count":5},"...",{"size":104,"count":55}, {"size":105,"count":9}, {"size":106,"count":46}, {"size":107,"count":8}, {"size":108,"count":6}, {"size":109,"count":6}, {"size":111,"count":41}, {"size":112,"count":53}, {"size":113,"count":10}, {"size":114,"count":14}, {"size":115,"count":6}, {"size":117,"count":78}, {"size":118,"count":117}, {"size":119,"count":35}, {"size":127,"count":73}, {"size":128,"count":21}, {"size":129,"count":2}, {"size":130,"count":15}, {"size":131,"count":18}, {"size":133,"count":2}, {"size":135,"count":74}, {"size":136,"count":50}, {"size":137,"count":18}, {"size":140,"count":8}, {"size":141,"count":1776}]
Minimum variable degree1
Maximum variable degree3289
Distribution of variable degrees[{"degree":1,"count":2},{"degree":2,"count":9869},{"degree":3,"count":14},{"degree":4,"count":31},{"degree":5,"count":51},{"degree":6,"count":71},{"degree":7,"count":99},{"degree":8,"count":104},{"degree":9,"count":116},{"degree":10,"count":158},{"degree":11,"count":226},{"degree":12,"count":258},{"degree":13,"count":171},{"degree":14,"count":35},{"degree":15,"count":26},{"degree":16,"count":18},{"degree":17,"count":8},{"degree":18,"count":6},{"degree":19,"count":1},{"degree":3289,"count":1}]
Minimum constraint arity2
Maximum constraint arity6
Distribution of constraint arities[{"arity":2,"count":546},{"arity":3,"count":3288},{"arity":6,"count":3288}]
Number of extensional constraints3288
Number of intensional constraints3834
Distribution of constraint types[{"type":"extension","count":3288},{"type":"intension","count":3834}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13132 MiB free)
  memory of node 1: 16384 MiB (10481 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309870-1534304585/watcher-4309870-1534304585 -o /tmp/evaluation-result-4309870-1534304585/solver-4309870-1534304585 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node135-1534293063-15170 --watchdog 2580 xcsp_picat HOME/instance-4309870-1534304585.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=16669, runsolver pid=16666

[startup+0.100116 s]*
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=24157760/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=25920 CPUtime=0.1 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1537 0 0 0 10 0 0 0 20 0 1 0 248021767 2074361856 6480 33554432000 4194304 5849940 140727065571920 140727065571920 140183867644928 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 6480 605 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 25920 KiB

[startup+0.209907 s]*
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=24151616/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=32064 CPUtime=0.21 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1540 0 0 0 21 0 0 0 20 0 1 0 248021767 2074361856 8016 33554432000 4194304 5849940 140727065571920 140727065571920 4488915 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 8016 605 405 0 503380 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 32064 KiB

[startup+0.309772 s]*
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=24145472/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=38208 CPUtime=0.31 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1543 0 0 0 31 0 0 0 20 0 1 0 248021767 2074361856 9552 33554432000 4194304 5849940 140727065571920 140727065571920 4548541 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 9552 605 405 0 503380 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 38208 KiB

[startup+0.700298 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=24132920/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=62784 CPUtime=0.69 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1555 0 0 0 68 1 0 0 20 0 1 0 248021767 2074361856 15696 33554432000 4194304 5849940 140727065571920 140727065571920 4524797 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 15696 605 405 0 503380 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 62784 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=24104248/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=109888 CPUtime=1.49 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1578 0 0 0 147 2 0 0 20 0 1 0 248021767 2074361856 27472 33554432000 4194304 5849940 140727065571920 140727065571224 140183867644928 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 27472 605 405 0 503380 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 109888 KiB

[startup+3.10968 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=23981452/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=208276 CPUtime=3.1 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1714 0 0 0 307 3 0 0 20 0 1 0 248021767 2074361856 52069 33554432000 4194304 5849940 140727065571920 140727065571224 140183867644928 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 52069 626 405 0 503380 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 208276 KiB

[startup+6.30032 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=23775884/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=402836 CPUtime=6.29 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 1818 0 0 0 623 6 0 0 20 0 1 0 248021767 2074361856 100709 33554432000 4194304 5849940 140727065571920 140727065571224 4524797 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 100709 626 405 0 503380 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 402836 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=23428948/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=789908 CPUtime=12.69 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 2096 0 0 0 1257 12 0 0 20 0 1 0 248021767 2074361856 197477 33554432000 4194304 5849940 140727065571920 140727065571224 4488915 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 197477 626 405 0 503380 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 789908 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=22641040/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=2025744 memory=1564052 CPUtime=25.49 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 2576 0 0 0 2524 25 0 0 20 0 1 0 248021767 2074361856 391013 33554432000 4194304 5849940 140727065571920 140727065571224 140183867644928 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 506436 391013 626 405 0 503380 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 1564052 KiB

[startup+51.1003 s]*
/proc/loadavg: 2.00 2.01 2.05 3/192 16670
/proc/meminfo: memFree=21040960/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=4306468 memory=3086572 CPUtime=51.1 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 9814 0 0 0 5055 55 0 0 20 0 1 0 248021767 4409823232 771643 33554432000 4194304 5849940 140727065571920 140727065571240 5252848 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 1076617 771643 661 405 0 1073561 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 4306468 KiB
Current children cumulated memory: 3086572 KiB

[startup+102.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/191 16671
/proc/meminfo: memFree=18564272/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10631984 memory=5587464 CPUtime=102.29 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 43860 0 0 0 9851 378 0 0 20 0 1 0 248021767 10887151616 1396866 33554432000 4194304 5849940 140727065571920 140727065570920 4839790 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2657996 1396866 661 405 0 2654940 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 10631984 KiB
Current children cumulated memory: 5587464 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/190 16672
/proc/meminfo: memFree=16927988/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10797428 memory=7168344 CPUtime=162.3 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 51760 0 0 0 15771 459 0 0 20 0 1 0 248021767 11056566272 1792086 33554432000 4194304 5849940 140727065571920 140727065571160 140183867666311 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2699357 1792086 728 405 0 2696301 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 10797428 KiB
Current children cumulated memory: 7168344 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/191 16674
/proc/meminfo: memFree=16658072/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=11066816 memory=7437836 CPUtime=222.3 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 108247 0 0 0 21740 490 0 0 20 0 1 0 248021767 11332419584 1859459 33554432000 4194304 5849940 140727065571920 140727065570408 5319922 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2766704 1859459 754 405 0 2763648 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 11066816 KiB
Current children cumulated memory: 7437836 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16675
/proc/meminfo: memFree=16658000/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=11066816 memory=7437836 CPUtime=282.3 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 151349 0 0 0 27738 492 0 0 20 0 1 0 248021767 11332419584 1859459 33554432000 4194304 5849940 140727065571920 140727065570408 5319922 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2766704 1859459 754 405 0 2763648 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 11066816 KiB
Current children cumulated memory: 7437836 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16676
/proc/meminfo: memFree=16588100/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=11066816 memory=7437836 CPUtime=342.3 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 195835 0 0 0 33735 495 0 0 20 0 1 0 248021767 11332419584 1859459 33554432000 4194304 5849940 140727065571920 140727065570408 5319922 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2766704 1859459 754 405 0 2763648 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 11066816 KiB
Current children cumulated memory: 7437836 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16677
/proc/meminfo: memFree=16588152/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=11066816 memory=7437836 CPUtime=402.3 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 238173 0 0 0 39734 496 0 0 20 0 1 0 248021767 11332419584 1859459 33554432000 4194304 5849940 140727065571920 140727065570408 5319922 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2766704 1859459 754 405 0 2763648 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 11066816 KiB
Current children cumulated memory: 7437836 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/193 16687
/proc/meminfo: memFree=16455228/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=11066816 memory=7437836 CPUtime=462.31 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 273067 0 0 0 45732 499 0 0 20 0 1 0 248021767 11332419584 1859459 33554432000 4194304 5849940 140727065571920 140727065570408 5319945 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2766704 1859459 754 405 0 2763648 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 11066816 KiB
Current children cumulated memory: 7437836 KiB


################
# More data... #
################

/proc/16669/statm: 2747797 1840558 760 405 0 2744741 0
Current children cumulated CPU time: 1782.35 s
Current children cumulated vsize: 10991188 KiB
Current children cumulated memory: 7362232 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/193 16814
/proc/meminfo: memFree=13848116/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10991188 memory=7362232 CPUtime=1842.35 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 3657034 0 0 0 183101 1134 0 0 20 0 1 0 248021767 11254976512 1840558 33554432000 4194304 5849940 140727065571920 140727065570920 140183867666311 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747797 1840558 760 405 0 2744741 0
Current children cumulated CPU time: 1842.35 s
Current children cumulated vsize: 10991188 KiB
Current children cumulated memory: 7362232 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/193 16815
/proc/meminfo: memFree=13848088/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990912 memory=7361956 CPUtime=1902.35 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 3821049 0 0 0 189051 1184 0 0 20 0 1 0 248021767 11254693888 1840489 33554432000 4194304 5849940 140727065571920 140727065570920 5437784 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747728 1840489 760 405 0 2744672 0
Current children cumulated CPU time: 1902.35 s
Current children cumulated vsize: 10990912 KiB
Current children cumulated memory: 7361956 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 16816
/proc/meminfo: memFree=13848272/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990912 memory=7361956 CPUtime=1962.35 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 3968332 0 0 0 195009 1226 0 0 20 0 1 0 248021767 11254693888 1840489 33554432000 4194304 5849940 140727065571920 140727065570920 5307385 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747728 1840489 760 405 0 2744672 0
Current children cumulated CPU time: 1962.35 s
Current children cumulated vsize: 10990912 KiB
Current children cumulated memory: 7361956 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 16817
/proc/meminfo: memFree=13880996/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990768 memory=7361812 CPUtime=2022.35 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4133423 0 0 0 200974 1261 0 0 20 0 1 0 248021767 11254546432 1840453 33554432000 4194304 5849940 140727065571920 140727065570408 5307332 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747692 1840453 760 405 0 2744636 0
Current children cumulated CPU time: 2022.35 s
Current children cumulated vsize: 10990768 KiB
Current children cumulated memory: 7361812 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16819
/proc/meminfo: memFree=13848188/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990768 memory=7361812 CPUtime=2082.35 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4271875 0 0 0 206935 1300 0 0 20 0 1 0 248021767 11254546432 1840453 33554432000 4194304 5849940 140727065571920 140727065570920 140183867666311 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747692 1840453 760 405 0 2744636 0
Current children cumulated CPU time: 2082.35 s
Current children cumulated vsize: 10990768 KiB
Current children cumulated memory: 7361812 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16820
/proc/meminfo: memFree=13848368/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990768 memory=7361812 CPUtime=2142.36 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4428789 0 0 0 212902 1334 0 0 20 0 1 0 248021767 11254546432 1840453 33554432000 4194304 5849940 140727065571920 140727065570792 5438047 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747692 1840453 760 405 0 2744636 0
Current children cumulated CPU time: 2142.36 s
Current children cumulated vsize: 10990768 KiB
Current children cumulated memory: 7361812 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 16821
/proc/meminfo: memFree=13848508/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990776 memory=7361820 CPUtime=2202.36 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4587549 0 0 0 218860 1376 0 0 20 0 1 0 248021767 11254554624 1840455 33554432000 4194304 5849940 140727065571920 140727065570648 5317929 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747694 1840455 760 405 0 2744638 0
Current children cumulated CPU time: 2202.36 s
Current children cumulated vsize: 10990776 KiB
Current children cumulated memory: 7361820 KiB

[startup+2262.3 s]
/proc/loadavg: 2.15 2.05 2.06 3/192 16830
/proc/meminfo: memFree=13848276/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10990776 memory=7361820 CPUtime=2262.36 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4746715 0 0 0 224824 1412 0 0 20 0 1 0 248021767 11254554624 1840455 33554432000 4194304 5849940 140727065571920 140727065570792 140183867666311 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2747694 1840455 760 405 0 2744638 0
Current children cumulated CPU time: 2262.36 s
Current children cumulated vsize: 10990776 KiB
Current children cumulated memory: 7361820 KiB

[startup+2322.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/192 16831
/proc/meminfo: memFree=13780616/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993744 memory=7364788 CPUtime=2322.36 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 4910471 0 0 0 230781 1455 0 0 20 0 1 0 248021767 11257593856 1841197 33554432000 4194304 5849940 140727065571920 140727065570920 5335774 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748436 1841197 760 405 0 2745380 0
Current children cumulated CPU time: 2322.36 s
Current children cumulated vsize: 10993744 KiB
Current children cumulated memory: 7364788 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/192 16832
/proc/meminfo: memFree=13781324/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993516 memory=7364560 CPUtime=2382.37 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 5045535 0 0 0 236745 1492 0 0 20 0 1 0 248021767 11257360384 1841140 33554432000 4194304 5849940 140727065571920 140727065570920 5437903 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748379 1841140 760 405 0 2745323 0
Current children cumulated CPU time: 2382.37 s
Current children cumulated vsize: 10993516 KiB
Current children cumulated memory: 7364560 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/192 16834
/proc/meminfo: memFree=13781380/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993516 memory=7364560 CPUtime=2442.36 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 5208271 0 0 0 242694 1542 0 0 20 0 1 0 248021767 11257360384 1841140 33554432000 4194304 5849940 140727065571920 140727065570920 5312986 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748379 1841140 760 405 0 2745323 0
Current children cumulated CPU time: 2442.36 s
Current children cumulated vsize: 10993516 KiB
Current children cumulated memory: 7364560 KiB

[startup+2502.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/192 16835
/proc/meminfo: memFree=13781456/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993396 memory=7364440 CPUtime=2502.37 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 5366129 0 0 0 248664 1573 0 0 20 0 1 0 248021767 11257237504 1841110 33554432000 4194304 5849940 140727065571920 140727065570920 5437772 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748349 1841110 760 405 0 2745293 0
Current children cumulated CPU time: 2502.37 s
Current children cumulated vsize: 10993396 KiB
Current children cumulated memory: 7364440 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.04 2.04 2.05 3/191 16836
/proc/meminfo: memFree=13894940/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993396 memory=7364440 CPUtime=2520.06 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 5428235 0 0 0 250419 1587 0 0 20 0 1 0 248021767 11257237504 1841110 33554432000 4194304 5849940 140727065571920 140727065570792 5354572 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748349 1841110 760 405 0 2745293 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 10993396 KiB
Current children cumulated memory: 7364440 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.04 s]
# the end of solver process 16669 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2504.2 s, system=15.9145 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 2.04 2.04 2.05 3/191 16836
/proc/meminfo: memFree=13894940/32770624 swapFree=67108840/67108860
[pid=16669] ppid=16666 vsize=10993396 memory=7364440 CPUtime=2520.06 cores=1,3,5,7
/proc/16669/stat : 16669 (xcsp_picat) R 16666 16669 15138 0 -1 4202496 5428235 0 0 0 250419 1587 0 0 20 0 1 0 248021767 11257237504 1841110 33554432000 4194304 5849940 140727065571920 140727065570792 5354572 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 27635712 140727065580726 140727065580804 140727065580804 140727065583562 0
/proc/16669/statm: 2748349 1841110 760 405 0 2745293 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 10993396 KiB
Current children cumulated memory: 7364440 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.04
CPU time (s): 2520.11
CPU user time (s): 2504.2
CPU system time (s): 15.9145
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 14538236
Max. memory (cumulated for all children) (KiB): 9360596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2504.2
system time used= 15.9145
maximum resident set size= 9360596
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5428236
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 633


# summary of solver processes directly reported to runsolver:
#   pid: 16669
#   total CPU time (s): 2520.11
#   total CPU user time (s): 2504.2
#   total CPU system time (s): 15.9145

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.93275 second user time and 18.7963 second system time

The end

Launcher Data 

Begin job on node135 at 2018-08-15 05:43:06
IDJOB=4309870
IDBENCH=141271
IDSOLVER=2794
FILE ID=node135/4309870-1534304585
RUNJOBID= node135-1534293063-15170
PBS_JOBID= 21038137
Free space on /tmp= 47068 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Fapp/Fapp-m2s/Fapp-m2s-08-0700_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309870-1534304585/watcher-4309870-1534304585 -o /tmp/evaluation-result-4309870-1534304585/solver-4309870-1534304585 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node135-1534293063-15170 --watchdog 2580  xcsp_picat HOME/instance-4309870-1534304585.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1726f38b1078149b3b3b5e51280bc638
RANDOM SEED=1699877914

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24181744 kB
MemAvailable:   31446796 kB
Buffers:          152116 kB
Cached:          7346864 kB
SwapCached:           20 kB
Active:          4548080 kB
Inactive:        3453056 kB
Active(anon):     451364 kB
Inactive(anon):   111472 kB
Active(file):    4096716 kB
Inactive(file):  3341584 kB
Unevictable:        7240 kB
Mlocked:            7240 kB
SwapTotal:      67108860 kB
SwapFree:       67108840 kB
Dirty:            214936 kB
Writeback:             0 kB
AnonPages:        509392 kB
Mapped:            59912 kB
Shmem:             57996 kB
Slab:             283492 kB
SReclaimable:     255212 kB
SUnreclaim:        28280 kB
KernelStack:        3360 kB
PageTables:         6320 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2827192 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    362496 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       93568 kB
DirectMap2M:    33452032 kB

Free space on /tmp at the end= 46944 MiB
End job on node135 at 2018-08-15 06:25:06