Trace number 4309879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.14 2519.86

General information on the benchmark

NameFapp/Fapp-m2s/
Fapp-m2s-07-0600_c18.xml
MD5SUM0ae5362fc8ec35126a2a174beba608b8
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1603939205
Best CPU time to get the best result obtained on this benchmark2520.11
Satisfiable
(Un)Satisfiability was proved
Number of variables13855
Number of constraints8996
Number of domains202
Minimum domain size1
Maximum domain size151
Distribution of domain sizes[{"size":1,"count":2},{"size":2,"count":4816},{"size":11,"count":4218},{"size":12,"count":1},{"size":21,"count":9},{"size":23,"count":10},{"size":25,"count":44},{"size":29,"count":37},{"size":31,"count":2},{"size":32,"count":3},{"size":33,"count":37},{"size":34,"count":12},{"size":35,"count":9},{"size":36,"count":11},{"size":37,"count":13},{"size":38,"count":8},{"size":39,"count":37},{"size":40,"count":13},{"size":41,"count":28},{"size":42,"count":21},{"size":43,"count":32},{"size":44,"count":30},{"size":45,"count":18},{"size":46,"count":11},{"size":48,"count":13},"...",{"size":119,"count":4}, {"size":120,"count":3}, {"size":121,"count":17}, {"size":123,"count":97}, {"size":125,"count":18}, {"size":126,"count":17}, {"size":127,"count":42}, {"size":128,"count":76}, {"size":130,"count":61}, {"size":131,"count":88}, {"size":132,"count":46}, {"size":133,"count":30}, {"size":135,"count":53}, {"size":136,"count":94}, {"size":137,"count":43}, {"size":138,"count":8}, {"size":139,"count":29}, {"size":141,"count":5}, {"size":143,"count":122}, {"size":144,"count":136}, {"size":145,"count":57}, {"size":147,"count":60}, {"size":148,"count":54}, {"size":150,"count":21}, {"size":151,"count":1165}]
Minimum variable degree2
Maximum variable degree4219
Distribution of variable degrees[{"degree":2,"count":12654},{"degree":3,"count":1},{"degree":4,"count":10},{"degree":5,"count":17},{"degree":6,"count":18},{"degree":7,"count":18},{"degree":8,"count":40},{"degree":9,"count":42},{"degree":10,"count":76},{"degree":11,"count":64},{"degree":12,"count":63},{"degree":13,"count":48},{"degree":14,"count":63},{"degree":15,"count":70},{"degree":16,"count":93},{"degree":17,"count":127},{"degree":18,"count":153},{"degree":19,"count":186},{"degree":20,"count":110},{"degree":21,"count":1},{"degree":4219,"count":1}]
Minimum constraint arity2
Maximum constraint arity6
Distribution of constraint arities[{"arity":2,"count":560},{"arity":3,"count":4218},{"arity":6,"count":4218}]
Number of extensional constraints4218
Number of intensional constraints4778
Distribution of constraint types[{"type":"extension","count":4218},{"type":"intension","count":4778}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (5745 MiB free)
  memory of node 1: 16384 MiB (8836 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309879-1534304163/watcher-4309879-1534304163 -o /tmp/evaluation-result-4309879-1534304163/solver-4309879-1534304163 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534294082-5448 --watchdog 2580 xcsp_picat HOME/instance-4309879-1534304163.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=6529, runsolver pid=6526
Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14908608/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=25928 CPUtime=0.1 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1555 0 0 0 10 0 0 0 20 0 1 0 247979601 2074361856 6482 33554432000 4194304 5849940 140724060631280 140724060630584 4828704 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 6482 595 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 25928 KiB

[startup+0.209579 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14902464/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=32072 CPUtime=0.2 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1560 0 0 0 20 0 0 0 20 0 1 0 247979601 2074361856 8018 33554432000 4194304 5849940 140724060631280 140724060630584 4476348 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 8018 595 405 0 503380 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 32072 KiB

[startup+0.309452 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14896320/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=38216 CPUtime=0.3 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1563 0 0 0 30 0 0 0 20 0 1 0 247979601 2074361856 9554 33554432000 4194304 5849940 140724060631280 140724060630584 4532510 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 9554 595 405 0 503380 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 38216 KiB

[startup+0.700358 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14884032/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=62792 CPUtime=0.69 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1575 0 0 0 68 1 0 0 20 0 1 0 247979601 2074361856 15698 33554432000 4194304 5849940 140724060631280 140724060630584 139712585137152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 15698 595 405 0 503380 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 62792 KiB

[startup+1.50035 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14853132/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=112096 CPUtime=1.5 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1599 0 0 0 148 2 0 0 20 0 1 0 247979601 2074361856 28024 33554432000 4194304 5849940 140724060631280 140724060630584 139712585137152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 28024 628 405 0 503380 0
Current children cumulated CPU time: 1.5 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 112096 KiB

[startup+3.10934 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14732328/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=208352 CPUtime=3.1 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1734 0 0 0 307 3 0 0 20 0 1 0 247979601 2074361856 52088 33554432000 4194304 5849940 140724060631280 140724060630584 139712585137152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 52088 628 405 0 503380 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 208352 KiB

[startup+6.30028 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14507628/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=402912 CPUtime=6.29 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 1839 0 0 0 622 7 0 0 20 0 1 0 247979601 2074361856 100728 33554432000 4194304 5849940 140724060631280 140724060630584 139712585137152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 100728 628 405 0 503380 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 402912 KiB

[startup+12.7003 s]*
/proc/loadavg: 1.93 2.00 2.04 3/187 6530
/proc/meminfo: memFree=14138920/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=794080 CPUtime=12.7 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 2121 0 0 0 1256 14 0 0 20 0 1 0 247979601 2074361856 198520 33554432000 4194304 5849940 140724060631280 140724060630584 4476365 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 198520 628 405 0 503380 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 794080 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 6530
/proc/meminfo: memFree=13303092/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=2025744 memory=1570272 CPUtime=25.49 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 2599 0 0 0 2523 26 0 0 20 0 1 0 247979601 2074361856 392568 33554432000 4194304 5849940 140724060631280 140724060630584 139712585137152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 506436 392568 628 405 0 503380 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 1570272 KiB

[startup+51.1003 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 6530
/proc/meminfo: memFree=11889548/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=4174636 memory=2931808 CPUtime=51.09 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 6227 0 0 0 5057 52 0 0 20 0 1 0 247979601 4274827264 732952 33554432000 4194304 5849940 140724060631280 140724060630584 5257227 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 1043659 732952 632 405 0 1040603 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 4174636 KiB
Current children cumulated memory: 2931808 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.01 2.05 3/187 6592
/proc/meminfo: memFree=5287828/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=6701688 memory=5767608 CPUtime=102.3 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 42097 0 0 0 9951 279 0 0 20 0 1 0 247979601 6862528512 1441902 33554432000 4194304 5849940 140724060631280 140724060630600 5252893 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 1675422 1441902 665 405 0 1672366 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 6701688 KiB
Current children cumulated memory: 5767608 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 6593
/proc/meminfo: memFree=2617660/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=10858068 memory=9020068 CPUtime=162.3 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 55551 0 0 0 15810 420 0 0 20 0 1 0 247979601 11118661632 2255017 33554432000 4194304 5849940 140724060631280 140724060630376 5521670 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2714517 2255017 717 405 0 2711461 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 10858068 KiB
Current children cumulated memory: 9020068 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/186 6594
/proc/meminfo: memFree=1867764/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11609020 memory=9770996 CPUtime=222.31 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 77960 0 0 0 21748 483 0 0 20 0 1 0 247979601 11887636480 2442749 33554432000 4194304 5849940 140724060631280 140724060629768 5319920 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2902255 2442749 757 405 0 2899199 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 11609020 KiB
Current children cumulated memory: 9770996 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 6605
/proc/meminfo: memFree=1928000/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11609020 memory=9771184 CPUtime=282.32 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 142301 0 0 0 27744 488 0 0 20 0 1 0 247979601 11887636480 2442796 33554432000 4194304 5849940 140724060631280 140724060629768 5319945 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2902255 2442796 758 405 0 2899199 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 11609020 KiB
Current children cumulated memory: 9771184 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 6606
/proc/meminfo: memFree=1953304/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11609020 memory=9771184 CPUtime=342.33 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 218860 0 0 0 33741 492 0 0 20 0 1 0 247979601 11887636480 2442796 33554432000 4194304 5849940 140724060631280 140724060629768 5319922 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2902255 2442796 758 405 0 2899199 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 11609020 KiB
Current children cumulated memory: 9771184 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 6607
/proc/meminfo: memFree=1954056/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11609020 memory=9771184 CPUtime=402.33 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 306831 0 0 0 39736 497 0 0 20 0 1 0 247979601 11887636480 2442796 33554432000 4194304 5849940 140724060631280 140724060629768 5319922 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2902255 2442796 758 405 0 2899199 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 11609020 KiB
Current children cumulated memory: 9771184 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 6608
/proc/meminfo: memFree=1953948/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11609020 memory=9771184 CPUtime=462.33 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 386804 0 0 0 45732 501 0 0 20 0 1 0 247979601 11887636480 2442796 33554432000 4194304 5849940 140724060631280 140724060629768 5319920 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2902255 2442796 758 405 0 2899199 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 11609020 KiB
Current children cumulated memory: 9771184 KiB


################
# More data... #
################

/proc/6529/statm: 2835339 2376416 764 405 0 2832283 0
Current children cumulated CPU time: 1782.49 s
Current children cumulated vsize: 11341356 KiB
Current children cumulated memory: 9505664 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6672
/proc/meminfo: memFree=2124340/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11341356 memory=9505664 CPUtime=1842.51 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 5144135 0 0 0 183431 820 0 0 20 0 1 0 247979601 11613548544 2376416 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2835339 2376416 764 405 0 2832283 0
Current children cumulated CPU time: 1842.51 s
Current children cumulated vsize: 11341356 KiB
Current children cumulated memory: 9505664 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6673
/proc/meminfo: memFree=1822772/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11517856 memory=9682164 CPUtime=1902.51 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 5624982 0 0 0 189380 871 0 0 20 0 1 0 247979601 11794284544 2420541 33554432000 4194304 5849940 140724060631280 140724060630040 5317193 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879464 2420541 764 405 0 2876408 0
Current children cumulated CPU time: 1902.51 s
Current children cumulated vsize: 11517856 KiB
Current children cumulated memory: 9682164 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6674
/proc/meminfo: memFree=1897236/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11517856 memory=9682164 CPUtime=1962.52 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 6047615 0 0 0 195348 904 0 0 20 0 1 0 247979601 11794284544 2420541 33554432000 4194304 5849940 140724060631280 140724060629768 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879464 2420541 764 405 0 2876408 0
Current children cumulated CPU time: 1962.52 s
Current children cumulated vsize: 11517856 KiB
Current children cumulated memory: 9682164 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6675
/proc/meminfo: memFree=1896992/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11517204 memory=9681512 CPUtime=2022.52 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 6382327 0 0 0 201299 953 0 0 20 0 1 0 247979601 11793616896 2420378 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879301 2420378 764 405 0 2876245 0
Current children cumulated CPU time: 2022.52 s
Current children cumulated vsize: 11517204 KiB
Current children cumulated memory: 9681512 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6684
/proc/meminfo: memFree=1809616/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11779068 memory=9943376 CPUtime=2082.52 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 6715246 0 0 0 207260 992 0 0 20 0 1 0 247979601 12061765632 2485844 33554432000 4194304 5849940 140724060631280 140724060630040 5340944 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2944767 2485844 764 405 0 2941711 0
Current children cumulated CPU time: 2082.52 s
Current children cumulated vsize: 11779068 KiB
Current children cumulated memory: 9943376 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6685
/proc/meminfo: memFree=1898144/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11516920 memory=9681228 CPUtime=2142.54 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 7027728 0 0 0 213221 1033 0 0 20 0 1 0 247979601 11793326080 2420307 33554432000 4194304 5849940 140724060631280 140724060629544 139712585560541 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879230 2420307 764 405 0 2876174 0
Current children cumulated CPU time: 2142.54 s
Current children cumulated vsize: 11516920 KiB
Current children cumulated memory: 9681228 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6686
/proc/meminfo: memFree=1897848/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11516920 memory=9681228 CPUtime=2202.53 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 7356374 0 0 0 219180 1073 0 0 20 0 1 0 247979601 11793326080 2420307 33554432000 4194304 5849940 140724060631280 140724060630152 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879230 2420307 764 405 0 2876174 0
Current children cumulated CPU time: 2202.53 s
Current children cumulated vsize: 11516920 KiB
Current children cumulated memory: 9681228 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6687
/proc/meminfo: memFree=1897792/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11516544 memory=9680852 CPUtime=2262.55 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 7736822 0 0 0 225130 1125 0 0 20 0 1 0 247979601 11792941056 2420213 33554432000 4194304 5849940 140724060631280 140724060629768 5319922 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879136 2420213 764 405 0 2876080 0
Current children cumulated CPU time: 2262.55 s
Current children cumulated vsize: 11516544 KiB
Current children cumulated memory: 9680852 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6688
/proc/meminfo: memFree=1898120/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11516180 memory=9680488 CPUtime=2322.55 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 8070972 0 0 0 231086 1169 0 0 20 0 1 0 247979601 11792568320 2420122 33554432000 4194304 5849940 140724060631280 140724060630280 5336189 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879045 2420122 764 405 0 2875989 0
Current children cumulated CPU time: 2322.55 s
Current children cumulated vsize: 11516180 KiB
Current children cumulated memory: 9680488 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6689
/proc/meminfo: memFree=1898192/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11516180 memory=9680488 CPUtime=2382.56 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 8458892 0 0 0 237040 1216 0 0 20 0 1 0 247979601 11792568320 2420122 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2879045 2420122 764 405 0 2875989 0
Current children cumulated CPU time: 2382.56 s
Current children cumulated vsize: 11516180 KiB
Current children cumulated memory: 9680488 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6690
/proc/meminfo: memFree=1959612/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11525608 memory=9682736 CPUtime=2442.57 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 8800890 0 0 0 242995 1262 0 0 20 0 1 0 247979601 11802222592 2420684 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2881402 2420684 764 405 0 2878346 0
Current children cumulated CPU time: 2442.57 s
Current children cumulated vsize: 11525608 KiB
Current children cumulated memory: 9682736 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6691
/proc/meminfo: memFree=1895056/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11525172 memory=9682300 CPUtime=2502.57 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 9195360 0 0 0 248953 1304 0 0 20 0 1 0 247979601 11801776128 2420575 33554432000 4194304 5849940 140724060631280 140724060630280 5312790 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2881293 2420575 764 405 0 2878237 0
Current children cumulated CPU time: 2502.57 s
Current children cumulated vsize: 11525172 KiB
Current children cumulated memory: 9682300 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.81 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6691
/proc/meminfo: memFree=1895056/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11525172 memory=9682300 CPUtime=2520.08 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 9254370 0 0 0 250694 1314 0 0 20 0 1 0 247979601 11801776128 2420575 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2881293 2420575 764 405 0 2878237 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 11525172 KiB
Current children cumulated memory: 9682300 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.86 s]
# the end of solver process 6529 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.95 s, system=13.1945 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.81 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6691
/proc/meminfo: memFree=1895056/32770624 swapFree=67108504/67108860
[pid=6529] ppid=6526 vsize=11525172 memory=9682300 CPUtime=2520.08 cores=1,3,5,7
/proc/6529/stat : 6529 (xcsp_picat) R 6526 6529 5416 0 -1 4202496 9254370 0 0 0 250694 1314 0 0 20 0 1 0 247979601 11801776128 2420575 33554432000 4194304 5849940 140724060631280 140724060630280 139712585158535 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 29261824 140724060636342 140724060636420 140724060636420 140724060639178 0
/proc/6529/statm: 2881293 2420575 764 405 0 2878237 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 11525172 KiB
Current children cumulated memory: 9682300 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.86
CPU time (s): 2520.14
CPU user time (s): 2506.95
CPU system time (s): 13.1945
CPU usage (%): 100.011
Max. virtual memory (cumulated for all children) (KiB): 14514320
Max. memory (cumulated for all children) (KiB): 9944884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.95
system time used= 13.1945
maximum resident set size= 9944884
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9254370
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1192


# summary of solver processes directly reported to runsolver:
#   pid: 6529
#   total CPU time (s): 2520.14
#   total CPU user time (s): 2506.95
#   total CPU system time (s): 13.1945

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.82968 second user time and 18.4692 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-15 05:36:04
IDJOB=4309879
IDBENCH=141263
IDSOLVER=2794
FILE ID=node104/4309879-1534304163
RUNJOBID= node104-1534294082-5448
PBS_JOBID= 21038148
Free space on /tmp= 39776 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Fapp/Fapp-m2s/Fapp-m2s-07-0600_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309879-1534304163/watcher-4309879-1534304163 -o /tmp/evaluation-result-4309879-1534304163/solver-4309879-1534304163 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534294082-5448 --watchdog 2580  xcsp_picat HOME/instance-4309879-1534304163.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0ae5362fc8ec35126a2a174beba608b8
RANDOM SEED=311948851

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        14932864 kB
MemAvailable:   31419832 kB
Buffers:          244736 kB
Cached:         16296772 kB
SwapCached:            8 kB
Active:          8515708 kB
Inactive:        8555784 kB
Active(anon):     481160 kB
Inactive(anon):   109336 kB
Active(file):    8034548 kB
Inactive(file):  8446448 kB
Unevictable:        7304 kB
Mlocked:            7304 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:            279936 kB
Writeback:             0 kB
AnonPages:        537272 kB
Mapped:            57284 kB
Shmem:             57828 kB
Slab:             462432 kB
SReclaimable:     434432 kB
SUnreclaim:        28000 kB
KernelStack:        3280 kB
PageTables:         6308 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2861436 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    327680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 39680 MiB
End job on node104 at 2018-08-15 06:18:04