Trace number 4240443

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: cosoco-sat 1.1? (TO) 2400.01 2400.9

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-07-350-100.xml
MD5SUMcd1777af07bd314664d86e97c163b75e
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark22
Best CPU time to get the best result obtained on this benchmark19965.9
Satisfiable
(Un)Satisfiability was proved
Number of variables2451
Number of constraints29
Number of domains2
Minimum domain size2
Maximum domain size334
Distribution of domain sizes[{"size":2,"count":2450},{"size":334,"count":1}]
Minimum variable degree8
Maximum variable degree22
Distribution of variable degrees[{"degree":8,"count":2450},{"degree":22,"count":1}]
Minimum constraint arity350
Maximum constraint arity2450
Distribution of constraint arities[{"arity":350,"count":7},{"arity":701,"count":21},{"arity":2450,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":28}]
Optimization problemYES
Type of objectivemin VAR

Solver Data 

0.19/0.22	c SAT : Variables: 5234 -- Clauses: 60512
0.19/0.22	c best=?? lower=0 upper=333

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4240443-1500636419/watcher-4240443-1500636419 -o /tmp/evaluation-result-4240443-1500636419/solver-4240443-1500636419 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node131-1500623778-4006 --watchdog 2560 HOME/cosoco -lc -model -restarts -sat HOME/instance-4240443-1500636419.xml 

pid=6563
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.12 4.22 3.18 3/189 6566
/proc/meminfo: memFree=30535420/32770624 swapFree=6268/16656
[pid=6566] ppid=6563 vsize=27120 CPUtime=0 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 974 0 0 0 0 0 0 0 20 0 1 0 16918521 27770880 804 33554432000 4194304 5970956 140720312568112 140720312565208 140217460169701 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 6780 804 703 434 0 144 0

[startup+0.100114 s]
/proc/loadavg: 4.12 4.22 3.18 3/189 6566
/proc/meminfo: memFree=30535420/32770624 swapFree=6268/16656
[pid=6566] ppid=6563 vsize=29868 CPUtime=0.09 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 1774 0 0 0 9 0 0 0 20 0 1 0 16918521 30584832 1558 33554432000 4194304 5970956 140720312568112 140720312562344 140217463648368 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 7467 1558 801 434 0 831 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29868

[startup+0.200272 s]
/proc/loadavg: 4.12 4.22 3.18 3/189 6566
/proc/meminfo: memFree=30535420/32770624 swapFree=6268/16656
[pid=6566] ppid=6563 vsize=32296 CPUtime=0.19 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 2358 0 0 0 19 0 0 0 20 0 1 0 16918521 33071104 2197 33554432000 4194304 5970956 140720312568112 140720312561112 140217461113043 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 8074 2197 801 434 0 1438 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 32296

[startup+0.300214 s]
/proc/loadavg: 4.12 4.22 3.18 3/189 6566
/proc/meminfo: memFree=30535420/32770624 swapFree=6268/16656
[pid=6566] ppid=6563 vsize=45768 CPUtime=0.28 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 4855 0 0 0 28 0 0 0 20 0 1 0 16918521 46866432 5178 33554432000 4194304 5970956 140720312568112 140720312565080 4964777 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 11442 5178 847 434 0 4806 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 45768

[startup+0.700179 s]
/proc/loadavg: 4.12 4.22 3.18 3/189 6566
/proc/meminfo: memFree=30535420/32770624 swapFree=6268/16656
[pid=6566] ppid=6563 vsize=47088 CPUtime=0.68 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 5169 0 0 0 68 0 0 0 20 0 1 0 16918521 48218112 5508 33554432000 4194304 5970956 140720312568112 140720312565080 5052085 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 11772 5508 847 434 0 5136 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 47088

[startup+1.50015 s]
/proc/loadavg: 4.12 4.22 3.18 3/190 6567
/proc/meminfo: memFree=30509940/32770624 swapFree=6268/16672
[pid=6566] ppid=6563 vsize=51576 CPUtime=1.48 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 6280 0 0 0 148 0 0 0 20 0 1 0 16918521 52813824 6630 33554432000 4194304 5970956 140720312568112 140720312565080 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 12894 6630 847 434 0 6258 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 51576

[startup+3.10018 s]
/proc/loadavg: 4.12 4.22 3.18 3/190 6567
/proc/meminfo: memFree=30497212/32770624 swapFree=6268/16672
[pid=6566] ppid=6563 vsize=60420 CPUtime=3.09 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 9314 0 0 0 308 1 0 0 20 0 1 0 16918521 61870080 8790 33554432000 4194304 5970956 140720312568112 140720312565080 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 15105 8790 847 434 0 8469 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 60420

[startup+6.30017 s]
/proc/loadavg: 3.87 4.16 3.17 3/190 6567
/proc/meminfo: memFree=30462844/32770624 swapFree=6268/16716
[pid=6566] ppid=6563 vsize=76260 CPUtime=6.29 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 14324 0 0 0 627 2 0 0 20 0 1 0 16918521 78090240 12760 33554432000 4194304 5970956 140720312568112 140720312565080 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 19065 12760 848 434 0 12429 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 76260

[startup+12.7002 s]
/proc/loadavg: 3.72 4.13 3.16 3/190 6567
/proc/meminfo: memFree=30390288/32770624 swapFree=6268/16728
[pid=6566] ppid=6563 vsize=109920 CPUtime=12.68 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 24542 0 0 0 1265 3 0 0 20 0 1 0 16918521 112558080 21173 33554432000 4194304 5970956 140720312568112 140720312565080 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 27480 21173 848 434 0 20844 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 109920

[startup+25.5003 s]
/proc/loadavg: 3.34 4.02 3.14 3/190 6567
/proc/meminfo: memFree=30283136/32770624 swapFree=6268/16736
[pid=6566] ppid=6563 vsize=143844 CPUtime=25.48 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 59769 0 0 0 2542 6 0 0 20 0 1 0 16918521 147296256 29707 33554432000 4194304 5970956 140720312568112 140720312565080 5098954 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 35961 29707 849 434 0 29325 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 143844

[startup+51.1003 s]
/proc/loadavg: 2.88 3.86 3.11 3/190 6567
/proc/meminfo: memFree=30148204/32770624 swapFree=6268/16748
[pid=6566] ppid=6563 vsize=143844 CPUtime=51.07 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 67797 0 0 0 5097 10 0 0 20 0 1 0 16918521 147296256 29723 33554432000 4194304 5970956 140720312568112 140720312565080 5098944 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 35961 29723 849 434 0 29325 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 143844

[startup+102.3 s]
/proc/loadavg: 2.38 3.57 3.05 3/188 6569
/proc/meminfo: memFree=29868820/32770624 swapFree=6268/16800
[pid=6566] ppid=6563 vsize=144240 CPUtime=102.26 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 82384 0 0 0 10214 12 0 0 20 0 1 0 16918521 147701760 29825 33554432000 4194304 5970956 140720312568112 140720312565144 5098954 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 36060 29825 849 434 0 29424 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 144240

[startup+162.3 s]
/proc/loadavg: 2.14 3.29 2.99 3/188 6570
/proc/meminfo: memFree=29546088/32770624 swapFree=6268/16832
[pid=6566] ppid=6563 vsize=145164 CPUtime=162.23 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 108313 0 0 0 16209 14 0 0 20 0 1 0 16918521 148647936 30025 33554432000 4194304 5970956 140720312568112 140720312565144 5069735 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 36291 30025 849 434 0 29655 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 145164

[startup+222.306 s]
/proc/loadavg: 2.05 3.05 2.92 3/188 6578
/proc/meminfo: memFree=29218792/32770624 swapFree=6268/16948
[pid=6566] ppid=6563 vsize=146752 CPUtime=222.22 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 122636 0 0 0 22207 15 0 0 20 0 1 0 16918521 150274048 30428 33554432000 4194304 5970956 140720312568112 140720312565144 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 36688 30428 849 434 0 30052 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 146752

[startup+282.3 s]
/proc/loadavg: 2.02 2.86 2.87 3/187 6579
/proc/meminfo: memFree=28894964/32770624 swapFree=6268/16976
[pid=6566] ppid=6563 vsize=149136 CPUtime=282.19 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 136756 0 0 0 28203 16 0 0 20 0 1 0 16918521 152715264 31025 33554432000 4194304 5970956 140720312568112 140720312565144 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 37284 31025 849 434 0 30648 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 149136

[startup+342.3 s]
/proc/loadavg: 2.01 2.70 2.81 3/187 6580
/proc/meminfo: memFree=28565240/32770624 swapFree=6268/17008
[pid=6566] ppid=6563 vsize=152496 CPUtime=342.17 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 150620 0 0 0 34200 17 0 0 20 0 1 0 16918521 156155904 31849 33554432000 4194304 5970956 140720312568112 140720312565144 4908971 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 38124 31849 849 434 0 31488 0
Current children cumulated CPU time (s) 342.17
Current children cumulated vsize (KiB) 152496

[startup+402.3 s]
/proc/loadavg: 2.00 2.58 2.76 3/187 6581
/proc/meminfo: memFree=28244384/32770624 swapFree=6268/17044
[pid=6566] ppid=6563 vsize=154104 CPUtime=402.14 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 162829 0 0 0 40196 18 0 0 20 0 1 0 16918521 157802496 32248 33554432000 4194304 5970956 140720312568112 140720312564984 5098954 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 38526 32248 849 434 0 31890 0
Current children cumulated CPU time (s) 402.14
Current children cumulated vsize (KiB) 154104

[startup+462.3 s]
/proc/loadavg: 2.07 2.49 2.72 3/187 6582
/proc/meminfo: memFree=27916980/32770624 swapFree=6268/17072
[pid=6566] ppid=6563 vsize=154500 CPUtime=462.12 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 170301 0 0 0 46194 18 0 0 20 0 1 0 16918521 158208000 32361 33554432000 4194304 5970956 140720312568112 140720312564984 4961400 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 38625 32361 849 434 0 31989 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 154500

[startup+522.3 s]
/proc/loadavg: 2.03 2.40 2.67 3/187 6583
/proc/meminfo: memFree=27597092/32770624 swapFree=6268/17104
[pid=6566] ppid=6563 vsize=154900 CPUtime=522.1 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 177798 0 0 0 52191 19 0 0 20 0 1 0 16918521 158617600 32432 33554432000 4194304 5970956 140720312568112 140720312564984 4961411 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 38725 32432 849 434 0 32089 0
Current children cumulated CPU time (s) 522.1
Current children cumulated vsize (KiB) 154900

[startup+582.3 s]
/proc/loadavg: 2.01 2.33 2.63 3/187 6584
/proc/meminfo: memFree=27270132/32770624 swapFree=6268/17132
[pid=6566] ppid=6563 vsize=155168 CPUtime=582.07 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 185298 0 0 0 58188 19 0 0 20 0 1 0 16918521 158892032 32544 33554432000 4194304 5970956 140720312568112 140720312564984 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 38792 32544 849 434 0 32156 0
Current children cumulated CPU time (s) 582.07
Current children cumulated vsize (KiB) 155168


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.01 2.04 2.24 3/188 6615
/proc/meminfo: memFree=26617708/32770624 swapFree=6268/17656
[pid=6566] ppid=6563 vsize=156632 CPUtime=1541.74 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 381154 0 0 0 154142 32 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 5069735 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1541.74
Current children cumulated vsize (KiB) 156632

[startup+1602.3 s]
/proc/loadavg: 2.00 2.03 2.23 3/188 6616
/proc/meminfo: memFree=26617612/32770624 swapFree=6268/17692
[pid=6566] ppid=6563 vsize=156632 CPUtime=1601.7 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 393756 0 0 0 160138 32 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4964777 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1601.7
Current children cumulated vsize (KiB) 156632

[startup+1662.3 s]
/proc/loadavg: 2.04 2.04 2.22 3/188 6617
/proc/meminfo: memFree=26617580/32770624 swapFree=6268/17724
[pid=6566] ppid=6563 vsize=156632 CPUtime=1661.68 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 406363 0 0 0 166135 33 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1661.68
Current children cumulated vsize (KiB) 156632

[startup+1722.3 s]
/proc/loadavg: 2.02 2.04 2.21 3/187 6619
/proc/meminfo: memFree=26617384/32770624 swapFree=6268/17760
[pid=6566] ppid=6563 vsize=156632 CPUtime=1721.67 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 418992 0 0 0 172133 34 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1721.67
Current children cumulated vsize (KiB) 156632

[startup+1782.3 s]
/proc/loadavg: 2.01 2.03 2.20 3/187 6620
/proc/meminfo: memFree=26617420/32770624 swapFree=6268/17788
[pid=6566] ppid=6563 vsize=156632 CPUtime=1781.65 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 431648 0 0 0 178130 35 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1781.65
Current children cumulated vsize (KiB) 156632

[startup+1842.3 s]
/proc/loadavg: 2.00 2.02 2.18 3/187 6621
/proc/meminfo: memFree=26617204/32770624 swapFree=6268/17816
[pid=6566] ppid=6563 vsize=156632 CPUtime=1841.63 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 444309 0 0 0 184127 36 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 5069728 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1841.63
Current children cumulated vsize (KiB) 156632

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.17 3/187 6623
/proc/meminfo: memFree=26617112/32770624 swapFree=6268/17864
[pid=6566] ppid=6563 vsize=156632 CPUtime=1901.61 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 457002 0 0 0 190124 37 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4964447 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1901.61
Current children cumulated vsize (KiB) 156632

[startup+1962.3 s]
/proc/loadavg: 2.07 2.03 2.17 3/187 6624
/proc/meminfo: memFree=26617312/32770624 swapFree=6268/17892
[pid=6566] ppid=6563 vsize=156632 CPUtime=1961.58 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 469701 0 0 0 196121 37 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 5098954 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 1961.58
Current children cumulated vsize (KiB) 156632

[startup+2022.3 s]
/proc/loadavg: 2.03 2.02 2.15 3/187 6632
/proc/meminfo: memFree=26615664/32770624 swapFree=6268/17928
[pid=6566] ppid=6563 vsize=156632 CPUtime=2021.56 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 482430 0 0 0 202119 37 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 4908985 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 2021.56
Current children cumulated vsize (KiB) 156632

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.14 3/188 6656
/proc/meminfo: memFree=26614912/32770624 swapFree=6268/18052
[pid=6566] ppid=6563 vsize=156632 CPUtime=2081.54 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 495167 0 0 0 208116 38 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 5069735 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 2081.54
Current children cumulated vsize (KiB) 156632

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.13 3/188 6657
/proc/meminfo: memFree=26615296/32770624 swapFree=6268/18080
[pid=6566] ppid=6563 vsize=156632 CPUtime=2141.52 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 507938 0 0 0 214113 39 0 0 20 0 1 0 16918521 160391168 32902 33554432000 4194304 5970956 140720312568112 140720312565000 5069728 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32902 849 434 0 32522 0
Current children cumulated CPU time (s) 2141.52
Current children cumulated vsize (KiB) 156632

[startup+2202.31 s]
/proc/loadavg: 2.00 2.01 2.13 3/188 6719
/proc/meminfo: memFree=31880900/32770624 swapFree=6268/18156
[pid=6566] ppid=6563 vsize=156632 CPUtime=2201.5 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 520723 0 0 0 220110 40 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4961411 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2201.5
Current children cumulated vsize (KiB) 156632

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.12 3/188 6720
/proc/meminfo: memFree=31879924/32770624 swapFree=6268/18236
[pid=6566] ppid=6563 vsize=156632 CPUtime=2261.47 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 524253 0 0 0 226106 41 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4908971 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2261.47
Current children cumulated vsize (KiB) 156632

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.12 3/188 6721
/proc/meminfo: memFree=31882040/32770624 swapFree=6268/18288
[pid=6566] ppid=6563 vsize=156632 CPUtime=2321.44 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 524553 0 0 0 232103 41 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4964452 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2321.44
Current children cumulated vsize (KiB) 156632

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.11 3/187 6722
/proc/meminfo: memFree=31881684/32770624 swapFree=6268/18324
[pid=6566] ppid=6563 vsize=156632 CPUtime=2381.41 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 524852 0 0 0 238100 41 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2381.41
Current children cumulated vsize (KiB) 156632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.9 s]
/proc/loadavg: 2.00 2.01 2.11 3/187 6722
/proc/meminfo: memFree=31882304/32770624 swapFree=6268/18332
[pid=6566] ppid=6563 vsize=156632 CPUtime=2400 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 525150 0 0 0 239959 41 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2400
Current children cumulated vsize (KiB) 156632

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6566 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.9 s]
/proc/loadavg: 2.00 2.01 2.11 3/187 6722
/proc/meminfo: memFree=31882304/32770624 swapFree=6268/18332
[pid=6566] ppid=6563 vsize=156632 CPUtime=2400 cores=0,2,4,6
/proc/6566/stat : 6566 (cosoco) R 6563 6566 3975 0 -1 4202496 525150 0 0 0 239959 41 0 0 20 0 1 0 16918521 160391168 32903 33554432000 4194304 5970956 140720312568112 140720312565000 4964768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 9191424 140720312571068 140720312571203 140720312571203 140720312573902 0
/proc/6566/statm: 39158 32903 849 434 0 32522 0
Current children cumulated CPU time (s) 2400
Current children cumulated vsize (KiB) 156632

Child status: 1
Real time (s): 2400.9
CPU time (s): 2400.01
CPU user time (s): 2399.6
CPU system time (s): 0.415846
CPU usage (%): 99.963
Max. virtual memory (cumulated for all children) (KiB): 156632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.6
system time used= 0.415846
maximum resident set size= 131656
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 525177
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 122506

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.13273 second user time and 9.06492 second system time

The end

Launcher Data 

Begin job on node131 at 2017-07-21 13:27:00
IDJOB=4240443
IDBENCH=122949
IDSOLVER=2621
FILE ID=node131/4240443-1500636419
RUNJOBID= node131-1500623778-4006
PBS_JOBID= 20623002
Free space on /tmp= 62020 MiB

SOLVER NAME= cosoco-sat 1.1
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-07-350-100.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4240443-1500636419/watcher-4240443-1500636419 -o /tmp/evaluation-result-4240443-1500636419/solver-4240443-1500636419 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node131-1500623778-4006 --watchdog 2560  HOME/cosoco -lc -model -restarts -sat HOME/instance-4240443-1500636419.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cd1777af07bd314664d86e97c163b75e
RANDOM SEED=1370875230

node131.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2533.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1733.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30535996 kB
MemAvailable:   30516784 kB
Buffers:          120068 kB
Cached:           132856 kB
SwapCached:           52 kB
Active:          1443572 kB
Inactive:         351660 kB
Active(anon):    1218568 kB
Inactive(anon):   335004 kB
Active(file):     225004 kB
Inactive(file):    16656 kB
Unevictable:        6268 kB
Mlocked:            6268 kB
SwapTotal:      67108860 kB
SwapFree:       67108780 kB
Dirty:              4652 kB
Writeback:             0 kB
AnonPages:       1548324 kB
Mapped:            34420 kB
Shmem:              8780 kB
Slab:             135880 kB
SReclaimable:     109924 kB
SUnreclaim:        25956 kB
KernelStack:        3344 kB
PageTables:         7928 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1817772 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      109952 kB
DirectMap2M:    33435648 kB

Free space on /tmp at the end= 62020 MiB
End job on node131 at 2017-07-21 14:07:01