Trace number 4240463

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.11 2400.6

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-10-360-120.xml
MD5SUM76b33169874d58bfc9aedd730e623c3c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark37
Best CPU time to get the best result obtained on this benchmark20056.5
Satisfiable
(Un)Satisfiability was proved
Number of variables3601
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size329
Distribution of domain sizes[{"size":2,"count":3600},{"size":329,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":3600},{"degree":46,"count":1}]
Minimum constraint arity360
Maximum constraint arity3600
Distribution of constraint arities[{"arity":360,"count":10},{"arity":721,"count":45},{"arity":3600,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data 

0.29/0.38	c best=?? lower=0 upper=328

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4240463-1500638209/watcher-4240463-1500638209 -o /tmp/evaluation-result-4240463-1500638209/solver-4240463-1500638209 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1500635808-9681 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4240463-1500638209.xml 

pid=9891
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 2/181 9895
/proc/meminfo: memFree=31457912/32770624 swapFree=6172/402392
[pid=9894] ppid=9891 vsize=27120 CPUtime=0 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 976 0 0 0 0 0 0 0 20 0 1 0 17246786 27770880 806 33554432000 4194304 5970956 140727678813616 140727678810264 139866765863909 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 6780 806 703 434 0 144 0

[startup+0.100115 s]
/proc/loadavg: 2.00 2.01 2.00 2/181 9895
/proc/meminfo: memFree=31457912/32770624 swapFree=6172/402392
[pid=9894] ppid=9891 vsize=30668 CPUtime=0.09 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 1978 0 0 0 9 0 0 0 20 0 1 0 17246786 31404032 1761 33554432000 4194304 5970956 140727678813616 140727678806456 139866766700667 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 7667 1761 801 434 0 1031 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 30668

[startup+0.20027 s]
/proc/loadavg: 2.00 2.01 2.00 2/181 9895
/proc/meminfo: memFree=31457912/32770624 swapFree=6172/402392
[pid=9894] ppid=9891 vsize=33240 CPUtime=0.19 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 2609 0 0 0 19 0 0 0 20 0 1 0 17246786 34037760 2435 33554432000 4194304 5970956 140727678813616 140727678807848 139866765863909 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 8310 2435 801 434 0 1674 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 33240

[startup+0.300221 s]
/proc/loadavg: 2.00 2.01 2.00 2/181 9895
/proc/meminfo: memFree=31457912/32770624 swapFree=6172/402392
[pid=9894] ppid=9891 vsize=36324 CPUtime=0.29 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 3380 0 0 0 29 0 0 0 20 0 1 0 17246786 37195776 3206 33554432000 4194304 5970956 140727678813616 140727678807848 139866765863909 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 9081 3206 801 434 0 2445 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 36324

[startup+0.700164 s]
/proc/loadavg: 2.00 2.01 2.00 2/181 9895
/proc/meminfo: memFree=31457912/32770624 swapFree=6172/402392
[pid=9894] ppid=9891 vsize=47576 CPUtime=0.68 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 6249 0 0 0 68 0 0 0 20 0 1 0 17246786 48717824 6064 33554432000 4194304 5970956 140727678813616 140727678810584 139866765863909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 11894 6064 841 434 0 5258 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 47576

[startup+1.50017 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31429396/32770624 swapFree=6172/402384
[pid=9894] ppid=9891 vsize=52196 CPUtime=1.49 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 7380 0 0 0 148 1 0 0 20 0 1 0 17246786 53448704 7186 33554432000 4194304 5970956 140727678813616 140727678810584 4961400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 13049 7186 841 434 0 6413 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 52196

[startup+3.10016 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31423816/32770624 swapFree=6172/402384
[pid=9894] ppid=9891 vsize=59192 CPUtime=3.09 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 9889 0 0 0 308 1 0 0 20 0 1 0 17246786 60612608 8937 33554432000 4194304 5970956 140727678813616 140727678810584 139866765863909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 14798 8937 841 434 0 8162 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 59192

[startup+6.30016 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31404488/32770624 swapFree=6172/402432
[pid=9894] ppid=9891 vsize=77276 CPUtime=6.29 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 15434 0 0 0 627 2 0 0 20 0 1 0 17246786 79130624 13458 33554432000 4194304 5970956 140727678813616 140727678810584 4964768 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 19319 13458 841 434 0 12683 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 77276

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31368388/32770624 swapFree=6172/402448
[pid=9894] ppid=9891 vsize=109352 CPUtime=12.68 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 24346 0 0 0 1265 3 0 0 20 0 1 0 17246786 111976448 21492 33554432000 4194304 5970956 140727678813616 140727678810584 5070523 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 27338 21492 842 434 0 20702 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 109352

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31298560/32770624 swapFree=6172/402456
[pid=9894] ppid=9891 vsize=177728 CPUtime=25.48 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 42758 0 0 0 2542 6 0 0 20 0 1 0 17246786 181993472 38574 33554432000 4194304 5970956 140727678813616 140727678810584 139866765863909 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 44432 38574 842 434 0 37796 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 177728

[startup+51.1003 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9908
/proc/meminfo: memFree=31205884/32770624 swapFree=6172/402468
[pid=9894] ppid=9891 vsize=269732 CPUtime=51.07 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 108558 0 0 0 5096 11 0 0 20 0 1 0 17246786 276205568 61620 33554432000 4194304 5970956 140727678813616 140727678810584 5098954 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 67433 61620 842 434 0 60797 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 269732

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9910
/proc/meminfo: memFree=31205532/32770624 swapFree=6172/402504
[pid=9894] ppid=9891 vsize=269864 CPUtime=102.27 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 109090 0 0 0 10216 11 0 0 20 0 1 0 17246786 276340736 61621 33554432000 4194304 5970956 140727678813616 140727678810648 4964452 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 67466 61621 843 434 0 60830 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 269864

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/187 9911
/proc/meminfo: memFree=31205256/32770624 swapFree=6172/402516
[pid=9894] ppid=9891 vsize=270128 CPUtime=162.25 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 109278 0 0 0 16214 11 0 0 20 0 1 0 17246786 276611072 61699 33554432000 4194304 5970956 140727678813616 140727678810648 5052093 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 67532 61699 843 434 0 60896 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 270128

[startup+222.306 s]
/proc/loadavg: 2.04 2.03 2.00 3/187 9919
/proc/meminfo: memFree=31204308/32770624 swapFree=6172/402528
[pid=9894] ppid=9891 vsize=270788 CPUtime=222.24 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 109531 0 0 0 22213 11 0 0 20 0 1 0 17246786 277286912 61887 33554432000 4194304 5970956 140727678813616 140727678810504 4908952 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 67697 61887 843 434 0 61061 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 270788

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/187 9942
/proc/meminfo: memFree=31203764/32770624 swapFree=6172/402544
[pid=9894] ppid=9891 vsize=271184 CPUtime=282.22 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 109952 0 0 0 28211 11 0 0 20 0 1 0 17246786 277692416 61943 33554432000 4194304 5970956 140727678813616 140727678810648 4908985 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 67796 61943 843 434 0 61160 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 271184

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/187 9943
/proc/meminfo: memFree=31202888/32770624 swapFree=6172/402556
[pid=9894] ppid=9891 vsize=272372 CPUtime=342.21 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 110317 0 0 0 34210 11 0 0 20 0 1 0 17246786 278908928 62278 33554432000 4194304 5970956 140727678813616 140727678810488 5052085 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 68093 62278 843 434 0 61457 0
Current children cumulated CPU time (s) 342.21
Current children cumulated vsize (KiB) 272372

[startup+402.3 s]
/proc/loadavg: 2.08 2.03 2.01 3/187 9944
/proc/meminfo: memFree=31201872/32770624 swapFree=6172/402576
[pid=9894] ppid=9891 vsize=273440 CPUtime=402.19 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 110661 0 0 0 40208 11 0 0 20 0 1 0 17246786 280002560 62518 33554432000 4194304 5970956 140727678813616 140727678810648 4964452 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 68360 62518 843 434 0 61724 0
Current children cumulated CPU time (s) 402.19
Current children cumulated vsize (KiB) 273440

[startup+462.3 s]
/proc/loadavg: 2.03 2.02 2.01 3/187 9945
/proc/meminfo: memFree=31200104/32770624 swapFree=6172/402592
[pid=9894] ppid=9891 vsize=275296 CPUtime=462.19 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 111195 0 0 0 46207 12 0 0 20 0 1 0 17246786 281903104 62966 33554432000 4194304 5970956 140727678813616 140727678810648 5070435 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 68824 62966 843 434 0 62188 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 275296

[startup+522.3 s]
/proc/loadavg: 2.01 2.02 2.01 3/187 9946
/proc/meminfo: memFree=31197880/32770624 swapFree=6172/402604
[pid=9894] ppid=9891 vsize=277568 CPUtime=522.17 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 111837 0 0 0 52205 12 0 0 20 0 1 0 17246786 284229632 63560 33554432000 4194304 5970956 140727678813616 140727678810488 4964452 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 69392 63560 843 434 0 62756 0
Current children cumulated CPU time (s) 522.17
Current children cumulated vsize (KiB) 277568

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/187 9947
/proc/meminfo: memFree=31195704/32770624 swapFree=6172/402628
[pid=9894] ppid=9891 vsize=279444 CPUtime=582.16 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 112389 0 0 0 58204 12 0 0 20 0 1 0 17246786 286150656 64011 33554432000 4194304 5970956 140727678813616 140727678810648 4908988 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 69861 64011 843 434 0 63225 0
Current children cumulated CPU time (s) 582.16
Current children cumulated vsize (KiB) 279444


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.06 2.04 2.04 3/188 9980
/proc/meminfo: memFree=31175308/32770624 swapFree=6172/402944
[pid=9894] ppid=9891 vsize=298840 CPUtime=1481.98 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118410 0 0 0 148185 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4964452 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1481.98
Current children cumulated vsize (KiB) 298840

[startup+1542.31 s]
/proc/loadavg: 2.02 2.03 2.04 3/188 9981
/proc/meminfo: memFree=31175680/32770624 swapFree=6172/402964
[pid=9894] ppid=9891 vsize=298840 CPUtime=1541.97 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118486 0 0 0 154184 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4964768 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1541.97
Current children cumulated vsize (KiB) 298840

[startup+1602.3 s]
/proc/loadavg: 2.01 2.03 2.04 3/188 9982
/proc/meminfo: memFree=31175556/32770624 swapFree=6172/402988
[pid=9894] ppid=9891 vsize=298840 CPUtime=1601.96 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118563 0 0 0 160183 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5052085 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1601.96
Current children cumulated vsize (KiB) 298840

[startup+1662.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/187 9983
/proc/meminfo: memFree=31176960/32770624 swapFree=6172/403012
[pid=9894] ppid=9891 vsize=298840 CPUtime=1661.94 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118640 0 0 0 166181 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5069728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1661.94
Current children cumulated vsize (KiB) 298840

[startup+1722.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/187 9986
/proc/meminfo: memFree=31176092/32770624 swapFree=6172/403036
[pid=9894] ppid=9891 vsize=298840 CPUtime=1721.93 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118718 0 0 0 172180 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5069728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1721.93
Current children cumulated vsize (KiB) 298840

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 9987
/proc/meminfo: memFree=31175720/32770624 swapFree=6172/403056
[pid=9894] ppid=9891 vsize=298840 CPUtime=1781.92 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118796 0 0 0 178179 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4908985 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1781.92
Current children cumulated vsize (KiB) 298840

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 9988
/proc/meminfo: memFree=31175952/32770624 swapFree=6172/403076
[pid=9894] ppid=9891 vsize=298840 CPUtime=1841.91 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118874 0 0 0 184178 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4961400 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1841.91
Current children cumulated vsize (KiB) 298840

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 9990
/proc/meminfo: memFree=31175600/32770624 swapFree=6172/403092
[pid=9894] ppid=9891 vsize=298840 CPUtime=1901.9 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 118952 0 0 0 190177 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5098954 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1901.9
Current children cumulated vsize (KiB) 298840

[startup+1962.3 s]
/proc/loadavg: 2.05 2.03 2.04 3/187 9991
/proc/meminfo: memFree=31175972/32770624 swapFree=6172/403116
[pid=9894] ppid=9891 vsize=298840 CPUtime=1961.88 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119030 0 0 0 196175 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5069735 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 1961.88
Current children cumulated vsize (KiB) 298840

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 2.04 3/187 9999
/proc/meminfo: memFree=31175876/32770624 swapFree=6172/403136
[pid=9894] ppid=9891 vsize=298840 CPUtime=2021.87 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119108 0 0 0 202174 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4964777 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2021.87
Current children cumulated vsize (KiB) 298840

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.04 3/187 10000
/proc/meminfo: memFree=31176000/32770624 swapFree=6172/403156
[pid=9894] ppid=9891 vsize=298840 CPUtime=2081.86 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119186 0 0 0 208173 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4964777 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2081.86
Current children cumulated vsize (KiB) 298840

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 10001
/proc/meminfo: memFree=31176248/32770624 swapFree=6172/403172
[pid=9894] ppid=9891 vsize=298840 CPUtime=2141.85 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119264 0 0 0 214172 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5052093 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2141.85
Current children cumulated vsize (KiB) 298840

[startup+2202.31 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 10002
/proc/meminfo: memFree=31176056/32770624 swapFree=6172/403192
[pid=9894] ppid=9891 vsize=298840 CPUtime=2201.84 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119342 0 0 0 220171 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5098954 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2201.84
Current children cumulated vsize (KiB) 298840

[startup+2262.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 10003
/proc/meminfo: memFree=31176304/32770624 swapFree=6172/403212
[pid=9894] ppid=9891 vsize=298840 CPUtime=2261.82 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119419 0 0 0 226169 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 4964777 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2261.82
Current children cumulated vsize (KiB) 298840

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 10004
/proc/meminfo: memFree=31176180/32770624 swapFree=6172/403232
[pid=9894] ppid=9891 vsize=298840 CPUtime=2321.81 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119498 0 0 0 232168 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5098948 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2321.81
Current children cumulated vsize (KiB) 298840

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10005
/proc/meminfo: memFree=31175932/32770624 swapFree=6172/403260
[pid=9894] ppid=9891 vsize=298840 CPUtime=2381.8 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119576 0 0 0 238167 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5098954 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2381.8
Current children cumulated vsize (KiB) 298840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.6 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 10005
/proc/meminfo: memFree=31176180/32770624 swapFree=6172/403264
[pid=9894] ppid=9891 vsize=298840 CPUtime=2400.09 cores=1,3,5,7
/proc/9894/stat : 9894 (cosoco) R 9891 9894 6087 0 -1 4202496 119629 0 0 0 239996 13 0 0 20 0 1 0 17246786 306012160 68884 33554432000 4194304 5970956 140727678813616 140727678810504 5098954 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 28815360 140727678817473 140727678817603 140727678817603 140727678820302 0
/proc/9894/statm: 74710 68884 843 434 0 68074 0
Current children cumulated CPU time (s) 2400.09
Current children cumulated vsize (KiB) 298840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 9894 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.6
CPU time (s): 2400.11
CPU user time (s): 2399.97
CPU system time (s): 0.135972
CPU usage (%): 99.9793
Max. virtual memory (cumulated for all children) (KiB): 298840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.97
system time used= 0.135972
maximum resident set size= 275580
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 119657
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25
involuntary context switches= 120771

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.83317 second user time and 9.48935 second system time

The end

Launcher Data 

Begin job on node150 at 2017-07-21 13:56:49
IDJOB=4240463
IDBENCH=122969
IDSOLVER=2620
FILE ID=node150/4240463-1500638209
RUNJOBID= node150-1500635808-9681
PBS_JOBID= 20622986
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-10-360-120.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4240463-1500638209/watcher-4240463-1500638209 -o /tmp/evaluation-result-4240463-1500638209/solver-4240463-1500638209 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1500635808-9681 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4240463-1500638209.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 76b33169874d58bfc9aedd730e623c3c
RANDOM SEED=418046161

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.01
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31458176 kB
MemAvailable:   32004748 kB
Buffers:          235604 kB
Cached:           598216 kB
SwapCached:            0 kB
Active:           469052 kB
Inactive:         419444 kB
Active(anon):      57648 kB
Inactive(anon):    17052 kB
Active(file):     411404 kB
Inactive(file):   402392 kB
Unevictable:        6172 kB
Mlocked:            6180 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2400 kB
Writeback:             0 kB
AnonPages:         60532 kB
Mapped:            32524 kB
Shmem:             17040 kB
Slab:             122792 kB
SReclaimable:      97220 kB
SUnreclaim:        25572 kB
KernelStack:        3776 kB
PageTables:         4232 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     317220 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 62028 MiB
End job on node150 at 2017-07-21 14:36:50