Trace number 3707097

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2012-05-17? (TO) 1800.05 1800.41

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j60opt/
normalized-j6013_4.std.opb
MD5SUMda670fe6dfaf44f990525edb598421e7
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark106
Best CPU time to get the best result obtained on this benchmark1800.05
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables36722
Total number of constraints117773
Number of constraints which are clauses116573
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint60
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

2.38/2.46	c 2012-05-27T20:34:34+0200
2.38/2.46	c arch = x86_64
2.38/2.46	c os = linux
2.38/2.46	c compiler = ghc 7.4
2.38/2.46	c packages:
2.38/2.46	c   OptDir-0.0.1
2.38/2.46	c   array-0.4.0.0
2.38/2.46	c   base-4.5.0.0
2.38/2.46	c   bytestring-0.9.2.1
2.38/2.46	c   containers-0.4.2.1
2.38/2.46	c   deepseq-1.3.0.0
2.38/2.46	c   mtl-2.1.1
2.38/2.46	c   old_locale-1.0.0.4
2.38/2.46	c   parse_dimacs-1.2
2.38/2.46	c   parsec-3.1.2
2.38/2.46	c   queue-0.1.2
2.38/2.46	c   stm-2.3
2.38/2.46	c   time-1.4
2.38/2.46	c command line = ["--pb","HOME/instance-3707097-1338143674.opb"]
2.38/2.46	c #vars 36722
2.38/2.46	c #constraints 117773
2.38/2.46	c Solving starts ...
3.59/3.60	c solving time = 1.127s
3.59/3.60	c #decision = 1380
3.59/3.60	c #conflict = 485
3.59/3.60	c #restart = 3
3.59/3.60	o 115
3.59/3.65	c Solving starts ...
3.69/3.76	c solving time = 0.097s
3.69/3.76	c #decision = 1544
3.69/3.76	c #conflict = 514
3.69/3.76	c #restart = 3
3.69/3.76	o 114
3.69/3.76	c Solving starts ...
3.79/3.83	c solving time = 0.064s
3.79/3.83	c #decision = 1661
3.79/3.83	c #conflict = 528
3.79/3.83	c #restart = 3
3.79/3.83	o 113
3.79/3.83	c Solving starts ...
3.79/3.88	c solving time = 0.033s
3.79/3.88	c #decision = 1770
3.79/3.88	c #conflict = 532
3.79/3.88	c #restart = 3
3.79/3.88	o 112
3.79/3.88	c Solving starts ...
3.89/3.91	c solving time = 0.027s
3.89/3.91	c #decision = 1854
3.89/3.91	c #conflict = 532
3.89/3.91	c #restart = 3
3.89/3.91	o 111
3.89/3.91	c Solving starts ...
4.50/4.51	c solving time = 0.594s
4.50/4.51	c #decision = 2404
4.50/4.51	c #conflict = 697
4.50/4.51	c #restart = 4
4.50/4.51	o 110
4.50/4.51	c Solving starts ...
43.58/43.64	c solving time = 39.110s
43.58/43.64	c #decision = 21299
43.58/43.64	c #conflict = 12696
43.58/43.64	c #restart = 14
43.58/43.64	o 109
43.58/43.64	c Solving starts ...
166.96/167.06	c solving time = 123.402s
166.96/167.06	c #decision = 72877
166.96/167.06	c #conflict = 52259
166.96/167.06	c #restart = 27
166.96/167.06	o 108
166.96/167.06	c Solving starts ...
178.86/178.92	c solving time = 11.846s
178.86/178.92	c #decision = 77319
178.86/178.92	c #conflict = 55312
178.86/178.92	c #restart = 33
178.86/178.92	o 107
178.86/178.92	c Solving starts ...
1326.10/1326.48	c learnt constraints deletion: 248334 -> 124169

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707097-1338143674/watcher-3707097-1338143674 -o /tmp/evaluation-result-3707097-1338143674/solver-3707097-1338143674 -C 1800 -W 1900 -M 15500 HOME/toysat --pb HOME/instance-3707097-1338143674.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 12341
/proc/meminfo: memFree=30250272/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=7232 CPUtime=0 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 829 0 0 0 0 0 0 0 20 0 1 0 280493422 7405568 750 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 1808 750 415 1167 0 589 0

[startup+0.0366889 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 12341
/proc/meminfo: memFree=30250272/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=8256 CPUtime=0.03 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 1297 0 0 0 3 0 0 0 20 0 1 0 280493422 8454144 1218 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 2064 1223 418 1167 0 845 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8256

[startup+0.100219 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 12341
/proc/meminfo: memFree=30250272/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=12352 CPUtime=0.09 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 2355 0 0 0 9 0 0 0 20 0 1 0 280493422 12648448 2276 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 3088 2276 418 1167 0 1869 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12352

[startup+0.300221 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 12341
/proc/meminfo: memFree=30250272/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=26688 CPUtime=0.29 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 5939 0 0 0 28 1 0 0 20 0 1 0 280493422 27328512 5860 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 6672 5860 418 1167 0 5453 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26688

[startup+0.700118 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 12341
/proc/meminfo: memFree=30250272/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=57408 CPUtime=0.69 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 13494 0 0 0 66 3 0 0 20 0 1 0 280493422 58785792 13416 33554432000 4194304 8973514 140733309246512 140733309245776 4212523 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 14352 13422 418 1167 0 13133 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 57408

[startup+1.50024 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 12342
/proc/meminfo: memFree=30179328/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=100416 CPUtime=1.48 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 24371 0 0 0 143 5 0 0 20 0 1 0 280493422 102825984 24292 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 25104 24292 418 1167 0 23885 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 100416

[startup+3.10024 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 12342
/proc/meminfo: memFree=30091776/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=173120 CPUtime=3.09 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 42580 0 0 0 301 8 0 0 20 0 1 0 280493422 177274880 42501 33554432000 4194304 8973514 140733309246512 140733309229608 7841851 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 43280 42501 445 1167 0 42061 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 173120

[startup+6.30019 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 12342
/proc/meminfo: memFree=30080696/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=173120 CPUtime=6.29 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 42591 0 0 0 619 10 0 0 20 0 1 0 280493422 177274880 42512 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 43280 42512 456 1167 0 42061 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 173120

[startup+12.7003 s]
/proc/loadavg: 2.12 2.03 2.01 3/177 12342
/proc/meminfo: memFree=30075652/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=178240 CPUtime=12.69 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 43871 0 0 0 1257 12 0 0 20 0 1 0 280493422 182517760 43792 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 44560 43792 456 1167 0 43341 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 178240

[startup+25.5004 s]
/proc/loadavg: 2.10 2.03 2.01 3/177 12342
/proc/meminfo: memFree=30060976/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=188480 CPUtime=25.49 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 46431 0 0 0 2532 17 0 0 20 0 1 0 280493422 193003520 46352 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 47120 46352 456 1167 0 45901 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 188480

[startup+51.1002 s]
/proc/loadavg: 2.13 2.04 2.01 3/177 12342
/proc/meminfo: memFree=30035440/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=207936 CPUtime=51.08 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 51295 0 0 0 5082 26 0 0 20 0 1 0 280493422 212926464 51216 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 51984 51216 456 1167 0 50765 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 207936

[startup+102.3 s]
/proc/loadavg: 2.09 2.05 2.01 3/177 12343
/proc/meminfo: memFree=29984352/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=248896 CPUtime=102.28 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 61535 0 0 0 10180 48 0 0 20 0 1 0 280493422 254869504 61456 33554432000 4194304 8973514 140733309246512 140733309246008 7841851 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 62224 61456 456 1167 0 61005 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 248896

[startup+162.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/177 12343
/proc/meminfo: memFree=29933760/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=283712 CPUtime=162.27 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 70239 0 0 0 16159 68 0 0 20 0 1 0 280493422 290521088 70160 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 70928 70160 456 1167 0 69709 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 283712

[startup+222.307 s]
/proc/loadavg: 2.01 2.03 2.00 3/177 12343
/proc/meminfo: memFree=29885280/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=320576 CPUtime=222.26 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 79455 0 0 0 22136 90 0 0 20 0 1 0 280493422 328269824 79376 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 80144 79376 456 1167 0 78925 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 320576

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 12343
/proc/meminfo: memFree=29834872/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=356416 CPUtime=282.24 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 88415 0 0 0 28116 108 0 0 20 0 1 0 280493422 364969984 88336 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 89104 88336 456 1167 0 87885 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 356416

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/178 12346
/proc/meminfo: memFree=29784472/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=391232 CPUtime=342.23 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 97130 0 0 0 34095 128 0 0 20 0 1 0 280493422 400621568 97045 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 97808 97045 456 1167 0 96589 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 391232

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 12347
/proc/meminfo: memFree=29739124/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=421952 CPUtime=402.22 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 104826 0 0 0 40077 145 0 0 20 0 1 0 280493422 432078848 104725 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 105488 104725 456 1167 0 104269 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 421952

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12347
/proc/meminfo: memFree=29703068/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=445504 CPUtime=462.19 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 110728 0 0 0 46059 160 0 0 20 0 1 0 280493422 456196096 110613 33554432000 4194304 8973514 140733309246512 140733309245776 4209198 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 111376 110613 456 1167 0 110157 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 445504

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12424
/proc/meminfo: memFree=29998772/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=468032 CPUtime=522.16 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 116388 0 0 0 52042 174 0 0 20 0 1 0 280493422 479264768 116245 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 117008 116245 456 1167 0 115789 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 468032

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12424
/proc/meminfo: memFree=29938908/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=489536 CPUtime=582.14 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 121779 0 0 0 58028 186 0 0 20 0 1 0 280493422 501284864 121621 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 122384 121621 456 1167 0 121165 0
Current children cumulated CPU time (s) 582.14
Current children cumulated vsize (KiB) 489536

[startup+642.3 s]

################
# More data... #
################

[startup+882.307 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12425
/proc/meminfo: memFree=29665804/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=601152 CPUtime=882.1 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 149689 0 0 0 87953 257 0 0 20 0 1 0 280493422 615579648 149525 33554432000 4194304 8973514 140733309246512 140733309228480 6842815 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 150288 149525 456 1167 0 149069 0
Current children cumulated CPU time (s) 882.1
Current children cumulated vsize (KiB) 601152

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12428
/proc/meminfo: memFree=29609868/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=625728 CPUtime=942.08 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 155833 0 0 0 93938 270 0 0 20 0 1 0 280493422 640745472 155669 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 156432 155669 456 1167 0 155213 0
Current children cumulated CPU time (s) 942.08
Current children cumulated vsize (KiB) 625728

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12429
/proc/meminfo: memFree=29560648/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=646208 CPUtime=1002.07 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 160953 0 0 0 99922 285 0 0 20 0 1 0 280493422 661716992 160789 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 161552 160789 456 1167 0 160333 0
Current children cumulated CPU time (s) 1002.07
Current children cumulated vsize (KiB) 646208

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12429
/proc/meminfo: memFree=29510676/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=667712 CPUtime=1062.06 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 166329 0 0 0 105908 298 0 0 20 0 1 0 280493422 683737088 166165 33554432000 4194304 8973514 140733309246512 140733309246008 4427236 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 166928 166165 456 1167 0 165709 0
Current children cumulated CPU time (s) 1062.06
Current children cumulated vsize (KiB) 667712

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12429
/proc/meminfo: memFree=29463808/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=688192 CPUtime=1122.05 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 171449 0 0 0 111894 311 0 0 20 0 1 0 280493422 704708608 171285 33554432000 4194304 8973514 140733309246512 140733309228480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 172048 171285 456 1167 0 170829 0
Current children cumulated CPU time (s) 1122.05
Current children cumulated vsize (KiB) 688192

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12429
/proc/meminfo: memFree=29419416/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=708672 CPUtime=1182.04 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 176569 0 0 0 117882 322 0 0 20 0 1 0 280493422 725680128 176405 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 177168 176405 456 1167 0 175949 0
Current children cumulated CPU time (s) 1182.04
Current children cumulated vsize (KiB) 708672

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12429
/proc/meminfo: memFree=29380768/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=728128 CPUtime=1242.02 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 181454 0 0 0 123870 332 0 0 20 0 1 0 280493422 745603072 181269 33554432000 4194304 8973514 140733309246512 140733309228480 7841851 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 182032 181269 456 1167 0 180813 0
Current children cumulated CPU time (s) 1242.02
Current children cumulated vsize (KiB) 728128

[startup+1302.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12430
/proc/meminfo: memFree=29341860/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=748608 CPUtime=1302.01 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 186578 0 0 0 129854 347 0 0 20 0 1 0 280493422 766574592 186389 33554432000 4194304 8973514 140733309246512 140733309244480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 187152 186389 456 1167 0 185933 0
Current children cumulated CPU time (s) 1302.01
Current children cumulated vsize (KiB) 748608

[startup+1362.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12430
/proc/meminfo: memFree=29253972/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1362 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 135838 362 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309245776 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1362
Current children cumulated vsize (KiB) 805952

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12430
/proc/meminfo: memFree=29224996/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1421.99 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 141820 379 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309246008 4213376 0 2 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1421.99
Current children cumulated vsize (KiB) 805952

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12430
/proc/meminfo: memFree=29200444/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1481.98 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 147801 397 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309244480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1481.98
Current children cumulated vsize (KiB) 805952

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12433
/proc/meminfo: memFree=29178000/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1541.98 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 153788 410 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309244480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1541.98
Current children cumulated vsize (KiB) 805952

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12457
/proc/meminfo: memFree=29152880/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1601.96 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 159775 421 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309228480 4427236 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1601.96
Current children cumulated vsize (KiB) 805952

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12457
/proc/meminfo: memFree=29134420/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1661.95 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 165762 433 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309228480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1661.95
Current children cumulated vsize (KiB) 805952

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12457
/proc/meminfo: memFree=29113492/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=805952 CPUtime=1721.94 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 200915 0 0 0 171749 445 0 0 20 0 1 0 280493422 825294848 200726 33554432000 4194304 8973514 140733309246512 140733309244480 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201488 200726 457 1167 0 200269 0
Current children cumulated CPU time (s) 1721.94
Current children cumulated vsize (KiB) 805952

[startup+1782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12457
/proc/meminfo: memFree=29091820/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=806976 CPUtime=1781.93 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 201171 0 0 0 177739 454 0 0 20 0 1 0 280493422 826343424 200982 33554432000 4194304 8973514 140733309246512 140733309246008 7937344 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 201744 200982 457 1167 0 200525 0
Current children cumulated CPU time (s) 1781.93
Current children cumulated vsize (KiB) 806976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12457
/proc/meminfo: memFree=29077776/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=814144 CPUtime=1800.04 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 202963 0 0 0 179546 458 0 0 20 0 1 0 280493422 833683456 202774 33554432000 4194304 8973514 140733309246512 140733309244480 7400245 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 203536 202774 457 1167 0 202317 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 814144

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12457
/proc/meminfo: memFree=29077776/32873648 swapFree=6860/6860
[pid=12341] ppid=12339 vsize=814144 CPUtime=1800.04 cores=1,3,5,7
/proc/12341/stat : 12341 (toysat) R 12339 12341 9979 0 -1 4202496 202963 0 0 0 179546 458 0 0 20 0 1 0 280493422 833683456 202774 33554432000 4194304 8973514 140733309246512 140733309244480 7400245 0 0 0 34082818 0 0 0 17 5 0 0 0 0 0
/proc/12341/statm: 203536 202774 457 1167 0 202317 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 814144

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.41
CPU time (s): 1800.05
CPU user time (s): 1795.46
CPU system time (s): 4.5893
CPU usage (%): 99.9801
Max. virtual memory (cumulated for all children) (KiB): 814144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.46
system time used= 4.5893
maximum resident set size= 811096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 202963
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 118
involuntary context switches= 1845

runsolver used 3.2515 second user time and 9.71352 second system time

The end

Launcher Data 

Begin job on node116 at 2012-05-27 20:34:34
IDJOB=3707097
IDBENCH=76987
IDSOLVER=2285
FILE ID=node116/3707097-1338143674
RUNJOBID= node116-1338124087-9996
PBS_JOBID= 14624506
Free space on /tmp= 71456 MiB

SOLVER NAME= toysat 2012-05-17
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j60opt/normalized-j6013_4.std.opb
COMMAND LINE= HOME/toysat --pb BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707097-1338143674/watcher-3707097-1338143674 -o /tmp/evaluation-result-3707097-1338143674/solver-3707097-1338143674 -C 1800 -W 1900 -M 15500  HOME/toysat --pb HOME/instance-3707097-1338143674.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= da670fe6dfaf44f990525edb598421e7
RANDOM SEED=1360239586

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30250288 kB
Buffers:          361128 kB
Cached:           932540 kB
SwapCached:         3240 kB
Active:          1270720 kB
Inactive:         514232 kB
Active(anon):     481828 kB
Inactive(anon):     8960 kB
Active(file):     788892 kB
Inactive(file):   505272 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67103664 kB
Dirty:             11128 kB
Writeback:             0 kB
AnonPages:        492456 kB
Mapped:            14460 kB
Shmem:                96 kB
Slab:             700364 kB
SReclaimable:     143988 kB
SUnreclaim:       556376 kB
KernelStack:        1456 kB
PageTables:         4444 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     602900 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    442368 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71448 MiB
End job on node116 at 2012-05-27 21:04:36