Trace number 3371390

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 252.257 66.7045

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-27-step13.cnf
MD5SUM52e16341bcff805ef2d6abe4e95359a0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark30.0214
Satisfiable
(Un)Satisfiability was proved
Number of variables224228
Number of clauses5314673
Sum of the clauses size11732345
Maximum clause length3193
Minimum clause length1
Number of clauses of size 1556
Number of clauses of size 25229536
Number of clauses of size 36084
Number of clauses of size 49856
Number of clauses of size 58159
Number of clauses of size over 560482

Solver Data 

252.24/66.70	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371390-1305422070/watcher-3371390-1305422070 -o /tmp/evaluation-result-3371390-1305422070/solver-3371390-1305422070 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371390-1305422070.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.88 7.39 7.70 5/321 9999
/proc/meminfo: memFree=10542968/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=20588 CPUtime=0 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 3218 1254 0 0 0 0 0 0 22 0 1 0 653809655 21082112 3148 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436074922 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 6043 3154 147 55 0 3929 0

[startup+0.0665981 s]
/proc/loadavg: 6.88 7.39 7.70 5/321 9999
/proc/meminfo: memFree=10542968/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=35748 CPUtime=0.05 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 7062 1254 0 0 5 0 0 0 22 0 1 0 653809655 36605952 6928 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 8937 6928 148 55 0 6823 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 35748

[startup+0.100601 s]
/proc/loadavg: 6.88 7.39 7.70 5/321 9999
/proc/meminfo: memFree=10542968/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=43444 CPUtime=0.09 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 9018 1254 0 0 8 1 0 0 22 0 1 0 653809655 44486656 8884 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 10861 8884 148 55 0 8747 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 43444

[startup+0.300552 s]
/proc/loadavg: 6.88 7.39 7.70 5/321 9999
/proc/meminfo: memFree=10542968/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=67388 CPUtime=0.29 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 15026 1254 0 0 27 2 0 0 23 0 1 0 653809655 69005312 14871 33554432000 4194304 4417452 140733692673168 18446744073709551615 4231248 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 16847 14871 149 55 0 14733 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 67388

[startup+0.700471 s]
/proc/loadavg: 6.88 7.39 7.70 5/321 9999
/proc/meminfo: memFree=10542968/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=152096 CPUtime=0.68 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 36213 1254 0 0 64 4 0 0 25 0 1 0 653809655 155746304 36048 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 38024 36048 149 55 0 35910 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 152096

[startup+1.50032 s]
/proc/loadavg: 6.88 7.39 7.70 6/322 10005
/proc/meminfo: memFree=10354948/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=184864 CPUtime=1.49 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 44405 1254 0 0 143 6 0 0 25 0 1 0 653809655 189300736 44240 33554432000 4194304 4417452 140733692673168 18446744073709551615 4259612 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 46216 44240 149 55 0 44102 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 184864

[startup+3.10102 s]
/proc/loadavg: 6.88 7.39 7.70 6/322 10005
/proc/meminfo: memFree=10274224/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=381472 CPUtime=3.09 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 93557 1254 0 0 296 13 0 0 25 0 1 0 653809655 390627328 93392 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/9999/statm: 95368 93392 149 55 0 93254 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 381472

[startup+6.30038 s]
/proc/loadavg: 6.73 7.35 7.69 9/326 10009
/proc/meminfo: memFree=10112916/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=564768 CPUtime=11.35 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 117804 1254 0 0 1117 18 0 0 25 0 5 0 653809655 578322432 97788 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 141192 97788 172 55 0 139078 0
[pid=9999/tid=10006] ppid=9997 vsize=564768 CPUtime=1.68 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 6155 1254 0 0 168 0 0 0 25 0 5 0 653810116 578322432 97788 33554432000 4194304 4417452 140733692673168 18446744073709551615 4291090 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=564768 CPUtime=1.67 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 6175 1254 0 0 167 0 0 0 25 0 5 0 653810116 578322432 97788 33554432000 4194304 4417452 140733692673168 18446744073709551615 4291024 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=564768 CPUtime=1.68 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 6157 1254 0 0 167 1 0 0 25 0 5 0 653810116 578322432 97788 33554432000 4194304 4417452 140733692673168 18446744073709551615 4290963 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=564768 CPUtime=1.67 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 5748 1254 0 0 166 1 0 0 25 0 5 0 653810116 578322432 97788 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.35
Current children cumulated vsize (KiB) 564768

[startup+12.7012 s]
/proc/loadavg: 6.83 7.36 7.69 9/326 10009
/proc/meminfo: memFree=10109416/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=560308 CPUtime=36.86 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 232977 1254 0 0 3646 40 0 0 25 0 5 0 653809655 573755392 99216 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 140077 99216 179 55 0 137963 0
[pid=9999/tid=10006] ppid=9997 vsize=560308 CPUtime=8.07 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 42279 1254 0 0 799 8 0 0 25 0 5 0 653810116 573755392 99216 33554432000 4194304 4417452 140733692673168 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=560308 CPUtime=8.07 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 42988 1254 0 0 800 7 0 0 25 0 5 0 653810116 573755392 99216 33554432000 4194304 4417452 140733692673168 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=560308 CPUtime=8.08 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 47709 1254 0 0 800 8 0 0 25 0 5 0 653810116 573755392 99216 33554432000 4194304 4417452 140733692673168 18446744073709551615 4254425 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=560308 CPUtime=8 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 6432 1254 0 0 799 1 0 0 25 0 5 0 653810116 573755392 99216 33554432000 4194304 4417452 140733692673168 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36.86
Current children cumulated vsize (KiB) 560308

[startup+25.5007 s]
/proc/loadavg: 6.87 7.34 7.68 9/326 10046
/proc/meminfo: memFree=10262664/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=593608 CPUtime=87.93 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 244194 1254 0 0 8751 42 0 0 25 0 5 0 653809655 607854592 109229 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 148402 109229 180 55 0 146288 0
[pid=9999/tid=10006] ppid=9997 vsize=593608 CPUtime=20.87 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 42283 1254 0 0 2079 8 0 0 25 0 5 0 653810116 607854592 109229 33554432000 4194304 4417452 140733692673168 18446744073709551615 4253385 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=593608 CPUtime=20.87 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 42991 1254 0 0 2080 7 0 0 25 0 5 0 653810116 607854592 109229 33554432000 4194304 4417452 140733692673168 18446744073709551615 4272996 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=593608 CPUtime=20.88 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 50594 1254 0 0 2080 8 0 0 25 0 5 0 653810116 607854592 109229 33554432000 4194304 4417452 140733692673168 18446744073709551615 4258587 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=593608 CPUtime=20.67 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 14757 1254 0 0 2065 2 0 0 25 0 5 0 653810116 607854592 109229 33554432000 4194304 4417452 140733692673168 18446744073709551615 4237148 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 87.93
Current children cumulated vsize (KiB) 593608

[startup+51.1009 s]
/proc/loadavg: 7.33 7.41 7.69 9/326 10047
/proc/meminfo: memFree=10107136/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=612952 CPUtime=190.08 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 258730 1254 0 0 18964 44 0 0 25 0 5 0 653809655 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 153238 114271 180 55 0 151124 0
[pid=9999/tid=10006] ppid=9997 vsize=612952 CPUtime=46.47 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 43567 1254 0 0 4639 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=612952 CPUtime=46.47 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 4639 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=612952 CPUtime=46.48 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 53336 1254 0 0 4639 9 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4250747 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=612952 CPUtime=46.02 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 22448 1254 0 0 4599 3 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4251081 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 190.08
Current children cumulated vsize (KiB) 612952

Solver just ended. Dumping a history of the last processes samples

[startup+51.2009 s]
/proc/loadavg: 7.33 7.41 7.69 9/326 10047
/proc/meminfo: memFree=10107136/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=612952 CPUtime=190.48 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 258730 1254 0 0 19004 44 0 0 25 0 5 0 653809655 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 153238 114271 180 55 0 151124 0
[pid=9999/tid=10006] ppid=9997 vsize=612952 CPUtime=46.57 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 43567 1254 0 0 4649 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=612952 CPUtime=46.57 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 4649 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=612952 CPUtime=46.58 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 53336 1254 0 0 4649 9 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4365106 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=612952 CPUtime=46.12 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 22448 1254 0 0 4609 3 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 190.48
Current children cumulated vsize (KiB) 612952

[startup+57.6006 s]
/proc/loadavg: 7.39 7.42 7.69 9/326 10047
/proc/meminfo: memFree=10081244/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=612952 CPUtime=216.02 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 258730 1254 0 0 21558 44 0 0 25 0 5 0 653809655 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 153238 114271 180 55 0 151124 0
[pid=9999/tid=10006] ppid=9997 vsize=612952 CPUtime=52.97 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 43567 1254 0 0 5289 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=612952 CPUtime=52.97 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 5289 8 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=612952 CPUtime=52.98 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 53336 1254 0 0 5289 9 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=612952 CPUtime=52.45 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 22448 1254 0 0 5242 3 0 0 25 0 5 0 653810116 627662848 114271 33554432000 4194304 4417452 140733692673168 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 216.02
Current children cumulated vsize (KiB) 612952

[startup+60.801 s]
/proc/loadavg: 7.51 7.44 7.70 9/326 10047
/proc/meminfo: memFree=9970140/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=616936 CPUtime=228.78 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 259726 1254 0 0 22834 44 0 0 25 0 5 0 653809655 631742464 115267 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 154234 115267 180 55 0 152120 0
[pid=9999/tid=10006] ppid=9997 vsize=616936 CPUtime=56.17 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 43567 1254 0 0 5609 8 0 0 25 0 5 0 653810116 631742464 115267 33554432000 4194304 4417452 140733692673168 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=616936 CPUtime=56.17 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 5609 8 0 0 25 0 5 0 653810116 631742464 115267 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=616936 CPUtime=56.18 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 53336 1254 0 0 5609 9 0 0 25 0 5 0 653810116 631742464 115267 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=616936 CPUtime=55.62 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 23444 1254 0 0 5559 3 0 0 25 0 5 0 653810116 631742464 115267 33554432000 4194304 4417452 140733692673168 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 228.78
Current children cumulated vsize (KiB) 616936

[startup+64.0004 s]
/proc/loadavg: 7.55 7.45 7.70 10/326 10047
/proc/meminfo: memFree=10098236/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=630436 CPUtime=241.54 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 263128 1254 0 0 24110 44 0 0 25 0 5 0 653809655 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 157609 118642 180 55 0 155495 0
[pid=9999/tid=10006] ppid=9997 vsize=630436 CPUtime=59.37 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 44334 1254 0 0 5929 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=630436 CPUtime=59.37 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 5929 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=630436 CPUtime=59.38 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 54516 1254 0 0 5929 9 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4357087 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=630436 CPUtime=58.79 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 24899 1254 0 0 5875 4 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 241.54
Current children cumulated vsize (KiB) 630436

[startup+65.6011 s]
/proc/loadavg: 7.55 7.45 7.70 9/326 10047
/proc/meminfo: memFree=10097244/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=630436 CPUtime=247.93 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 263128 1254 0 0 24749 44 0 0 25 0 5 0 653809655 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 157609 118642 180 55 0 155495 0
[pid=9999/tid=10006] ppid=9997 vsize=630436 CPUtime=60.97 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 44334 1254 0 0 6089 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=630436 CPUtime=60.97 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 6089 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4366523 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=630436 CPUtime=60.98 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 54516 1254 0 0 6089 9 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=630436 CPUtime=60.38 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 24899 1254 0 0 6034 4 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 247.93
Current children cumulated vsize (KiB) 630436

[startup+66.401 s]
/proc/loadavg: 7.55 7.45 7.70 9/326 10047
/proc/meminfo: memFree=10105428/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=630436 CPUtime=251.12 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 263128 1254 0 0 25068 44 0 0 25 0 5 0 653809655 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 157609 118642 180 55 0 155495 0
[pid=9999/tid=10006] ppid=9997 vsize=630436 CPUtime=61.77 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 44334 1254 0 0 6169 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=630436 CPUtime=61.77 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 6169 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=630436 CPUtime=61.78 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 54516 1254 0 0 6169 9 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=630436 CPUtime=61.17 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 24899 1254 0 0 6113 4 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 251.12
Current children cumulated vsize (KiB) 630436

[startup+66.6009 s]
/proc/loadavg: 7.55 7.45 7.70 9/326 10047
/proc/meminfo: memFree=10105428/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=630436 CPUtime=251.92 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) S 9997 9999 8860 0 -1 4202496 263128 1254 0 0 25148 44 0 0 25 0 5 0 653809655 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9999/statm: 157609 118642 180 55 0 155495 0
[pid=9999/tid=10006] ppid=9997 vsize=630436 CPUtime=61.97 cores=1,3,5,7
/proc/9999/task/10006/stat : 10006 (plingeling) R 9997 9999 8860 0 -1 4202560 44334 1254 0 0 6189 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9999/tid=10007] ppid=9997 vsize=630436 CPUtime=61.97 cores=1,3,5,7
/proc/9999/task/10007/stat : 10007 (plingeling) R 9997 9999 8860 0 -1 4202560 45810 1254 0 0 6189 8 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9999/tid=10008] ppid=9997 vsize=630436 CPUtime=61.98 cores=1,3,5,7
/proc/9999/task/10008/stat : 10008 (plingeling) R 9997 9999 8860 0 -1 4202560 54516 1254 0 0 6189 9 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4358022 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9999/tid=10009] ppid=9997 vsize=630436 CPUtime=61.37 cores=1,3,5,7
/proc/9999/task/10009/stat : 10009 (plingeling) R 9997 9999 8860 0 -1 4202560 24899 1254 0 0 6133 4 0 0 25 0 5 0 653810116 645566464 118642 33554432000 4194304 4417452 140733692673168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 251.92
Current children cumulated vsize (KiB) 630436

[startup+66.7009 s]
/proc/loadavg: 7.55 7.45 7.70 9/326 10047
/proc/meminfo: memFree=10105428/32951124 swapFree=67093864/67111528
[pid=9999] ppid=9997 vsize=302492 CPUtime=252.24 cores=1,3,5,7
/proc/9999/stat : 9999 (plingeling) R 9997 9999 8860 0 -1 4202496 263129 1254 0 0 25178 46 0 0 17 0 1 0 653809655 309751808 17914 33554432000 4194304 4417452 140733692673168 18446744073709551615 212436042858 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9999/statm: 75623 17652 181 55 0 73509 0
Current children cumulated CPU time (s) 252.24
Current children cumulated vsize (KiB) 302492

Child status: 20
Real time (s): 66.7045
CPU time (s): 252.257
CPU user time (s): 251.785
CPU system time (s): 0.471928
CPU usage (%): 378.17
Max. virtual memory (cumulated for all children) (KiB): 734444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 251.785
system time used= 0.471928
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264386
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 140
involuntary context switches= 1830

runsolver used 0.185971 second user time and 0.483926 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-15 03:14:33
IDJOB=3371390
IDBENCH=82430
IDSOLVER=1848
FILE ID=node102/3371390-1305422070
RUNJOBID= node102-1305421967-9824
PBS_JOBID= 13324562
Free space on /tmp= 73400 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-pipesworld-27-step13.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371390-1305422070/watcher-3371390-1305422070 -o /tmp/evaluation-result-3371390-1305422070/solver-3371390-1305422070 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371390-1305422070.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 52e16341bcff805ef2d6abe4e95359a0
RANDOM SEED=293567952

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10543124 kB
Buffers:        266476 kB
Cached:        3019720 kB
SwapCached:       1128 kB
Active:       20056280 kB
Inactive:      2055384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10543124 kB
SwapTotal:    67111528 kB
SwapFree:     67093864 kB
Dirty:          136764 kB
Writeback:           0 kB
AnonPages:    18823840 kB
Mapped:          26792 kB
Slab:           179920 kB
PageTables:      53820 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59489524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73428 MiB
End job on node102 at 2011-05-15 03:15:40