Trace number 3472367

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 158916 5103.89

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
MD5SUMc4319228342e10028de028a9b67c3404
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses676901
Sum of the clauses size1609791
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2668220
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...533164/instance-3472367-1307533164.cnf
0.79/0.89	c Solving...
158912.08/5100.03	
158912.08/5100.03	*** INTERRUPTED! ***
158912.08/5100.03	*** Shutting down threads...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3472367-1307533164/watcher-3472367-1307533164 -o /tmp/evaluation-result-3472367-1307533164/solver-3472367-1307533164 -C 160000 -W 5100 -M 256000 HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472367-1307533164.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 262144000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 262195200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.41 24.65 17.20 1/413 22320
/proc/meminfo: memFree=262859900/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=45668 CPUtime=0.02 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 5489 0 0 0 2 0 0 0 21 0 1 0 18703348 46764032 5282 270582939648 4194304 4964800 140733828365408 18446744073709551615 4679106 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/22320/statm: 11417 5291 374 189 0 6291 0

[startup+0.055143 s]
/proc/loadavg: 29.41 24.65 17.20 1/413 22320
/proc/meminfo: memFree=262859900/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=47508 CPUtime=0.05 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 8092 0 0 0 4 1 0 0 21 0 1 0 18703348 48648192 6978 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650955760 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/22320/statm: 11877 6978 386 189 0 6751 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 47508

[startup+0.101146 s]
/proc/loadavg: 29.41 24.65 17.20 1/413 22320
/proc/meminfo: memFree=262859900/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=50700 CPUtime=0.09 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 9182 0 0 0 8 1 0 0 21 0 1 0 18703348 51916800 7776 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/22320/statm: 12675 7778 386 189 0 7549 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 50700

[startup+0.301145 s]
/proc/loadavg: 29.41 24.65 17.20 1/413 22320
/proc/meminfo: memFree=262859900/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=79712 CPUtime=0.29 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 19086 0 0 0 26 3 0 0 22 0 1 0 18703348 81625088 14877 270582939648 4194304 4964800 140733828365408 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/22320/statm: 19928 14877 396 189 0 14802 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 79712

[startup+0.701153 s]
/proc/loadavg: 29.41 24.65 17.20 1/413 22320
/proc/meminfo: memFree=262859900/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=85336 CPUtime=0.69 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 20526 0 0 0 66 3 0 0 23 0 1 0 18703348 87384064 16317 270582939648 4194304 4964800 140733828365408 18446744073709551615 4621605 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/22320/statm: 21334 16317 401 189 0 16208 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 85336

[startup+1.50312 s]
/proc/loadavg: 29.41 24.65 17.20 32/445 22352
/proc/meminfo: memFree=262722980/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=1304892 CPUtime=13.64 cores=0-31
/proc/22320/stat : 22320 (claspmt) S 22318 22320 22294 0 -1 4202496 129901 0 0 0 176 1188 0 0 18 0 32 0 18703348 1336209408 91699 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/22320/statm: 326223 91704 434 189 0 320572 0
[pid=22320/tid=22322] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22322/stat : 22322 (claspmt) D 22318 22320 22294 0 -1 4202560 2148 0 0 0 1 41 0 0 18 0 32 0 18703438 1336209408 91710 270582939648 4194304 4964800 140733828365408 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22320/tid=22323] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22323/stat : 22323 (claspmt) D 22318 22320 22294 0 -1 4202560 2732 0 0 0 1 40 0 0 18 0 32 0 18703438 1336209408 91718 270582939648 4194304 4964800 140733828365408 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=22320/tid=22324] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22324/stat : 22324 (claspmt) D 22318 22320 22294 0 -1 4202560 2671 0 0 0 1 40 0 0 18 0 32 0 18703438 1336209408 91723 270582939648 4194304 4964800 140733828365408 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22320/tid=22325] ppid=22318 vsize=1304892 CPUtime=0.37 cores=0-31
/proc/22320/task/22325/stat : 22325 (claspmt) S 22318 22320 22294 0 -1 4202560 3302 0 0 0 1 36 0 0 18 0 32 0 18703438 1336209408 91734 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604497190125024 0 0 -1 16 0 0 0
[pid=22320/tid=22326] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22326/stat : 22326 (claspmt) D 22318 22320 22294 0 -1 4202560 3689 0 0 0 2 40 0 0 18 0 32 0 18703439 1336209408 91735 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=22320/tid=22327] ppid=22318 vsize=1304892 CPUtime=0.43 cores=0-31
/proc/22320/task/22327/stat : 22327 (claspmt) D 22318 22320 22294 0 -1 4202560 3896 0 0 0 3 40 0 0 18 0 32 0 18703439 1336209408 91736 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650653015 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=22320/tid=22328] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22328/stat : 22328 (claspmt) R 22318 22320 22294 0 -1 4202560 3209 0 0 0 3 39 0 0 18 0 32 0 18703439 1336209408 91745 270582939648 4194304 4964800 140733828365408 18446744073709551615 4380986 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=22320/tid=22329] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22329/stat : 22329 (claspmt) S 22318 22320 22294 0 -1 4202560 3417 0 0 0 3 39 0 0 18 0 32 0 18703439 1336209408 91748 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604502194167264 0 0 -1 6 0 0 0
[pid=22320/tid=22330] ppid=22318 vsize=1304892 CPUtime=0.36 cores=0-31
/proc/22320/task/22330/stat : 22330 (claspmt) S 22318 22320 22294 0 -1 4202560 3575 0 0 0 2 34 0 0 18 0 32 0 18703439 1336209408 91754 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604503740931552 0 0 -1 19 0 0 0
[pid=22320/tid=22331] ppid=22318 vsize=1304892 CPUtime=0.38 cores=0-31
/proc/22320/task/22331/stat : 22331 (claspmt) R 22318 22320 22294 0 -1 4202560 3625 0 0 0 1 37 0 0 18 0 32 0 18703439 1336209408 91765 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=22320/tid=22332] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22332/stat : 22332 (claspmt) D 22318 22320 22294 0 -1 4202560 4696 0 0 0 6 35 0 0 18 0 32 0 18703439 1336209408 91767 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650653104 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22320/tid=22333] ppid=22318 vsize=1304892 CPUtime=0.34 cores=0-31
/proc/22320/task/22333/stat : 22333 (claspmt) S 22318 22320 22294 0 -1 4202560 3295 0 0 0 3 31 0 0 18 0 32 0 18703439 1336209408 91768 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604569961774560 0 0 -1 9 0 0 0
[pid=22320/tid=22334] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22334/stat : 22334 (claspmt) R 22318 22320 22294 0 -1 4202560 3475 0 0 0 2 40 0 0 18 0 32 0 18703439 1336209408 91775 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=22320/tid=22335] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22335/stat : 22335 (claspmt) D 22318 22320 22294 0 -1 4202560 2690 0 0 0 0 42 0 0 18 0 32 0 18703439 1336209408 91784 270582939648 4194304 4964800 140733828365408 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=22320/tid=22336] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22336/stat : 22336 (claspmt) D 22318 22320 22294 0 -1 4202560 3894 0 0 0 1 40 0 0 18 0 32 0 18703439 1336209408 91789 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=22320/tid=22337] ppid=22318 vsize=1304892 CPUtime=0.37 cores=0-31
/proc/22320/task/22337/stat : 22337 (claspmt) S 22318 22320 22294 0 -1 4202560 3365 0 0 0 1 36 0 0 18 0 32 0 18703439 1336209408 91789 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604503983734240 0 0 -1 8 0 0 0
[pid=22320/tid=22338] ppid=22318 vsize=1304892 CPUtime=0.4 cores=0-31
/proc/22320/task/22338/stat : 22338 (claspmt) D 22318 22320 22294 0 -1 4202560 3380 0 0 0 1 39 0 0 18 0 32 0 18703439 1336209408 91797 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=22320/tid=22339] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22339/stat : 22339 (claspmt) D 22318 22320 22294 0 -1 4202560 3589 0 0 0 2 39 0 0 18 0 32 0 18703439 1336209408 91803 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650653031 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=22320/tid=22340] ppid=22318 vsize=1304892 CPUtime=0.4 cores=0-31
/proc/22320/task/22340/stat : 22340 (claspmt) R 22318 22320 22294 0 -1 4202560 3731 0 0 0 5 35 0 0 18 0 32 0 18703439 1336209408 91818 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650653351 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=22320/tid=22341] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22341/stat : 22341 (claspmt) R 22318 22320 22294 0 -1 4202560 3376 0 0 0 2 40 0 0 18 0 32 0 18703439 1336209408 91821 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650623218 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=22320/tid=22342] ppid=22318 vsize=1304892 CPUtime=0.38 cores=0-31
/proc/22320/task/22342/stat : 22342 (claspmt) R 22318 22320 22294 0 -1 4202560 4018 0 0 0 4 34 0 0 18 0 32 0 18703439 1336209408 91822 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=22320/tid=22343] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22343/stat : 22343 (claspmt) D 22318 22320 22294 0 -1 4202560 3987 0 0 0 4 38 0 0 18 0 32 0 18703439 1336209408 91825 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650653309 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=22320/tid=22344] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22344/stat : 22344 (claspmt) D 22318 22320 22294 0 -1 4202560 3983 0 0 0 1 41 0 0 18 0 32 0 18703439 1336209408 91835 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=22320/tid=22345] ppid=22318 vsize=1304892 CPUtime=0.35 cores=0-31
/proc/22320/task/22345/stat : 22345 (claspmt) S 22318 22320 22294 0 -1 4202560 3295 0 0 0 2 33 0 0 18 0 32 0 18703439 1336209408 91839 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604505939852768 0 0 -1 11 0 0 0
[pid=22320/tid=22346] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22346/stat : 22346 (claspmt) R 22318 22320 22294 0 -1 4202560 3546 0 0 0 2 40 0 0 18 0 32 0 18703439 1336209408 91853 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=22320/tid=22347] ppid=22318 vsize=1304892 CPUtime=0.42 cores=0-31
/proc/22320/task/22347/stat : 22347 (claspmt) S 22318 22320 22294 0 -1 4202560 4538 0 0 0 9 33 0 0 18 0 32 0 18703439 1336209408 91857 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604490699972064 0 0 -1 17 0 0 0
[pid=22320/tid=22348] ppid=22318 vsize=1304892 CPUtime=0.33 cores=0-31
/proc/22320/task/22348/stat : 22348 (claspmt) D 22318 22320 22294 0 -1 4202560 3784 0 0 0 2 31 0 0 18 0 32 0 18703439 1336209408 91857 270582939648 4194304 4964800 140733828365408 18446744073709551615 4685574 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=22320/tid=22349] ppid=22318 vsize=1304892 CPUtime=0.4 cores=0-31
/proc/22320/task/22349/stat : 22349 (claspmt) S 22318 22320 22294 0 -1 4202560 3263 0 0 0 3 37 0 0 18 0 32 0 18703439 1336209408 91860 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604499799801312 0 0 -1 21 0 0 0
[pid=22320/tid=22350] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22350/stat : 22350 (claspmt) D 22318 22320 22294 0 -1 4202560 3569 0 0 0 2 39 0 0 18 0 32 0 18703439 1336209408 91862 270582939648 4194304 4964800 140733828365408 18446744073709551615 4405094 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=22320/tid=22351] ppid=22318 vsize=1304892 CPUtime=0.41 cores=0-31
/proc/22320/task/22351/stat : 22351 (claspmt) R 22318 22320 22294 0 -1 4202560 3716 0 0 0 2 39 0 0 18 0 32 0 18703439 1336209408 91873 270582939648 4194304 4964800 140733828365408 18446744073709551615 4376501 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=22320/tid=22352] ppid=22318 vsize=1304892 CPUtime=0.4 cores=0-31
/proc/22320/task/22352/stat : 22352 (claspmt) R 22318 22320 22294 0 -1 4202560 3865 0 0 0 1 39 0 0 18 0 32 0 18703440 1336209408 91887 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 28 0 0 0
Current children cumulated CPU time (s) 13.64
Current children cumulated vsize (KiB) 1304892

[startup+3.10121 s]
/proc/loadavg: 29.41 24.65 17.20 5/445 22352
/proc/meminfo: memFree=262431676/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=1313612 CPUtime=20.88 cores=0-31
/proc/22320/stat : 22320 (claspmt) S 22318 22320 22294 0 -1 4202496 146839 0 0 0 851 1237 0 0 18 0 32 0 18703348 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/22320/statm: 328403 107537 440 189 0 322752 0
[pid=22320/tid=22322] ppid=22318 vsize=1313612 CPUtime=0.45 cores=0-31
/proc/22320/task/22322/stat : 22322 (claspmt) S 22318 22320 22294 0 -1 4202560 2872 0 0 0 2 43 0 0 18 0 32 0 18703438 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604505824181728 0 0 -1 1 0 0 0
[pid=22320/tid=22323] ppid=22318 vsize=1313612 CPUtime=0.5 cores=0-31
/proc/22320/task/22323/stat : 22323 (claspmt) S 22318 22320 22294 0 -1 4202560 4654 0 0 0 6 44 0 0 18 0 32 0 18703438 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604501917228512 0 0 -1 2 0 0 0
[pid=22320/tid=22324] ppid=22318 vsize=1313612 CPUtime=0.51 cores=0-31
/proc/22320/task/22324/stat : 22324 (claspmt) S 22318 22320 22294 0 -1 4202560 4748 0 0 0 7 44 0 0 18 0 32 0 18703438 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604501061000672 0 0 -1 3 0 0 0
[pid=22320/tid=22325] ppid=22318 vsize=1313612 CPUtime=0.37 cores=0-31
/proc/22320/task/22325/stat : 22325 (claspmt) S 22318 22320 22294 0 -1 4202560 3302 0 0 0 1 36 0 0 18 0 32 0 18703438 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604497190125024 0 0 -1 16 0 0 0
[pid=22320/tid=22326] ppid=22318 vsize=1313612 CPUtime=1.94 cores=0-31
/proc/22320/task/22326/stat : 22326 (claspmt) R 22318 22320 22294 0 -1 4202560 4108 0 0 0 151 43 0 0 20 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=22320/tid=22327] ppid=22318 vsize=1313612 CPUtime=0.5 cores=0-31
/proc/22320/task/22327/stat : 22327 (claspmt) S 22318 22320 22294 0 -1 4202560 4735 0 0 0 7 43 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604483686546912 0 0 -1 26 0 0 0
[pid=22320/tid=22328] ppid=22318 vsize=1313612 CPUtime=0.52 cores=0-31
/proc/22320/task/22328/stat : 22328 (claspmt) S 22318 22320 22294 0 -1 4202560 4149 0 0 0 10 42 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604497653497312 0 0 -1 5 0 0 0
[pid=22320/tid=22329] ppid=22318 vsize=1313612 CPUtime=0.42 cores=0-31
/proc/22320/task/22329/stat : 22329 (claspmt) S 22318 22320 22294 0 -1 4202560 3417 0 0 0 3 39 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604502194167264 0 0 -1 6 0 0 0
[pid=22320/tid=22330] ppid=22318 vsize=1313612 CPUtime=0.36 cores=0-31
/proc/22320/task/22330/stat : 22330 (claspmt) S 22318 22320 22294 0 -1 4202560 3575 0 0 0 2 34 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604503740931552 0 0 -1 19 0 0 0
[pid=22320/tid=22331] ppid=22318 vsize=1313612 CPUtime=0.46 cores=0-31
/proc/22320/task/22331/stat : 22331 (claspmt) S 22318 22320 22294 0 -1 4202560 4721 0 0 0 6 40 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604484431027680 0 0 -1 25 0 0 0
[pid=22320/tid=22332] ppid=22318 vsize=1313612 CPUtime=0.44 cores=0-31
/proc/22320/task/22332/stat : 22332 (claspmt) S 22318 22320 22294 0 -1 4202560 5098 0 0 0 8 36 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604505812844000 0 0 -1 7 0 0 0
[pid=22320/tid=22333] ppid=22318 vsize=1313612 CPUtime=0.34 cores=0-31
/proc/22320/task/22333/stat : 22333 (claspmt) S 22318 22320 22294 0 -1 4202560 3295 0 0 0 3 31 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604569961774560 0 0 -1 9 0 0 0
[pid=22320/tid=22334] ppid=22318 vsize=1313612 CPUtime=1.92 cores=0-31
/proc/22320/task/22334/stat : 22334 (claspmt) R 22318 22320 22294 0 -1 4202560 4235 0 0 0 149 43 0 0 20 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 4668984 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=22320/tid=22335] ppid=22318 vsize=1313612 CPUtime=0.5 cores=0-31
/proc/22320/task/22335/stat : 22335 (claspmt) S 22318 22320 22294 0 -1 4202560 4348 0 0 0 5 45 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604498475490784 0 0 -1 0 0 0 0
[pid=22320/tid=22336] ppid=22318 vsize=1313612 CPUtime=0.48 cores=0-31
/proc/22320/task/22336/stat : 22336 (claspmt) S 22318 22320 22294 0 -1 4202560 4402 0 0 0 6 42 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604486891519456 0 0 -1 24 0 0 0
[pid=22320/tid=22337] ppid=22318 vsize=1313612 CPUtime=0.37 cores=0-31
/proc/22320/task/22337/stat : 22337 (claspmt) S 22318 22320 22294 0 -1 4202560 3365 0 0 0 1 36 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604503983734240 0 0 -1 8 0 0 0
[pid=22320/tid=22338] ppid=22318 vsize=1313612 CPUtime=0.41 cores=0-31
/proc/22320/task/22338/stat : 22338 (claspmt) S 22318 22320 22294 0 -1 4202560 3557 0 0 0 1 40 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604505701621216 0 0 -1 20 0 0 0
[pid=22320/tid=22339] ppid=22318 vsize=1313612 CPUtime=0.47 cores=0-31
/proc/22320/task/22339/stat : 22339 (claspmt) S 22318 22320 22294 0 -1 4202560 4432 0 0 0 6 41 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604504405958112 0 0 -1 12 0 0 0
[pid=22320/tid=22340] ppid=22318 vsize=1313612 CPUtime=0.43 cores=0-31
/proc/22320/task/22340/stat : 22340 (claspmt) S 22318 22320 22294 0 -1 4202560 4067 0 0 0 7 36 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604504398880224 0 0 -1 27 0 0 0
[pid=22320/tid=22341] ppid=22318 vsize=1313612 CPUtime=0.42 cores=0-31
/proc/22320/task/22341/stat : 22341 (claspmt) S 22318 22320 22294 0 -1 4202560 3399 0 0 0 2 40 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604497487207904 0 0 -1 30 0 0 0
[pid=22320/tid=22342] ppid=22318 vsize=1313612 CPUtime=1.95 cores=0-31
/proc/22320/task/22342/stat : 22342 (claspmt) R 22318 22320 22294 0 -1 4202560 4170 0 0 0 161 34 0 0 20 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=22320/tid=22343] ppid=22318 vsize=1313612 CPUtime=0.48 cores=0-31
/proc/22320/task/22343/stat : 22343 (claspmt) S 22318 22320 22294 0 -1 4202560 4791 0 0 0 7 41 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604483310935520 0 0 -1 18 0 0 0
[pid=22320/tid=22344] ppid=22318 vsize=1313612 CPUtime=0.51 cores=0-31
/proc/22320/task/22344/stat : 22344 (claspmt) S 22318 22320 22294 0 -1 4202560 4466 0 0 0 8 43 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604506116521440 0 0 -1 13 0 0 0
[pid=22320/tid=22345] ppid=22318 vsize=1313612 CPUtime=0.35 cores=0-31
/proc/22320/task/22345/stat : 22345 (claspmt) S 22318 22320 22294 0 -1 4202560 3295 0 0 0 2 33 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604505939852768 0 0 -1 11 0 0 0
[pid=22320/tid=22346] ppid=22318 vsize=1313612 CPUtime=0.42 cores=0-31
/proc/22320/task/22346/stat : 22346 (claspmt) S 22318 22320 22294 0 -1 4202560 3547 0 0 0 2 40 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604500339580384 0 0 -1 10 0 0 0
[pid=22320/tid=22347] ppid=22318 vsize=1313612 CPUtime=0.42 cores=0-31
/proc/22320/task/22347/stat : 22347 (claspmt) S 22318 22320 22294 0 -1 4202560 4538 0 0 0 9 33 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604490699972064 0 0 -1 17 0 0 0
[pid=22320/tid=22348] ppid=22318 vsize=1313612 CPUtime=0.42 cores=0-31
/proc/22320/task/22348/stat : 22348 (claspmt) S 22318 22320 22294 0 -1 4202560 4620 0 0 0 9 33 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604504025562592 0 0 -1 23 0 0 0
[pid=22320/tid=22349] ppid=22318 vsize=1313612 CPUtime=0.4 cores=0-31
/proc/22320/task/22349/stat : 22349 (claspmt) S 22318 22320 22294 0 -1 4202560 3263 0 0 0 3 37 0 0 18 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 258662772457 0 0 4096 18946 18446604499799801312 0 0 -1 21 0 0 0
[pid=22320/tid=22350] ppid=22318 vsize=1313612 CPUtime=1.92 cores=0-31
/proc/22320/task/22350/stat : 22350 (claspmt) R 22318 22320 22294 0 -1 4202560 4248 0 0 0 150 42 0 0 20 0 32 0 18703439 1345138688 107537 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=22320/tid=22351] ppid=22318 vsize=1313612 CPUtime=0.49 cores=0-31

################
# More data... #
################

/proc/22320/task/22333/stat : 22333 (claspmt) R 22318 22320 22294 0 -1 4202560 323088 0 0 0 492504 675 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=22320/tid=22334] ppid=22318 vsize=41253704 CPUtime=5079.01 cores=0-31
/proc/22320/task/22334/stat : 22334 (claspmt) R 22318 22320 22294 0 -1 4202560 4773 0 0 0 507857 44 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=22320/tid=22335] ppid=22318 vsize=41253704 CPUtime=4918.63 cores=0-31
/proc/22320/task/22335/stat : 22335 (claspmt) R 22318 22320 22294 0 -1 4202560 252836 0 0 0 491341 522 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=22320/tid=22336] ppid=22318 vsize=41253704 CPUtime=4924.22 cores=0-31
/proc/22320/task/22336/stat : 22336 (claspmt) R 22318 22320 22294 0 -1 4202560 1052728 0 0 0 491091 1331 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=22320/tid=22337] ppid=22318 vsize=41253704 CPUtime=4928.94 cores=0-31
/proc/22320/task/22337/stat : 22337 (claspmt) R 22318 22320 22294 0 -1 4202560 372691 0 0 0 492026 868 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4332462 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=22320/tid=22338] ppid=22318 vsize=41253704 CPUtime=4931.79 cores=0-31
/proc/22320/task/22338/stat : 22338 (claspmt) R 22318 22320 22294 0 -1 4202560 138684 0 0 0 492772 407 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=22320/tid=22339] ppid=22318 vsize=41253704 CPUtime=4936.34 cores=0-31
/proc/22320/task/22339/stat : 22339 (claspmt) R 22318 22320 22294 0 -1 4202560 186193 0 0 0 493291 343 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4660118 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=22320/tid=22340] ppid=22318 vsize=41253704 CPUtime=4935.42 cores=0-31
/proc/22320/task/22340/stat : 22340 (claspmt) R 22318 22320 22294 0 -1 4202560 213656 0 0 0 493012 530 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=22320/tid=22341] ppid=22318 vsize=41253704 CPUtime=4930.33 cores=0-31
/proc/22320/task/22341/stat : 22341 (claspmt) R 22318 22320 22294 0 -1 4202560 430882 0 0 0 492151 882 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4362375 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=22320/tid=22342] ppid=22318 vsize=41253704 CPUtime=5078.93 cores=0-31
/proc/22320/task/22342/stat : 22342 (claspmt) R 22318 22320 22294 0 -1 4202560 4204 0 0 0 507859 34 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=22320/tid=22343] ppid=22318 vsize=41253704 CPUtime=4926.62 cores=0-31
/proc/22320/task/22343/stat : 22343 (claspmt) R 22318 22320 22294 0 -1 4202560 228663 0 0 0 492164 498 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=22320/tid=22344] ppid=22318 vsize=41253704 CPUtime=4916.92 cores=0-31
/proc/22320/task/22344/stat : 22344 (claspmt) R 22318 22320 22294 0 -1 4202560 910801 0 0 0 490505 1187 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=22320/tid=22345] ppid=22318 vsize=41253704 CPUtime=4932.96 cores=0-31
/proc/22320/task/22345/stat : 22345 (claspmt) R 22318 22320 22294 0 -1 4202560 297632 0 0 0 492553 743 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=22320/tid=22346] ppid=22318 vsize=41253704 CPUtime=4933.77 cores=0-31
/proc/22320/task/22346/stat : 22346 (claspmt) R 22318 22320 22294 0 -1 4202560 124839 0 0 0 492973 404 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=22320/tid=22347] ppid=22318 vsize=41253704 CPUtime=4936.3 cores=0-31
/proc/22320/task/22347/stat : 22347 (claspmt) R 22318 22320 22294 0 -1 4202560 184603 0 0 0 493296 334 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22320/tid=22348] ppid=22318 vsize=41253704 CPUtime=4931.7 cores=0-31
/proc/22320/task/22348/stat : 22348 (claspmt) R 22318 22320 22294 0 -1 4202560 249814 0 0 0 492597 573 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=22320/tid=22349] ppid=22318 vsize=41253704 CPUtime=4932.47 cores=0-31
/proc/22320/task/22349/stat : 22349 (claspmt) R 22318 22320 22294 0 -1 4202560 378257 0 0 0 492492 755 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=22320/tid=22350] ppid=22318 vsize=41253704 CPUtime=5080.16 cores=0-31
/proc/22320/task/22350/stat : 22350 (claspmt) R 22318 22320 22294 0 -1 4202560 4761 0 0 0 507972 44 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669017 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=22320/tid=22351] ppid=22318 vsize=41253704 CPUtime=4933.8 cores=0-31
/proc/22320/task/22351/stat : 22351 (claspmt) R 22318 22320 22294 0 -1 4202560 284826 0 0 0 492791 589 0 0 25 0 32 0 18703439 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4683996 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=22320/tid=22352] ppid=22318 vsize=41253704 CPUtime=4930.32 cores=0-31
/proc/22320/task/22352/stat : 22352 (claspmt) R 22318 22320 22294 0 -1 4202560 1041820 0 0 0 491806 1226 0 0 25 0 32 0 18703440 42243792896 10062678 270582939648 4194304 4964800 140733828365408 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 158346
Current children cumulated vsize (KiB) 41253704



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 32.05 32.07 31.99 33/445 22512
/proc/meminfo: memFree=222434356/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=41323336 CPUtime=158912 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 10234696 0 0 0 15872349 18860 0 0 25 0 32 0 18703348 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4362289 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/22320/statm: 10330834 10088744 463 189 0 10325183 0
[pid=22320/tid=22322] ppid=22318 vsize=41323336 CPUtime=4952.11 cores=0-31
/proc/22320/task/22322/stat : 22322 (claspmt) R 22318 22320 22294 0 -1 4202560 130664 0 0 0 494791 420 0 0 25 0 32 0 18703438 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=22320/tid=22323] ppid=22318 vsize=41323336 CPUtime=4942.03 cores=0-31
/proc/22320/task/22323/stat : 22323 (claspmt) R 22318 22320 22294 0 -1 4202560 193985 0 0 0 493828 375 0 0 25 0 32 0 18703438 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4363459 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=22320/tid=22324] ppid=22318 vsize=41323336 CPUtime=4944.81 cores=0-31
/proc/22320/task/22324/stat : 22324 (claspmt) R 22318 22320 22294 0 -1 4202560 211512 0 0 0 493983 498 0 0 25 0 32 0 18703438 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669523 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=22320/tid=22325] ppid=22318 vsize=41323336 CPUtime=4936.7 cores=0-31
/proc/22320/task/22325/stat : 22325 (claspmt) R 22318 22320 22294 0 -1 4202560 423872 0 0 0 492807 863 0 0 25 0 32 0 18703438 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=22320/tid=22326] ppid=22318 vsize=41323336 CPUtime=5096.72 cores=0-31
/proc/22320/task/22326/stat : 22326 (claspmt) R 22318 22320 22294 0 -1 4202560 4354 0 0 0 509629 43 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670194 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22320/tid=22327] ppid=22318 vsize=41323336 CPUtime=4952.71 cores=0-31
/proc/22320/task/22327/stat : 22327 (claspmt) R 22318 22320 22294 0 -1 4202560 365164 0 0 0 494588 683 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=22320/tid=22328] ppid=22318 vsize=41323336 CPUtime=4946.43 cores=0-31
/proc/22320/task/22328/stat : 22328 (claspmt) R 22318 22320 22294 0 -1 4202560 1015862 0 0 0 493440 1203 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=22320/tid=22329] ppid=22318 vsize=41323336 CPUtime=4938.17 cores=0-31
/proc/22320/task/22329/stat : 22329 (claspmt) R 22318 22320 22294 0 -1 4202560 349113 0 0 0 492955 862 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4362240 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=22320/tid=22330] ppid=22318 vsize=41323336 CPUtime=4952.07 cores=0-31
/proc/22320/task/22330/stat : 22330 (claspmt) R 22318 22320 22294 0 -1 4202560 131132 0 0 0 494825 382 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=22320/tid=22331] ppid=22318 vsize=41323336 CPUtime=4943.8 cores=0-31
/proc/22320/task/22331/stat : 22331 (claspmt) R 22318 22320 22294 0 -1 4202560 224767 0 0 0 493988 392 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=22320/tid=22332] ppid=22318 vsize=41323336 CPUtime=4953.5 cores=0-31
/proc/22320/task/22332/stat : 22332 (claspmt) R 22318 22320 22294 0 -1 4202560 180351 0 0 0 494891 459 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4659391 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=22320/tid=22333] ppid=22318 vsize=41323336 CPUtime=4949.51 cores=0-31
/proc/22320/task/22333/stat : 22333 (claspmt) R 22318 22320 22294 0 -1 4202560 323088 0 0 0 494276 675 0 0 25 0 32 0 18703439 42315096064 10088744 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=22320/tid=22334] ppid=22318 vsize=41323336 CPUtime=5096.73 cores=0-31
/proc/22320/task/22334/stat : 22334 (claspmt) R 22318 22320 22294 0 -1 4202560 4773 0 0 0 509629 44 0 0 25 0 32 0 18703439 42315096064 10088752 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=22320/tid=22335] ppid=22318 vsize=41323336 CPUtime=4936.35 cores=0-31
/proc/22320/task/22335/stat : 22335 (claspmt) R 22318 22320 22294 0 -1 4202560 252836 0 0 0 493113 522 0 0 25 0 32 0 18703439 42315096064 10088755 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=22320/tid=22336] ppid=22318 vsize=41323336 CPUtime=4941.93 cores=0-31
/proc/22320/task/22336/stat : 22336 (claspmt) R 22318 22320 22294 0 -1 4202560 1068468 0 0 0 492850 1343 0 0 25 0 32 0 18703439 42315096064 10088755 270582939648 4194304 4964800 140733828365408 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=22320/tid=22337] ppid=22318 vsize=41323336 CPUtime=4946.63 cores=0-31
/proc/22320/task/22337/stat : 22337 (claspmt) R 22318 22320 22294 0 -1 4202560 375025 0 0 0 493789 874 0 0 25 0 32 0 18703439 42315096064 10088755 270582939648 4194304 4964800 140733828365408 18446744073709551615 4342896 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=22320/tid=22338] ppid=22318 vsize=41323336 CPUtime=4949.51 cores=0-31
/proc/22320/task/22338/stat : 22338 (claspmt) R 22318 22320 22294 0 -1 4202560 138826 0 0 0 494544 407 0 0 25 0 32 0 18703439 42315096064 10088755 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=22320/tid=22339] ppid=22318 vsize=41323336 CPUtime=4954.06 cores=0-31
/proc/22320/task/22339/stat : 22339 (claspmt) R 22318 22320 22294 0 -1 4202560 186251 0 0 0 495063 343 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=22320/tid=22340] ppid=22318 vsize=41323336 CPUtime=4953.13 cores=0-31
/proc/22320/task/22340/stat : 22340 (claspmt) R 22318 22320 22294 0 -1 4202560 214385 0 0 0 494783 530 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4654511 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=22320/tid=22341] ppid=22318 vsize=41323336 CPUtime=4948.04 cores=0-31
/proc/22320/task/22341/stat : 22341 (claspmt) R 22318 22320 22294 0 -1 4202560 435565 0 0 0 493914 890 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=22320/tid=22342] ppid=22318 vsize=41323336 CPUtime=5096.65 cores=0-31
/proc/22320/task/22342/stat : 22342 (claspmt) R 22318 22320 22294 0 -1 4202560 4204 0 0 0 509631 34 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=22320/tid=22343] ppid=22318 vsize=41323336 CPUtime=4944.34 cores=0-31
/proc/22320/task/22343/stat : 22343 (claspmt) R 22318 22320 22294 0 -1 4202560 228663 0 0 0 493936 498 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4342228 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=22320/tid=22344] ppid=22318 vsize=41323336 CPUtime=4934.64 cores=0-31
/proc/22320/task/22344/stat : 22344 (claspmt) R 22318 22320 22294 0 -1 4202560 910801 0 0 0 492277 1187 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=22320/tid=22345] ppid=22318 vsize=41323336 CPUtime=4950.68 cores=0-31
/proc/22320/task/22345/stat : 22345 (claspmt) R 22318 22320 22294 0 -1 4202560 297654 0 0 0 494325 743 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4653455 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=22320/tid=22346] ppid=22318 vsize=41323336 CPUtime=4951.49 cores=0-31
/proc/22320/task/22346/stat : 22346 (claspmt) R 22318 22320 22294 0 -1 4202560 124839 0 0 0 494745 404 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=22320/tid=22347] ppid=22318 vsize=41323336 CPUtime=4954.01 cores=0-31
/proc/22320/task/22347/stat : 22347 (claspmt) R 22318 22320 22294 0 -1 4202560 184671 0 0 0 495067 334 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22320/tid=22348] ppid=22318 vsize=41323336 CPUtime=4949.42 cores=0-31
/proc/22320/task/22348/stat : 22348 (claspmt) R 22318 22320 22294 0 -1 4202560 249814 0 0 0 494369 573 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=22320/tid=22349] ppid=22318 vsize=41323336 CPUtime=4950.18 cores=0-31
/proc/22320/task/22349/stat : 22349 (claspmt) R 22318 22320 22294 0 -1 4202560 378298 0 0 0 494263 755 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=22320/tid=22350] ppid=22318 vsize=41323336 CPUtime=5097.88 cores=0-31
/proc/22320/task/22350/stat : 22350 (claspmt) R 22318 22320 22294 0 -1 4202560 4761 0 0 0 509744 44 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=22320/tid=22351] ppid=22318 vsize=41323336 CPUtime=4951.51 cores=0-31
/proc/22320/task/22351/stat : 22351 (claspmt) R 22318 22320 22294 0 -1 4202560 284833 0 0 0 494562 589 0 0 25 0 32 0 18703439 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4342909 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=22320/tid=22352] ppid=22318 vsize=41323336 CPUtime=4948.04 cores=0-31
/proc/22320/task/22352/stat : 22352 (claspmt) R 22318 22320 22294 0 -1 4202560 1042973 0 0 0 493577 1227 0 0 25 0 32 0 18703440 42315096064 10088756 270582939648 4194304 4964800 140733828365408 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 158912
Current children cumulated vsize (KiB) 41323336

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -22320

Solver just ended. Dumping a history of the last processes samples

[startup+5100.6 s]
/proc/loadavg: 32.05 32.07 31.99 2/415 22513
/proc/meminfo: memFree=222467704/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=41197516 CPUtime=158913 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4202496 10234769 0 0 0 15872440 18860 0 0 25 0 1 0 18703348 42186256384 10079834 270582939648 4194304 4964800 140733828365408 18446744073709551615 258650610907 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/22320/statm: 10299379 10079834 474 189 0 10293728 0
Current children cumulated CPU time (s) 158913
Current children cumulated vsize (KiB) 41197516

[startup+5102.2 s]
/proc/loadavg: 32.05 32.07 31.99 2/415 22513
/proc/meminfo: memFree=222503788/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=0 CPUtime=158915 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4203524 10234769 0 0 0 15872581 18877 0 0 25 0 1 0 18703348 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/22320/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 158915
Current children cumulated vsize (KiB) 0

[startup+5103 s]
/proc/loadavg: 32.05 32.07 31.99 2/414 22513
/proc/meminfo: memFree=237297228/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=0 CPUtime=158915 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4203524 10234769 0 0 0 15872581 18957 0 0 25 0 1 0 18703348 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/22320/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 158915
Current children cumulated vsize (KiB) 0

[startup+5103.4 s]
/proc/loadavg: 32.05 32.07 31.99 2/414 22513
/proc/meminfo: memFree=237297228/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=0 CPUtime=158916 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4203524 10234769 0 0 0 15872581 18997 0 0 25 0 1 0 18703348 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/22320/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 158916
Current children cumulated vsize (KiB) 0

[startup+5103.8 s]
/proc/loadavg: 32.05 32.07 31.99 2/414 22513
/proc/meminfo: memFree=237297228/264257624 swapFree=67111528/67111528
[pid=22320] ppid=22318 vsize=0 CPUtime=158916 cores=0-31
/proc/22320/stat : 22320 (claspmt) R 22318 22320 22294 0 -1 4203524 10234769 0 0 0 15872581 19037 0 0 25 0 1 0 18703348 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/22320/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 158916
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 5103.89
CPU time (s): 158916
CPU user time (s): 158726
CPU system time (s): 190.462
CPU usage (%): 3113.63
Max. virtual memory (cumulated for all children) (KiB): 41323336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 158726
system time used= 190.462
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10234769
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2384891
involuntary context switches= 391997

runsolver used 30.3704 second user time and 113.44 second system time

The end

Launcher Data 

Begin job on node200 at 2011-06-08 13:39:25
IDJOB=3472367
IDBENCH=82372
IDSOLVER=1961
FILE ID=node200/3472367-1307533164
RUNJOBID= node200-1307533164-22308
PBS_JOBID= 13514242
Free space on /tmp= 61732 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3472367-1307533164/watcher-3472367-1307533164 -o /tmp/evaluation-result-3472367-1307533164/solver-3472367-1307533164 -C 160000 -W 5100 -M 256000  HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472367-1307533164.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 256000 MiB
NBCORE= 32

MD5SUM BENCH= c4319228342e10028de028a9b67c3404
RANDOM SEED=1395924422

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      262860172 kB
Buffers:        175608 kB
Cached:         957368 kB
SwapCached:          0 kB
Active:         206644 kB
Inactive:       989872 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      262860172 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           13092 kB
Writeback:           0 kB
AnonPages:       63180 kB
Mapped:          14444 kB
Slab:           121168 kB
PageTables:       4428 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   159576 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61732 MiB
End job on node200 at 2011-06-08 15:04:29