Trace number 3472418

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 160004 5011.34

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
MD5SUMa0ec1baa890da62d0c6df7f1e62c6af3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark31478.4
Satisfiable
(Un)Satisfiability was proved
Number of variables163622
Number of clauses488120
Sum of the clauses size1138944
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2325412
Number of clauses of size 3162706
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...634753/instance-3472418-1307634753.cnf
1.69/1.77	c Solving...
160000.97/5008.93	
160000.97/5008.93	*** INTERRUPTED! ***
160000.97/5008.93	*** Shutting down threads...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3472418-1307634753/watcher-3472418-1307634753 -o /tmp/evaluation-result-3472418-1307634753/solver-3472418-1307634753 -C 160000 -W 5100 -M 256000 HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472418-1307634753.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 262144000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 262195200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.57 31.60 31.90 1/412 29398
/proc/meminfo: memFree=262340700/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=41652 CPUtime=0.02 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 5045 0 0 0 2 0 0 0 21 0 1 0 28862256 42651648 4975 270582939648 4194304 4964800 140737325034064 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 10413 4983 373 189 0 5287 0

[startup+0.128128 s]
/proc/loadavg: 29.57 31.60 31.90 1/412 29398
/proc/meminfo: memFree=262340700/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=63668 CPUtime=0.12 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 13311 0 0 0 10 2 0 0 21 0 1 0 28862256 65196032 10813 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 15917 10815 383 189 0 10791 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 63668

[startup+0.201118 s]
/proc/loadavg: 29.57 31.60 31.90 1/412 29398
/proc/meminfo: memFree=262340700/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=72672 CPUtime=0.19 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 16257 0 0 0 17 2 0 0 21 0 1 0 28862256 74416128 13151 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 18168 13153 383 189 0 13042 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 72672

[startup+0.301133 s]
/proc/loadavg: 29.57 31.60 31.90 1/412 29398
/proc/meminfo: memFree=262340700/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=92400 CPUtime=0.28 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 23318 0 0 0 25 3 0 0 22 0 1 0 28862256 94617600 17663 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 23100 17666 396 189 0 17974 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 92400

[startup+0.701136 s]
/proc/loadavg: 29.57 31.60 31.90 1/412 29398
/proc/meminfo: memFree=262340700/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=108308 CPUtime=0.69 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 27072 0 0 0 65 4 0 0 23 0 1 0 28862256 110907392 21417 270582939648 4194304 4964800 140737325034064 18446744073709551615 4601745 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 27077 21418 401 189 0 21951 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 108308

[startup+1.50117 s]
/proc/loadavg: 29.57 31.60 31.90 2/413 29399
/proc/meminfo: memFree=262249304/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=118076 CPUtime=1.49 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 29507 0 0 0 144 5 0 0 25 0 1 0 28862256 120909824 23852 270582939648 4194304 4964800 140737325034064 18446744073709551615 4607536 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/29398/statm: 29519 23852 401 189 0 24393 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 118076

[startup+3.10309 s]
/proc/loadavg: 29.57 31.60 31.90 6/444 29430
/proc/meminfo: memFree=262018192/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=2054068 CPUtime=18.62 cores=0-31
/proc/29398/stat : 29398 (claspmt) S 29396 29398 29368 0 -1 4202496 203621 0 0 0 340 1522 0 0 18 0 32 0 28862256 2103365632 155795 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/29398/statm: 513517 155797 434 189 0 507866 0
[pid=29398/tid=29400] ppid=29396 vsize=2054068 CPUtime=0.53 cores=0-31
/proc/29398/task/29400/stat : 29400 (claspmt) D 29396 29398 29368 0 -1 4202560 4865 0 0 0 4 49 0 0 17 0 32 0 28862433 2103365632 155800 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650653104 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=29398/tid=29401] ppid=29396 vsize=2054068 CPUtime=0.55 cores=0-31
/proc/29398/task/29401/stat : 29401 (claspmt) D 29396 29398 29368 0 -1 4202560 5073 0 0 0 4 51 0 0 17 0 32 0 28862433 2103365632 155805 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29398/tid=29402] ppid=29396 vsize=2054068 CPUtime=0.57 cores=0-31
/proc/29398/task/29402/stat : 29402 (claspmt) D 29396 29398 29368 0 -1 4202560 4909 0 0 0 4 53 0 0 17 0 32 0 28862433 2103365632 155806 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29398/tid=29403] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29403/stat : 29403 (claspmt) S 29396 29398 29368 0 -1 4202560 5456 0 0 0 4 50 0 0 17 0 32 0 28862433 2103365632 155816 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604504953355744 0 0 -1 21 0 0 0
[pid=29398/tid=29404] ppid=29396 vsize=2054068 CPUtime=0.52 cores=0-31
/proc/29398/task/29404/stat : 29404 (claspmt) D 29396 29398 29368 0 -1 4202560 5267 0 0 0 5 47 0 0 17 0 32 0 28862433 2103365632 155820 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=29398/tid=29405] ppid=29396 vsize=2054068 CPUtime=0.57 cores=0-31
/proc/29398/task/29405/stat : 29405 (claspmt) D 29396 29398 29368 0 -1 4202560 5351 0 0 0 6 51 0 0 17 0 32 0 28862433 2103365632 155823 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29398/tid=29406] ppid=29396 vsize=2054068 CPUtime=0.53 cores=0-31
/proc/29398/task/29406/stat : 29406 (claspmt) D 29396 29398 29368 0 -1 4202560 5917 0 0 0 4 49 0 0 17 0 32 0 28862433 2103365632 155823 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29398/tid=29407] ppid=29396 vsize=2054068 CPUtime=0.53 cores=0-31
/proc/29398/task/29407/stat : 29407 (claspmt) S 29396 29398 29368 0 -1 4202560 5535 0 0 0 5 48 0 0 17 0 32 0 28862433 2103365632 155831 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604500437466592 0 0 -1 29 0 0 0
[pid=29398/tid=29408] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29408/stat : 29408 (claspmt) S 29396 29398 29368 0 -1 4202560 5387 0 0 0 7 47 0 0 17 0 32 0 28862433 2103365632 155836 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604501774384608 0 0 -1 7 0 0 0
[pid=29398/tid=29409] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29409/stat : 29409 (claspmt) D 29396 29398 29368 0 -1 4202560 6180 0 0 0 6 48 0 0 17 0 32 0 28862433 2103365632 155841 270582939648 4194304 4964800 140737325034064 18446744073709551615 4376539 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=29398/tid=29410] ppid=29396 vsize=2054068 CPUtime=0.5 cores=0-31
/proc/29398/task/29410/stat : 29410 (claspmt) D 29396 29398 29368 0 -1 4202560 5553 0 0 0 5 45 0 0 17 0 32 0 28862433 2103365632 155844 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=29398/tid=29411] ppid=29396 vsize=2054068 CPUtime=0.51 cores=0-31
/proc/29398/task/29411/stat : 29411 (claspmt) S 29396 29398 29368 0 -1 4202560 5225 0 0 0 6 45 0 0 17 0 32 0 28862433 2103365632 155848 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604501545287136 0 0 -1 11 0 0 0
[pid=29398/tid=29412] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29412/stat : 29412 (claspmt) D 29396 29398 29368 0 -1 4202560 5709 0 0 0 6 48 0 0 17 0 32 0 28862433 2103365632 155849 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=29398/tid=29413] ppid=29396 vsize=2054068 CPUtime=0.56 cores=0-31
/proc/29398/task/29413/stat : 29413 (claspmt) D 29396 29398 29368 0 -1 4202560 5458 0 0 0 3 53 0 0 17 0 32 0 28862434 2103365632 155850 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=29398/tid=29414] ppid=29396 vsize=2054068 CPUtime=0.51 cores=0-31
/proc/29398/task/29414/stat : 29414 (claspmt) D 29396 29398 29368 0 -1 4202560 5869 0 0 0 3 48 0 0 17 0 32 0 28862434 2103365632 155853 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29398/tid=29415] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29415/stat : 29415 (claspmt) S 29396 29398 29368 0 -1 4202560 5481 0 0 0 4 50 0 0 17 0 32 0 28862434 2103365632 155860 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604502889905632 0 0 -1 16 0 0 0
[pid=29398/tid=29416] ppid=29396 vsize=2054068 CPUtime=0.52 cores=0-31
/proc/29398/task/29416/stat : 29416 (claspmt) S 29396 29398 29368 0 -1 4202560 5426 0 0 0 4 48 0 0 17 0 32 0 28862434 2103365632 155866 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604500239678944 0 0 -1 8 0 0 0
[pid=29398/tid=29417] ppid=29396 vsize=2054068 CPUtime=0.52 cores=0-31
/proc/29398/task/29417/stat : 29417 (claspmt) S 29396 29398 29368 0 -1 4202560 7308 0 0 0 8 44 0 0 17 0 32 0 28862434 2103365632 155870 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604502889897440 0 0 -1 17 0 0 0
[pid=29398/tid=29418] ppid=29396 vsize=2054068 CPUtime=0.53 cores=0-31
/proc/29398/task/29418/stat : 29418 (claspmt) R 29396 29398 29368 0 -1 4202560 5662 0 0 0 4 49 0 0 17 0 32 0 28862434 2103365632 155874 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=29398/tid=29419] ppid=29396 vsize=2054068 CPUtime=0.4 cores=0-31
/proc/29398/task/29419/stat : 29419 (claspmt) S 29396 29398 29368 0 -1 4202560 5583 0 0 0 4 36 0 0 17 0 32 0 28862434 2103365632 155877 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604559130525152 0 0 -1 25 0 0 0
[pid=29398/tid=29420] ppid=29396 vsize=2054068 CPUtime=0.56 cores=0-31
/proc/29398/task/29420/stat : 29420 (claspmt) D 29396 29398 29368 0 -1 4202560 4877 0 0 0 4 52 0 0 17 0 32 0 28862434 2103365632 155878 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29398/tid=29421] ppid=29396 vsize=2054068 CPUtime=0.51 cores=0-31
/proc/29398/task/29421/stat : 29421 (claspmt) D 29396 29398 29368 0 -1 4202560 5741 0 0 0 5 46 0 0 17 0 32 0 28862434 2103365632 155881 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=29398/tid=29422] ppid=29396 vsize=2054068 CPUtime=0.52 cores=0-31
/proc/29398/task/29422/stat : 29422 (claspmt) D 29396 29398 29368 0 -1 4202560 6037 0 0 0 6 46 0 0 17 0 32 0 28862434 2103365632 155888 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=29398/tid=29423] ppid=29396 vsize=2054068 CPUtime=0.55 cores=0-31
/proc/29398/task/29423/stat : 29423 (claspmt) S 29396 29398 29368 0 -1 4202560 5458 0 0 0 5 50 0 0 17 0 32 0 28862434 2103365632 155893 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604502611893728 0 0 -1 10 0 0 0
[pid=29398/tid=29424] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29424/stat : 29424 (claspmt) S 29396 29398 29368 0 -1 4202560 5470 0 0 0 5 49 0 0 17 0 32 0 28862434 2103365632 155897 270582939648 4194304 4964800 140737325034064 18446744073709551615 258662772457 0 0 4096 18946 18446604498267160032 0 0 -1 24 0 0 0
[pid=29398/tid=29425] ppid=29396 vsize=2054068 CPUtime=0.56 cores=0-31
/proc/29398/task/29425/stat : 29425 (claspmt) D 29396 29398 29368 0 -1 4202560 4850 0 0 0 4 52 0 0 17 0 32 0 28862434 2103365632 155900 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=29398/tid=29426] ppid=29396 vsize=2054068 CPUtime=0.55 cores=0-31
/proc/29398/task/29426/stat : 29426 (claspmt) R 29396 29398 29368 0 -1 4202560 6049 0 0 0 5 50 0 0 17 0 32 0 28862434 2103365632 155903 270582939648 4194304 4964800 140737325034064 18446744073709551615 4652106 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=29398/tid=29427] ppid=29396 vsize=2054068 CPUtime=0.52 cores=0-31
/proc/29398/task/29427/stat : 29427 (claspmt) D 29396 29398 29368 0 -1 4202560 5431 0 0 0 5 47 0 0 17 0 32 0 28862434 2103365632 155908 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=29398/tid=29428] ppid=29396 vsize=2054068 CPUtime=0.57 cores=0-31
/proc/29398/task/29428/stat : 29428 (claspmt) D 29396 29398 29368 0 -1 4202560 5656 0 0 0 5 52 0 0 17 0 32 0 28862434 2103365632 155909 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=29398/tid=29429] ppid=29396 vsize=2054068 CPUtime=0.54 cores=0-31
/proc/29398/task/29429/stat : 29429 (claspmt) R 29396 29398 29368 0 -1 4202560 6217 0 0 0 6 48 0 0 17 0 32 0 28862434 2103365632 155910 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650653361 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=29398/tid=29430] ppid=29396 vsize=2054068 CPUtime=0.56 cores=0-31
/proc/29398/task/29430/stat : 29430 (claspmt) D 29396 29398 29368 0 -1 4202560 6158 0 0 0 6 50 0 0 17 0 32 0 28862435 2103365632 155919 270582939648 4194304 4964800 140737325034064 18446744073709551615 4388416 0 0 4096 18946 0 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 18.62
Current children cumulated vsize (KiB) 2054068

[startup+6.30221 s]
/proc/loadavg: 29.68 31.59 31.89 34/444 29430
/proc/meminfo: memFree=261631192/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=2059480 CPUtime=98.79 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 227661 0 0 0 8298 1581 0 0 21 0 32 0 28862256 2108907520 179450 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669476 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29398/statm: 514870 179451 461 189 0 509219 0
[pid=29398/tid=29400] ppid=29396 vsize=2059480 CPUtime=2.93 cores=0-31
/proc/29398/task/29400/stat : 29400 (claspmt) R 29396 29398 29368 0 -1 4202560 5240 0 0 0 244 49 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=29398/tid=29401] ppid=29396 vsize=2059480 CPUtime=3 cores=0-31
/proc/29398/task/29401/stat : 29401 (claspmt) R 29396 29398 29368 0 -1 4202560 6597 0 0 0 246 54 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29398/tid=29402] ppid=29396 vsize=2059480 CPUtime=3.03 cores=0-31
/proc/29398/task/29402/stat : 29402 (claspmt) R 29396 29398 29368 0 -1 4202560 6892 0 0 0 246 57 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670155 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29398/tid=29403] ppid=29396 vsize=2059480 CPUtime=2.93 cores=0-31
/proc/29398/task/29403/stat : 29403 (claspmt) R 29396 29398 29368 0 -1 4202560 5669 0 0 0 243 50 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670203 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=29398/tid=29404] ppid=29396 vsize=2059480 CPUtime=3.52 cores=0-31
/proc/29398/task/29404/stat : 29404 (claspmt) R 29396 29398 29368 0 -1 4202560 5996 0 0 0 303 49 0 0 23 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=29398/tid=29405] ppid=29396 vsize=2059480 CPUtime=3.03 cores=0-31
/proc/29398/task/29405/stat : 29405 (claspmt) R 29396 29398 29368 0 -1 4202560 7224 0 0 0 248 55 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29398/tid=29406] ppid=29396 vsize=2059480 CPUtime=2.99 cores=0-31
/proc/29398/task/29406/stat : 29406 (claspmt) R 29396 29398 29368 0 -1 4202560 6491 0 0 0 247 52 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668681 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29398/tid=29407] ppid=29396 vsize=2059480 CPUtime=2.92 cores=0-31
/proc/29398/task/29407/stat : 29407 (claspmt) R 29396 29398 29368 0 -1 4202560 5804 0 0 0 243 49 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=29398/tid=29408] ppid=29396 vsize=2059480 CPUtime=2.93 cores=0-31
/proc/29398/task/29408/stat : 29408 (claspmt) R 29396 29398 29368 0 -1 4202560 5641 0 0 0 245 48 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4370384 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29398/tid=29409] ppid=29396 vsize=2059480 CPUtime=2.99 cores=0-31
/proc/29398/task/29409/stat : 29409 (claspmt) R 29396 29398 29368 0 -1 4202560 7388 0 0 0 248 51 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=29398/tid=29410] ppid=29396 vsize=2059480 CPUtime=2.94 cores=0-31
/proc/29398/task/29410/stat : 29410 (claspmt) R 29396 29398 29368 0 -1 4202560 6754 0 0 0 246 48 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=29398/tid=29411] ppid=29396 vsize=2059480 CPUtime=2.9 cores=0-31
/proc/29398/task/29411/stat : 29411 (claspmt) R 29396 29398 29368 0 -1 4202560 5468 0 0 0 243 47 0 0 18 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=29398/tid=29412] ppid=29396 vsize=2059480 CPUtime=3.68 cores=0-31
/proc/29398/task/29412/stat : 29412 (claspmt) R 29396 29398 29368 0 -1 4202560 6023 0 0 0 319 49 0 0 23 0 32 0 28862433 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=29398/tid=29413] ppid=29396 vsize=2059480 CPUtime=3 cores=0-31
/proc/29398/task/29413/stat : 29413 (claspmt) R 29396 29398 29368 0 -1 4202560 6702 0 0 0 245 55 0 0 18 0 32 0 28862434 2108907520 179451 270582939648 4194304 4964800 140737325034064 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=29398/tid=29414] ppid=29396 vsize=2059480 CPUtime=2.96 cores=0-31
/proc/29398/task/29414/stat : 29414 (claspmt) R 29396 29398 29368 0 -1 4202560 6254 0 0 0 246 50 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4365162 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29398/tid=29415] ppid=29396 vsize=2059480 CPUtime=2.93 cores=0-31
/proc/29398/task/29415/stat : 29415 (claspmt) R 29396 29398 29368 0 -1 4202560 5726 0 0 0 242 51 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=29398/tid=29416] ppid=29396 vsize=2059480 CPUtime=2.92 cores=0-31
/proc/29398/task/29416/stat : 29416 (claspmt) R 29396 29398 29368 0 -1 4202560 5569 0 0 0 243 49 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=29398/tid=29417] ppid=29396 vsize=2059480 CPUtime=2.92 cores=0-31
/proc/29398/task/29417/stat : 29417 (claspmt) R 29396 29398 29368 0 -1 4202560 7525 0 0 0 247 45 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=29398/tid=29418] ppid=29396 vsize=2059480 CPUtime=2.98 cores=0-31
/proc/29398/task/29418/stat : 29418 (claspmt) R 29396 29398 29368 0 -1 4202560 7268 0 0 0 246 52 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=29398/tid=29419] ppid=29396 vsize=2059480 CPUtime=2.8 cores=0-31
/proc/29398/task/29419/stat : 29419 (claspmt) R 29396 29398 29368 0 -1 4202560 5819 0 0 0 243 37 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670212 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=29398/tid=29420] ppid=29396 vsize=2059480 CPUtime=3.69 cores=0-31
/proc/29398/task/29420/stat : 29420 (claspmt) R 29396 29398 29368 0 -1 4202560 5684 0 0 0 315 54 0 0 24 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29398/tid=29421] ppid=29396 vsize=2059480 CPUtime=2.96 cores=0-31
/proc/29398/task/29421/stat : 29421 (claspmt) R 29396 29398 29368 0 -1 4202560 7310 0 0 0 247 49 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=29398/tid=29422] ppid=29396 vsize=2059480 CPUtime=2.95 cores=0-31
/proc/29398/task/29422/stat : 29422 (claspmt) R 29396 29398 29368 0 -1 4202560 6413 0 0 0 248 47 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=29398/tid=29423] ppid=29396 vsize=2059480 CPUtime=2.94 cores=0-31
/proc/29398/task/29423/stat : 29423 (claspmt) R 29396 29398 29368 0 -1 4202560 5708 0 0 0 243 51 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=29398/tid=29424] ppid=29396 vsize=2059480 CPUtime=2.93 cores=0-31
/proc/29398/task/29424/stat : 29424 (claspmt) R 29396 29398 29368 0 -1 4202560 5707 0 0 0 243 50 0 0 18 0 32 0 28862434 2108907520 179452 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 24 0 0 0

################
# More data... #
################

[pid=29398/tid=29407] ppid=29396 vsize=7070760 CPUtime=4957.88 cores=0-31
/proc/29398/task/29407/stat : 29407 (claspmt) R 29396 29398 29368 0 -1 4202560 13701 0 0 0 495703 85 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=29398/tid=29408] ppid=29396 vsize=7070760 CPUtime=4940.11 cores=0-31
/proc/29398/task/29408/stat : 29408 (claspmt) R 29396 29398 29368 0 -1 4202560 17978 0 0 0 493918 93 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=29398/tid=29409] ppid=29396 vsize=7070760 CPUtime=4957.95 cores=0-31
/proc/29398/task/29409/stat : 29409 (claspmt) R 29396 29398 29368 0 -1 4202560 60280 0 0 0 495551 244 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=29398/tid=29410] ppid=29396 vsize=7070760 CPUtime=4957.9 cores=0-31
/proc/29398/task/29410/stat : 29410 (claspmt) R 29396 29398 29368 0 -1 4202560 19827 0 0 0 495696 94 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=29398/tid=29411] ppid=29396 vsize=7070760 CPUtime=4954.44 cores=0-31
/proc/29398/task/29411/stat : 29411 (claspmt) R 29396 29398 29368 0 -1 4202560 51359 0 0 0 495198 246 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=29398/tid=29412] ppid=29396 vsize=7070760 CPUtime=4954.04 cores=0-31
/proc/29398/task/29412/stat : 29412 (claspmt) R 29396 29398 29368 0 -1 4202560 53790 0 0 0 495163 241 0 0 25 0 32 0 28862433 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668681 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=29398/tid=29413] ppid=29396 vsize=7070760 CPUtime=4957.16 cores=0-31
/proc/29398/task/29413/stat : 29413 (claspmt) R 29396 29398 29368 0 -1 4202560 21448 0 0 0 495609 107 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=29398/tid=29414] ppid=29396 vsize=7070760 CPUtime=4957.83 cores=0-31
/proc/29398/task/29414/stat : 29414 (claspmt) R 29396 29398 29368 0 -1 4202560 188171 0 0 0 495023 760 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29398/tid=29415] ppid=29396 vsize=7070760 CPUtime=4957.66 cores=0-31
/proc/29398/task/29415/stat : 29415 (claspmt) R 29396 29398 29368 0 -1 4202560 18840 0 0 0 495659 107 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=29398/tid=29416] ppid=29396 vsize=7070760 CPUtime=4956.76 cores=0-31
/proc/29398/task/29416/stat : 29416 (claspmt) R 29396 29398 29368 0 -1 4202560 18791 0 0 0 495586 90 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=29398/tid=29417] ppid=29396 vsize=7070760 CPUtime=4957.89 cores=0-31
/proc/29398/task/29417/stat : 29417 (claspmt) R 29396 29398 29368 0 -1 4202560 57829 0 0 0 495573 216 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=29398/tid=29418] ppid=29396 vsize=7070760 CPUtime=4956.4 cores=0-31
/proc/29398/task/29418/stat : 29418 (claspmt) R 29396 29398 29368 0 -1 4202560 22882 0 0 0 495484 156 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=29398/tid=29419] ppid=29396 vsize=7070760 CPUtime=4957.73 cores=0-31
/proc/29398/task/29419/stat : 29419 (claspmt) R 29396 29398 29368 0 -1 4202560 55002 0 0 0 495521 252 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=29398/tid=29420] ppid=29396 vsize=7070760 CPUtime=4958.42 cores=0-31
/proc/29398/task/29420/stat : 29420 (claspmt) R 29396 29398 29368 0 -1 4202560 39466 0 0 0 495656 186 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29398/tid=29421] ppid=29396 vsize=7070760 CPUtime=4957.9 cores=0-31
/proc/29398/task/29421/stat : 29421 (claspmt) R 29396 29398 29368 0 -1 4202560 21685 0 0 0 495681 109 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669493 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=29398/tid=29422] ppid=29396 vsize=7070760 CPUtime=4955.76 cores=0-31
/proc/29398/task/29422/stat : 29422 (claspmt) R 29396 29398 29368 0 -1 4202560 153944 0 0 0 494919 657 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29398/tid=29423] ppid=29396 vsize=7070760 CPUtime=4957.9 cores=0-31
/proc/29398/task/29423/stat : 29423 (claspmt) R 29396 29398 29368 0 -1 4202560 17859 0 0 0 495689 101 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=29398/tid=29424] ppid=29396 vsize=7070760 CPUtime=4957.74 cores=0-31
/proc/29398/task/29424/stat : 29424 (claspmt) R 29396 29398 29368 0 -1 4202560 22634 0 0 0 495668 106 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=29398/tid=29425] ppid=29396 vsize=7070760 CPUtime=4953.98 cores=0-31
/proc/29398/task/29425/stat : 29425 (claspmt) R 29396 29398 29368 0 -1 4202560 58765 0 0 0 495141 257 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29398/tid=29426] ppid=29396 vsize=7070760 CPUtime=4957.02 cores=0-31
/proc/29398/task/29426/stat : 29426 (claspmt) R 29396 29398 29368 0 -1 4202560 18527 0 0 0 495612 90 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=29398/tid=29427] ppid=29396 vsize=7070760 CPUtime=4957.86 cores=0-31
/proc/29398/task/29427/stat : 29427 (claspmt) R 29396 29398 29368 0 -1 4202560 60109 0 0 0 495514 272 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=29398/tid=29428] ppid=29396 vsize=7070760 CPUtime=4957.89 cores=0-31
/proc/29398/task/29428/stat : 29428 (claspmt) R 29396 29398 29368 0 -1 4202560 40595 0 0 0 495615 174 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=29398/tid=29429] ppid=29396 vsize=7070760 CPUtime=4956.67 cores=0-31
/proc/29398/task/29429/stat : 29429 (claspmt) R 29396 29398 29368 0 -1 4202560 21844 0 0 0 495570 97 0 0 25 0 32 0 28862434 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29398/tid=29430] ppid=29396 vsize=7070760 CPUtime=4957.87 cores=0-31
/proc/29398/task/29430/stat : 29430 (claspmt) R 29396 29398 29368 0 -1 4202560 157004 0 0 0 495097 690 0 0 25 0 32 0 28862435 7240458240 1556282 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 158511
Current children cumulated vsize (KiB) 7070760



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5008.9 s]
/proc/loadavg: 32.06 32.08 32.07 33/444 29585
/proc/meminfo: memFree=256107740/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=7070760 CPUtime=160001 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 1609915 0 0 0 15993008 7089 0 0 25 0 32 0 28862256 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29398/statm: 1767690 1557060 463 189 0 1762039 0
[pid=29398/tid=29400] ppid=29396 vsize=7070760 CPUtime=5004.36 cores=0-31
/proc/29398/task/29400/stat : 29400 (claspmt) R 29396 29398 29368 0 -1 4202560 13853 0 0 0 500359 77 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=29398/tid=29401] ppid=29396 vsize=7070760 CPUtime=5004.53 cores=0-31
/proc/29398/task/29401/stat : 29401 (claspmt) R 29396 29398 29368 0 -1 4202560 52627 0 0 0 500235 218 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29398/tid=29402] ppid=29396 vsize=7070760 CPUtime=4974.91 cores=0-31
/proc/29398/task/29402/stat : 29402 (claspmt) R 29396 29398 29368 0 -1 4202560 23272 0 0 0 497373 118 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=29398/tid=29403] ppid=29396 vsize=7070760 CPUtime=4964.54 cores=0-31
/proc/29398/task/29403/stat : 29403 (claspmt) R 29396 29398 29368 0 -1 4202560 39007 0 0 0 496267 187 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=29398/tid=29404] ppid=29396 vsize=7070760 CPUtime=5003.49 cores=0-31
/proc/29398/task/29404/stat : 29404 (claspmt) R 29396 29398 29368 0 -1 4202560 43979 0 0 0 500151 198 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29398/tid=29405] ppid=29396 vsize=7070760 CPUtime=4968.14 cores=0-31
/proc/29398/task/29405/stat : 29405 (claspmt) R 29396 29398 29368 0 -1 4202560 21913 0 0 0 496705 109 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=29398/tid=29406] ppid=29396 vsize=7070760 CPUtime=5003.61 cores=0-31
/proc/29398/task/29406/stat : 29406 (claspmt) R 29396 29398 29368 0 -1 4202560 161158 0 0 0 499684 677 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=29398/tid=29407] ppid=29396 vsize=7070760 CPUtime=5004.48 cores=0-31
/proc/29398/task/29407/stat : 29407 (claspmt) R 29396 29398 29368 0 -1 4202560 13701 0 0 0 500363 85 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=29398/tid=29408] ppid=29396 vsize=7070760 CPUtime=4986.72 cores=0-31
/proc/29398/task/29408/stat : 29408 (claspmt) R 29396 29398 29368 0 -1 4202560 17981 0 0 0 498579 93 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=29398/tid=29409] ppid=29396 vsize=7070760 CPUtime=5004.56 cores=0-31
/proc/29398/task/29409/stat : 29409 (claspmt) R 29396 29398 29368 0 -1 4202560 60280 0 0 0 500212 244 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=29398/tid=29410] ppid=29396 vsize=7070760 CPUtime=5004.51 cores=0-31
/proc/29398/task/29410/stat : 29410 (claspmt) R 29396 29398 29368 0 -1 4202560 19828 0 0 0 500357 94 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=29398/tid=29411] ppid=29396 vsize=7070760 CPUtime=5001.05 cores=0-31
/proc/29398/task/29411/stat : 29411 (claspmt) R 29396 29398 29368 0 -1 4202560 51377 0 0 0 499859 246 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=29398/tid=29412] ppid=29396 vsize=7070760 CPUtime=5000.65 cores=0-31
/proc/29398/task/29412/stat : 29412 (claspmt) R 29396 29398 29368 0 -1 4202560 53790 0 0 0 499824 241 0 0 25 0 32 0 28862433 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=29398/tid=29413] ppid=29396 vsize=7070760 CPUtime=5003.78 cores=0-31
/proc/29398/task/29413/stat : 29413 (claspmt) R 29396 29398 29368 0 -1 4202560 21451 0 0 0 500271 107 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=29398/tid=29414] ppid=29396 vsize=7070760 CPUtime=5004.44 cores=0-31
/proc/29398/task/29414/stat : 29414 (claspmt) R 29396 29398 29368 0 -1 4202560 188171 0 0 0 499684 760 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29398/tid=29415] ppid=29396 vsize=7070760 CPUtime=5004.27 cores=0-31
/proc/29398/task/29415/stat : 29415 (claspmt) R 29396 29398 29368 0 -1 4202560 18840 0 0 0 500320 107 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=29398/tid=29416] ppid=29396 vsize=7070760 CPUtime=5003.35 cores=0-31
/proc/29398/task/29416/stat : 29416 (claspmt) R 29396 29398 29368 0 -1 4202560 18791 0 0 0 500245 90 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=29398/tid=29417] ppid=29396 vsize=7070760 CPUtime=5004.51 cores=0-31
/proc/29398/task/29417/stat : 29417 (claspmt) R 29396 29398 29368 0 -1 4202560 57831 0 0 0 500235 216 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=29398/tid=29418] ppid=29396 vsize=7070760 CPUtime=5002.99 cores=0-31
/proc/29398/task/29418/stat : 29418 (claspmt) R 29396 29398 29368 0 -1 4202560 22887 0 0 0 500143 156 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=29398/tid=29419] ppid=29396 vsize=7070760 CPUtime=5004.34 cores=0-31
/proc/29398/task/29419/stat : 29419 (claspmt) R 29396 29398 29368 0 -1 4202560 55008 0 0 0 500182 252 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=29398/tid=29420] ppid=29396 vsize=7070760 CPUtime=5005.03 cores=0-31
/proc/29398/task/29420/stat : 29420 (claspmt) R 29396 29398 29368 0 -1 4202560 39501 0 0 0 500317 186 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29398/tid=29421] ppid=29396 vsize=7070760 CPUtime=5004.51 cores=0-31
/proc/29398/task/29421/stat : 29421 (claspmt) R 29396 29398 29368 0 -1 4202560 21685 0 0 0 500342 109 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=29398/tid=29422] ppid=29396 vsize=7070760 CPUtime=5002.38 cores=0-31
/proc/29398/task/29422/stat : 29422 (claspmt) R 29396 29398 29368 0 -1 4202560 153944 0 0 0 499581 657 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669490 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29398/tid=29423] ppid=29396 vsize=7070760 CPUtime=5004.51 cores=0-31
/proc/29398/task/29423/stat : 29423 (claspmt) R 29396 29398 29368 0 -1 4202560 17859 0 0 0 500350 101 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=29398/tid=29424] ppid=29396 vsize=7070760 CPUtime=5004.36 cores=0-31
/proc/29398/task/29424/stat : 29424 (claspmt) R 29396 29398 29368 0 -1 4202560 22636 0 0 0 500329 107 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=29398/tid=29425] ppid=29396 vsize=7070760 CPUtime=5000.59 cores=0-31
/proc/29398/task/29425/stat : 29425 (claspmt) R 29396 29398 29368 0 -1 4202560 58768 0 0 0 499802 257 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29398/tid=29426] ppid=29396 vsize=7070760 CPUtime=5003.63 cores=0-31
/proc/29398/task/29426/stat : 29426 (claspmt) R 29396 29398 29368 0 -1 4202560 18527 0 0 0 500273 90 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=29398/tid=29427] ppid=29396 vsize=7070760 CPUtime=5004.47 cores=0-31
/proc/29398/task/29427/stat : 29427 (claspmt) R 29396 29398 29368 0 -1 4202560 60148 0 0 0 500175 272 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=29398/tid=29428] ppid=29396 vsize=7070760 CPUtime=5004.49 cores=0-31
/proc/29398/task/29428/stat : 29428 (claspmt) R 29396 29398 29368 0 -1 4202560 40595 0 0 0 500275 174 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=29398/tid=29429] ppid=29396 vsize=7070760 CPUtime=5003.28 cores=0-31
/proc/29398/task/29429/stat : 29429 (claspmt) R 29396 29398 29368 0 -1 4202560 21844 0 0 0 500231 97 0 0 25 0 32 0 28862434 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29398/tid=29430] ppid=29396 vsize=7070760 CPUtime=5004.48 cores=0-31
/proc/29398/task/29430/stat : 29430 (claspmt) R 29396 29398 29368 0 -1 4202560 157004 0 0 0 499758 690 0 0 25 0 32 0 28862435 7240458240 1557060 270582939648 4194304 4964800 140737325034064 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 7070760

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -29398

Solver just ended. Dumping a history of the last processes samples

[startup+5009.54 s]
/proc/loadavg: 32.06 32.08 32.07 2/414 29586
/proc/meminfo: memFree=256135260/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=6944600 CPUtime=160002 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 1609928 0 0 0 15993102 7089 0 0 25 0 1 0 28862256 7111270400 1548039 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650610907 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/29398/statm: 1736150 1548039 474 189 0 1730499 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 6944600

[startup+5010.3 s]
/proc/loadavg: 32.06 32.08 32.07 2/414 29586
/proc/meminfo: memFree=256135260/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=6913912 CPUtime=160003 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4202496 1609928 0 0 0 15993178 7089 0 0 25 0 1 0 28862256 7079845888 1540283 270582939648 4194304 4964800 140737325034064 18446744073709551615 258650610907 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/29398/statm: 1728478 1540283 474 189 0 1722827 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 6913912

[startup+5011.1 s]
/proc/loadavg: 32.06 32.08 32.07 2/414 29586
/proc/meminfo: memFree=256195804/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=0 CPUtime=160003 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4203524 1609928 0 0 0 15993241 7107 0 0 25 0 1 0 28862256 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29398/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5011.3 s]
/proc/loadavg: 32.06 32.08 32.07 2/414 29586
/proc/meminfo: memFree=256195804/264257624 swapFree=67111528/67111528
[pid=29398] ppid=29396 vsize=0 CPUtime=160004 cores=0-31
/proc/29398/stat : 29398 (claspmt) R 29396 29398 29368 0 -1 4203524 1609928 0 0 0 15993241 7127 0 0 25 0 1 0 28862256 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29398/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 5011.34
CPU time (s): 160004
CPU user time (s): 159932
CPU system time (s): 71.3072
CPU usage (%): 3192.83
Max. virtual memory (cumulated for all children) (KiB): 7070760

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159932
system time used= 71.3072
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1609928
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 221776
involuntary context switches= 396384

runsolver used 28.1747 second user time and 113.174 second system time

The end

Launcher Data 

Begin job on node200 at 2011-06-09 17:52:34
IDJOB=3472418
IDBENCH=82468
IDSOLVER=1961
FILE ID=node200/3472418-1307634753
RUNJOBID= node200-1307634753-29382
PBS_JOBID= 13547779
Free space on /tmp= 61736 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3472418-1307634753/watcher-3472418-1307634753 -o /tmp/evaluation-result-3472418-1307634753/solver-3472418-1307634753 -C 160000 -W 5100 -M 256000  HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472418-1307634753.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 256000 MiB
NBCORE= 32

MD5SUM BENCH= a0ec1baa890da62d0c6df7f1e62c6af3
RANDOM SEED=189267920

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      262341608 kB
Buffers:        233588 kB
Cached:        1387784 kB
SwapCached:          0 kB
Active:         257180 kB
Inactive:      1427548 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      262341608 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            9552 kB
Writeback:           0 kB
AnonPages:       63500 kB
Mapped:          14396 kB
Slab:           151788 kB
PageTables:       4428 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   160260 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61732 MiB
End job on node200 at 2011-06-09 19:16:05