Trace number 3472382

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 20522 5102.18

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUM6c2d25eda70423643946d76935ceb950
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1512832
Number of clauses8233086
Sum of the clauses size19530286
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 28165680
Number of clauses of size 31280
Number of clauses of size 41600
Number of clauses of size 51600
Number of clauses of size over 562080

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...594563/instance-3472382-1307594563.cnf
3.09/3.13	c Solving...
20519.84/5100.02	
20519.84/5100.02	*** INTERRUPTED! ***
20519.84/5100.02	*** Shutting down threads...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3472382-1307594563/watcher-3472382-1307594563 -o /tmp/evaluation-result-3472382-1307594563/solver-3472382-1307594563 -C 160000 -W 5100 -M 256000 HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472382-1307594563.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 262144000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 262195200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 18.83 8.89 8.20 1/413 25840
/proc/meminfo: memFree=262448756/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=212944 CPUtime=0.02 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 3955 0 0 0 2 0 0 0 21 0 1 0 24843894 218054656 3884 270582939648 4194304 4964800 140736103120848 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 53236 3893 373 189 0 48110 0

[startup+0.116692 s]
/proc/loadavg: 18.83 8.89 8.20 1/413 25840
/proc/meminfo: memFree=262448756/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=212944 CPUtime=0.1 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 16970 0 0 0 8 2 0 0 21 0 1 0 24843894 218054656 16899 270582939648 4194304 4964800 140736103120848 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 53236 16910 373 189 0 48110 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 212944

[startup+0.200717 s]
/proc/loadavg: 18.83 8.89 8.20 1/413 25840
/proc/meminfo: memFree=262448756/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=212944 CPUtime=0.19 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 30516 0 0 0 14 5 0 0 21 0 1 0 24843894 218054656 30445 270582939648 4194304 4964800 140736103120848 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 53236 30455 373 189 0 48110 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 212944

[startup+0.300698 s]
/proc/loadavg: 18.83 8.89 8.20 1/413 25840
/proc/meminfo: memFree=262448756/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=212944 CPUtime=0.29 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 46701 0 0 0 21 8 0 0 22 0 1 0 24843894 218054656 46630 270582939648 4194304 4964800 140736103120848 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 53236 46639 373 189 0 48110 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 212944

[startup+0.700714 s]
/proc/loadavg: 18.83 8.89 8.20 1/413 25840
/proc/meminfo: memFree=262448756/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=320156 CPUtime=0.68 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 85767 0 0 0 53 15 0 0 23 0 1 0 24843894 327839744 73877 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650955760 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 80039 73877 387 189 0 74913 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 320156

[startup+1.50074 s]
/proc/loadavg: 18.83 8.89 8.20 2/414 25841
/proc/meminfo: memFree=262139244/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=352168 CPUtime=1.49 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 93836 0 0 0 128 21 0 0 25 0 1 0 24843894 360620032 81913 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650955760 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 88042 81914 387 189 0 82916 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 352168

[startup+3.10081 s]
/proc/loadavg: 18.83 8.89 8.20 2/414 25841
/proc/meminfo: memFree=262091264/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=472584 CPUtime=3.09 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 139374 0 0 0 274 35 0 0 25 0 1 0 24843894 483926016 112071 270582939648 4194304 4964800 140736103120848 18446744073709551615 4692747 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 118146 112071 398 189 0 113020 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 472584

[startup+6.30177 s]
/proc/loadavg: 19.80 9.26 8.32 32/445 25872
/proc/meminfo: memFree=260496576/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=3423052 CPUtime=99.9 cores=0-31
/proc/25840/stat : 25840 (claspmt) S 25838 25840 25708 0 -1 4202496 860216 0 0 0 531 9459 0 0 18 0 32 0 24843894 3505205248 584853 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/25840/statm: 855763 584853 423 189 0 850112 0
[pid=25840/tid=25842] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25842/stat : 25842 (claspmt) R 25838 25840 25708 0 -1 4202560 25297 0 0 0 10 302 0 0 25 0 32 0 24844209 3505205248 584861 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=25840/tid=25843] ppid=25838 vsize=3423052 CPUtime=3.13 cores=0-31
/proc/25840/task/25843/stat : 25843 (claspmt) R 25838 25840 25708 0 -1 4202560 11681 0 0 0 5 308 0 0 24 0 32 0 24844209 3505205248 584865 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25840/tid=25844] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25844/stat : 25844 (claspmt) R 25838 25840 25708 0 -1 4202560 12561 0 0 0 3 309 0 0 24 0 32 0 24844209 3505205248 584865 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25840/tid=25845] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25845/stat : 25845 (claspmt) R 25838 25840 25708 0 -1 4202560 27566 0 0 0 10 302 0 0 24 0 32 0 24844209 3505205248 584873 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=25840/tid=25846] ppid=25838 vsize=3423052 CPUtime=3.08 cores=0-31
/proc/25840/task/25846/stat : 25846 (claspmt) R 25838 25840 25708 0 -1 4202560 24059 0 0 0 7 301 0 0 25 0 32 0 24844209 3505205248 584878 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=25840/tid=25847] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25847/stat : 25847 (claspmt) R 25838 25840 25708 0 -1 4202560 26511 0 0 0 5 307 0 0 24 0 32 0 24844209 3505205248 584878 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=25840/tid=25848] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25848/stat : 25848 (claspmt) R 25838 25840 25708 0 -1 4202560 20384 0 0 0 7 305 0 0 24 0 32 0 24844209 3505205248 584880 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=25840/tid=25849] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25849/stat : 25849 (claspmt) R 25838 25840 25708 0 -1 4202560 21354 0 0 0 6 306 0 0 25 0 32 0 24844209 3505205248 584889 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=25840/tid=25850] ppid=25838 vsize=3423052 CPUtime=3.13 cores=0-31
/proc/25840/task/25850/stat : 25850 (claspmt) R 25838 25840 25708 0 -1 4202560 23586 0 0 0 9 304 0 0 25 0 32 0 24844210 3505205248 584889 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25840/tid=25851] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25851/stat : 25851 (claspmt) R 25838 25840 25708 0 -1 4202560 12130 0 0 0 3 309 0 0 25 0 32 0 24844210 3505205248 584891 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25840/tid=25852] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25852/stat : 25852 (claspmt) R 25838 25840 25708 0 -1 4202560 26151 0 0 0 10 302 0 0 25 0 32 0 24844210 3505205248 584899 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=25840/tid=25853] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25853/stat : 25853 (claspmt) R 25838 25840 25708 0 -1 4202560 26076 0 0 0 8 304 0 0 24 0 32 0 24844210 3505205248 584899 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=25840/tid=25854] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25854/stat : 25854 (claspmt) R 25838 25840 25708 0 -1 4202560 21901 0 0 0 8 304 0 0 24 0 32 0 24844210 3505205248 584899 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=25840/tid=25855] ppid=25838 vsize=3423052 CPUtime=3.13 cores=0-31
/proc/25840/task/25855/stat : 25855 (claspmt) R 25838 25840 25708 0 -1 4202560 25929 0 0 0 11 302 0 0 25 0 32 0 24844210 3505205248 584909 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=25840/tid=25856] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25856/stat : 25856 (claspmt) R 25838 25840 25708 0 -1 4202560 23096 0 0 0 9 303 0 0 24 0 32 0 24844210 3505205248 584909 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=25840/tid=25857] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25857/stat : 25857 (claspmt) R 25838 25840 25708 0 -1 4202560 21201 0 0 0 7 305 0 0 24 0 32 0 24844210 3505205248 584909 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25840/tid=25858] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25858/stat : 25858 (claspmt) R 25838 25840 25708 0 -1 4202560 23411 0 0 0 8 304 0 0 24 0 32 0 24844210 3505205248 584924 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25840/tid=25859] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25859/stat : 25859 (claspmt) R 25838 25840 25708 0 -1 4202560 26474 0 0 0 7 305 0 0 24 0 32 0 24844210 3505205248 584924 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=25840/tid=25860] ppid=25838 vsize=3423052 CPUtime=3.1 cores=0-31
/proc/25840/task/25860/stat : 25860 (claspmt) R 25838 25840 25708 0 -1 4202560 23264 0 0 0 8 302 0 0 25 0 32 0 24844210 3505205248 584924 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=25840/tid=25861] ppid=25838 vsize=3423052 CPUtime=3.13 cores=0-31
/proc/25840/task/25861/stat : 25861 (claspmt) R 25838 25840 25708 0 -1 4202560 25839 0 0 0 5 308 0 0 24 0 32 0 24844210 3505205248 584937 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=25840/tid=25862] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25862/stat : 25862 (claspmt) R 25838 25840 25708 0 -1 4202560 30689 0 0 0 12 300 0 0 24 0 32 0 24844210 3505205248 584939 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=25840/tid=25863] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25863/stat : 25863 (claspmt) R 25838 25840 25708 0 -1 4202560 22281 0 0 0 8 304 0 0 25 0 32 0 24844210 3505205248 584939 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=25840/tid=25864] ppid=25838 vsize=3423052 CPUtime=3.13 cores=0-31
/proc/25840/task/25864/stat : 25864 (claspmt) R 25838 25840 25708 0 -1 4202560 28361 0 0 0 10 303 0 0 25 0 32 0 24844210 3505205248 584947 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25840/tid=25865] ppid=25838 vsize=3423052 CPUtime=3.1 cores=0-31
/proc/25840/task/25865/stat : 25865 (claspmt) R 25838 25840 25708 0 -1 4202560 26109 0 0 0 8 302 0 0 24 0 32 0 24844210 3505205248 584951 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=25840/tid=25866] ppid=25838 vsize=3423052 CPUtime=3.11 cores=0-31
/proc/25840/task/25866/stat : 25866 (claspmt) R 25838 25840 25708 0 -1 4202560 26329 0 0 0 11 300 0 0 24 0 32 0 24844210 3505205248 584951 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=25840/tid=25867] ppid=25838 vsize=3423052 CPUtime=3.1 cores=0-31
/proc/25840/task/25867/stat : 25867 (claspmt) R 25838 25840 25708 0 -1 4202560 26144 0 0 0 9 301 0 0 24 0 32 0 24844210 3505205248 584957 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=25840/tid=25868] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25868/stat : 25868 (claspmt) R 25838 25840 25708 0 -1 4202560 23139 0 0 0 8 304 0 0 24 0 32 0 24844210 3505205248 584961 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=25840/tid=25869] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25869/stat : 25869 (claspmt) R 25838 25840 25708 0 -1 4202560 25706 0 0 0 5 307 0 0 25 0 32 0 24844210 3505205248 584961 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=25840/tid=25870] ppid=25838 vsize=3423052 CPUtime=3.12 cores=0-31
/proc/25840/task/25870/stat : 25870 (claspmt) R 25838 25840 25708 0 -1 4202560 14917 0 0 0 5 307 0 0 24 0 32 0 24844210 3505205248 584966 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679151 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25840/tid=25871] ppid=25838 vsize=3423052 CPUtime=3.1 cores=0-31
/proc/25840/task/25871/stat : 25871 (claspmt) R 25838 25840 25708 0 -1 4202560 26144 0 0 0 9 301 0 0 25 0 32 0 24844210 3505205248 584973 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=25840/tid=25872] ppid=25838 vsize=3423052 CPUtime=2.96 cores=0-31
/proc/25840/task/25872/stat : 25872 (claspmt) R 25838 25840 25708 0 -1 4202560 22564 0 0 0 7 289 0 0 25 0 32 0 24844210 3505205248 584973 270582939648 4194304 4964800 140736103120848 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 21 0 0 0
Current children cumulated CPU time (s) 99.9
Current children cumulated vsize (KiB) 3423052

[startup+12.703 s]
/proc/loadavg: 20.38 9.55 8.42 4/445 25872
/proc/meminfo: memFree=257939916/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=5334456 CPUtime=168.26 cores=0-31
/proc/25840/stat : 25840 (claspmt) S 25838 25840 25708 0 -1 4202496 1615516 0 0 0 2032 14794 0 0 18 0 32 0 24843894 5462482944 1159890 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/25840/statm: 1333614 1159900 433 189 0 1327963 0
[pid=25840/tid=25842] ppid=25838 vsize=5334456 CPUtime=4.75 cores=0-31
/proc/25840/task/25842/stat : 25842 (claspmt) S 25838 25840 25708 0 -1 4202560 39935 0 0 0 27 448 0 0 18 0 32 0 24844209 5462482944 1159901 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995246560 0 0 -1 13 0 0 0
[pid=25840/tid=25843] ppid=25838 vsize=5334456 CPUtime=5.54 cores=0-31
/proc/25840/task/25843/stat : 25843 (claspmt) R 25838 25840 25708 0 -1 4202560 43675 0 0 0 46 508 0 0 18 0 32 0 24844209 5462482944 1159906 270582939648 4194304 4964800 140736103120848 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25840/tid=25844] ppid=25838 vsize=5334456 CPUtime=5.57 cores=0-31
/proc/25840/task/25844/stat : 25844 (claspmt) R 25838 25840 25708 0 -1 4202560 44322 0 0 0 43 514 0 0 18 0 32 0 24844209 5462482944 1159912 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650653299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25840/tid=25845] ppid=25838 vsize=5334456 CPUtime=4.36 cores=0-31
/proc/25840/task/25845/stat : 25845 (claspmt) S 25838 25840 25708 0 -1 4202560 39809 0 0 0 22 414 0 0 18 0 32 0 24844209 5462482944 1159912 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604571714690528 0 0 -1 23 0 0 0
[pid=25840/tid=25846] ppid=25838 vsize=5334456 CPUtime=5.37 cores=0-31
/proc/25840/task/25846/stat : 25846 (claspmt) D 25838 25840 25708 0 -1 4202560 49851 0 0 0 41 496 0 0 18 0 32 0 24844209 5462482944 1159912 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=25840/tid=25847] ppid=25838 vsize=5334456 CPUtime=5.7 cores=0-31
/proc/25840/task/25847/stat : 25847 (claspmt) S 25838 25840 25708 0 -1 4202560 60484 0 0 0 97 473 0 0 18 0 32 0 24844209 5462482944 1159914 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498229280224 0 0 -1 8 0 0 0
[pid=25840/tid=25848] ppid=25838 vsize=5334456 CPUtime=5.61 cores=0-31
/proc/25840/task/25848/stat : 25848 (claspmt) D 25838 25840 25708 0 -1 4202560 48824 0 0 0 54 507 0 0 18 0 32 0 24844209 5462482944 1159918 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=25840/tid=25849] ppid=25838 vsize=5334456 CPUtime=4.94 cores=0-31
/proc/25840/task/25849/stat : 25849 (claspmt) S 25838 25840 25708 0 -1 4202560 39818 0 0 0 25 469 0 0 18 0 32 0 24844209 5462482944 1159923 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504872762848 0 0 -1 20 0 0 0
[pid=25840/tid=25850] ppid=25838 vsize=5334456 CPUtime=4.84 cores=0-31
/proc/25840/task/25850/stat : 25850 (claspmt) S 25838 25840 25708 0 -1 4202560 39871 0 0 0 24 460 0 0 18 0 32 0 24844210 5462482944 1159924 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502183009760 0 0 -1 6 0 0 0
[pid=25840/tid=25851] ppid=25838 vsize=5334456 CPUtime=5.53 cores=0-31
/proc/25840/task/25851/stat : 25851 (claspmt) R 25838 25840 25708 0 -1 4202560 44618 0 0 0 43 510 0 0 18 0 32 0 24844210 5462482944 1159933 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650653289 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25840/tid=25852] ppid=25838 vsize=5334456 CPUtime=5.7 cores=0-31
/proc/25840/task/25852/stat : 25852 (claspmt) D 25838 25840 25708 0 -1 4202560 57604 0 0 0 85 485 0 0 18 0 32 0 24844210 5462482944 1159936 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650653381 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=25840/tid=25853] ppid=25838 vsize=5334456 CPUtime=4.64 cores=0-31
/proc/25840/task/25853/stat : 25853 (claspmt) S 25838 25840 25708 0 -1 4202560 39860 0 0 0 20 444 0 0 18 0 32 0 24844210 5462482944 1159936 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483521207776 0 0 -1 18 0 0 0
[pid=25840/tid=25854] ppid=25838 vsize=5334456 CPUtime=5.47 cores=0-31
/proc/25840/task/25854/stat : 25854 (claspmt) R 25838 25840 25708 0 -1 4202560 47523 0 0 0 40 507 0 0 18 0 32 0 24844210 5462482944 1159941 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=25840/tid=25855] ppid=25838 vsize=5334456 CPUtime=5.86 cores=0-31
/proc/25840/task/25855/stat : 25855 (claspmt) S 25838 25840 25708 0 -1 4202560 57385 0 0 0 103 483 0 0 18 0 32 0 24844210 5462482944 1159942 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483408436704 0 0 -1 11 0 0 0
[pid=25840/tid=25856] ppid=25838 vsize=5334456 CPUtime=5.71 cores=0-31
/proc/25840/task/25856/stat : 25856 (claspmt) R 25838 25840 25708 0 -1 4202560 49549 0 0 0 67 504 0 0 18 0 32 0 24844210 5462482944 1159942 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=25840/tid=25857] ppid=25838 vsize=5334456 CPUtime=4.86 cores=0-31
/proc/25840/task/25857/stat : 25857 (claspmt) S 25838 25840 25708 0 -1 4202560 38591 0 0 0 23 463 0 0 18 0 32 0 24844210 5462482944 1159945 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995271136 0 0 -1 5 0 0 0
[pid=25840/tid=25858] ppid=25838 vsize=5334456 CPUtime=4.76 cores=0-31
/proc/25840/task/25858/stat : 25858 (claspmt) S 25838 25840 25708 0 -1 4202560 38997 0 0 0 26 450 0 0 18 0 32 0 24844210 5462482944 1159949 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851856864 0 0 -1 4 0 0 0
[pid=25840/tid=25859] ppid=25838 vsize=5334456 CPUtime=5.81 cores=0-31
/proc/25840/task/25859/stat : 25859 (claspmt) R 25838 25840 25708 0 -1 4202560 60630 0 0 0 93 488 0 0 18 0 32 0 24844210 5462482944 1159953 270582939648 4194304 4964800 140736103120848 18446744073709551615 4376590 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=25840/tid=25860] ppid=25838 vsize=5334456 CPUtime=5.76 cores=0-31
/proc/25840/task/25860/stat : 25860 (claspmt) R 25838 25840 25708 0 -1 4202560 53880 0 0 0 80 496 0 0 18 0 32 0 24844210 5462482944 1159962 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650653381 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=25840/tid=25861] ppid=25838 vsize=5334456 CPUtime=4.59 cores=0-31
/proc/25840/task/25861/stat : 25861 (claspmt) S 25838 25840 25708 0 -1 4202560 39766 0 0 0 18 441 0 0 18 0 32 0 24844210 5462482944 1159963 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501456297440 0 0 -1 24 0 0 0
[pid=25840/tid=25862] ppid=25838 vsize=5334456 CPUtime=5.79 cores=0-31

################
# More data... #
################

[pid=25840/tid=25849] ppid=25838 vsize=5798556 CPUtime=4.94 cores=0-31
/proc/25840/task/25849/stat : 25849 (claspmt) S 25838 25840 25708 0 -1 4202560 39818 0 0 0 25 469 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504872762848 0 0 -1 20 0 0 0
[pid=25840/tid=25850] ppid=25838 vsize=5798556 CPUtime=4.84 cores=0-31
/proc/25840/task/25850/stat : 25850 (claspmt) S 25838 25840 25708 0 -1 4202560 39871 0 0 0 24 460 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502183009760 0 0 -1 6 0 0 0
[pid=25840/tid=25851] ppid=25838 vsize=5798556 CPUtime=6.11 cores=0-31
/proc/25840/task/25851/stat : 25851 (claspmt) S 25838 25840 25708 0 -1 4202560 50715 0 0 0 97 514 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498416057824 0 0 -1 0 0 0 0
[pid=25840/tid=25852] ppid=25838 vsize=5798556 CPUtime=5.91 cores=0-31
/proc/25840/task/25852/stat : 25852 (claspmt) S 25838 25840 25708 0 -1 4202560 59051 0 0 0 104 487 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604499343146464 0 0 -1 25 0 0 0
[pid=25840/tid=25853] ppid=25838 vsize=5798556 CPUtime=4.64 cores=0-31
/proc/25840/task/25853/stat : 25853 (claspmt) S 25838 25840 25708 0 -1 4202560 39860 0 0 0 20 444 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483521207776 0 0 -1 18 0 0 0
[pid=25840/tid=25854] ppid=25838 vsize=5798556 CPUtime=5073.88 cores=0-31
/proc/25840/task/25854/stat : 25854 (claspmt) R 25838 25840 25708 0 -1 4202560 65160 0 0 0 506832 556 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=25840/tid=25855] ppid=25838 vsize=5798556 CPUtime=5.86 cores=0-31
/proc/25840/task/25855/stat : 25855 (claspmt) S 25838 25840 25708 0 -1 4202560 57385 0 0 0 103 483 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483408436704 0 0 -1 11 0 0 0
[pid=25840/tid=25856] ppid=25838 vsize=5798556 CPUtime=6.65 cores=0-31
/proc/25840/task/25856/stat : 25856 (claspmt) S 25838 25840 25708 0 -1 4202560 53459 0 0 0 148 517 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604503756709344 0 0 -1 14 0 0 0
[pid=25840/tid=25857] ppid=25838 vsize=5798556 CPUtime=4.86 cores=0-31
/proc/25840/task/25857/stat : 25857 (claspmt) S 25838 25840 25708 0 -1 4202560 38591 0 0 0 23 463 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995271136 0 0 -1 5 0 0 0
[pid=25840/tid=25858] ppid=25838 vsize=5798556 CPUtime=4.76 cores=0-31
/proc/25840/task/25858/stat : 25858 (claspmt) S 25838 25840 25708 0 -1 4202560 38997 0 0 0 26 450 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851856864 0 0 -1 4 0 0 0
[pid=25840/tid=25859] ppid=25838 vsize=5798556 CPUtime=5.87 cores=0-31
/proc/25840/task/25859/stat : 25859 (claspmt) S 25838 25840 25708 0 -1 4202560 60728 0 0 0 99 488 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604492362194400 0 0 -1 10 0 0 0
[pid=25840/tid=25860] ppid=25838 vsize=5798556 CPUtime=6.02 cores=0-31
/proc/25840/task/25860/stat : 25860 (claspmt) S 25838 25840 25708 0 -1 4202560 57202 0 0 0 102 500 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498416049632 0 0 -1 22 0 0 0
[pid=25840/tid=25861] ppid=25838 vsize=5798556 CPUtime=4.59 cores=0-31
/proc/25840/task/25861/stat : 25861 (claspmt) S 25838 25840 25708 0 -1 4202560 39766 0 0 0 18 441 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501456297440 0 0 -1 24 0 0 0
[pid=25840/tid=25862] ppid=25838 vsize=5798556 CPUtime=5074.43 cores=0-31
/proc/25840/task/25862/stat : 25862 (claspmt) R 25838 25840 25708 0 -1 4202560 65200 0 0 0 506957 486 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4399521 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=25840/tid=25863] ppid=25838 vsize=5798556 CPUtime=6.04 cores=0-31
/proc/25840/task/25863/stat : 25863 (claspmt) S 25838 25840 25708 0 -1 4202560 55630 0 0 0 109 495 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995238368 0 0 -1 12 0 0 0
[pid=25840/tid=25864] ppid=25838 vsize=5798556 CPUtime=6.44 cores=0-31
/proc/25840/task/25864/stat : 25864 (claspmt) S 25838 25840 25708 0 -1 4202560 55327 0 0 0 168 476 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504586984928 0 0 -1 4 0 0 0
[pid=25840/tid=25865] ppid=25838 vsize=5798556 CPUtime=4.61 cores=0-31
/proc/25840/task/25865/stat : 25865 (claspmt) S 25838 25840 25708 0 -1 4202560 39819 0 0 0 22 439 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502036692448 0 0 -1 26 0 0 0
[pid=25840/tid=25866] ppid=25838 vsize=5798556 CPUtime=4.52 cores=0-31
/proc/25840/task/25866/stat : 25866 (claspmt) S 25838 25840 25708 0 -1 4202560 39764 0 0 0 24 428 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501509373408 0 0 -1 19 0 0 0
[pid=25840/tid=25867] ppid=25838 vsize=5798556 CPUtime=5.92 cores=0-31
/proc/25840/task/25867/stat : 25867 (claspmt) S 25838 25840 25708 0 -1 4202560 58708 0 0 0 104 488 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851873248 0 0 -1 17 0 0 0
[pid=25840/tid=25868] ppid=25838 vsize=5798556 CPUtime=5.94 cores=0-31
/proc/25840/task/25868/stat : 25868 (claspmt) S 25838 25840 25708 0 -1 4202560 56223 0 0 0 102 492 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502036708832 0 0 -1 28 0 0 0
[pid=25840/tid=25869] ppid=25838 vsize=5798556 CPUtime=4.6 cores=0-31
/proc/25840/task/25869/stat : 25869 (claspmt) S 25838 25840 25708 0 -1 4202560 39791 0 0 0 19 441 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604505860537824 0 0 -1 16 0 0 0
[pid=25840/tid=25870] ppid=25838 vsize=5798556 CPUtime=5074.07 cores=0-31
/proc/25840/task/25870/stat : 25870 (claspmt) R 25838 25840 25708 0 -1 4202560 59341 0 0 0 506863 544 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=25840/tid=25871] ppid=25838 vsize=5798556 CPUtime=5.94 cores=0-31
/proc/25840/task/25871/stat : 25871 (claspmt) S 25838 25840 25708 0 -1 4202560 57109 0 0 0 104 490 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501456305632 0 0 -1 9 0 0 0
[pid=25840/tid=25872] ppid=25838 vsize=5798556 CPUtime=6.42 cores=0-31
/proc/25840/task/25872/stat : 25872 (claspmt) S 25838 25840 25708 0 -1 4202560 53864 0 0 0 147 495 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851815904 0 0 -1 21 0 0 0
Current children cumulated CPU time (s) 20449
Current children cumulated vsize (KiB) 5798556



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 4.02 4.03 4.05 5/445 26032
/proc/meminfo: memFree=257452464/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=5798556 CPUtime=20519.8 cores=0-31
/proc/25840/stat : 25840 (claspmt) S 25838 25840 25708 0 -1 4202496 1727198 0 0 0 2036964 15020 0 0 18 0 32 0 24843894 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/25840/statm: 1449639 1247369 434 189 0 1443988 0
[pid=25840/tid=25842] ppid=25838 vsize=5798556 CPUtime=4.75 cores=0-31
/proc/25840/task/25842/stat : 25842 (claspmt) S 25838 25840 25708 0 -1 4202560 39935 0 0 0 27 448 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995246560 0 0 -1 13 0 0 0
[pid=25840/tid=25843] ppid=25838 vsize=5798556 CPUtime=6.14 cores=0-31
/proc/25840/task/25843/stat : 25843 (claspmt) S 25838 25840 25708 0 -1 4202560 52817 0 0 0 100 514 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504587009504 0 0 -1 4 0 0 0
[pid=25840/tid=25844] ppid=25838 vsize=5798556 CPUtime=6.16 cores=0-31
/proc/25840/task/25844/stat : 25844 (claspmt) S 25838 25840 25708 0 -1 4202560 53183 0 0 0 97 519 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504251882976 0 0 -1 4 0 0 0
[pid=25840/tid=25845] ppid=25838 vsize=5798556 CPUtime=4.36 cores=0-31
/proc/25840/task/25845/stat : 25845 (claspmt) S 25838 25840 25708 0 -1 4202560 39809 0 0 0 22 414 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604571714690528 0 0 -1 23 0 0 0
[pid=25840/tid=25846] ppid=25838 vsize=5798556 CPUtime=5091.55 cores=0-31
/proc/25840/task/25846/stat : 25846 (claspmt) R 25838 25840 25708 0 -1 4202560 64754 0 0 0 508624 531 0 0 25 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=25840/tid=25847] ppid=25838 vsize=5798556 CPUtime=5.7 cores=0-31
/proc/25840/task/25847/stat : 25847 (claspmt) S 25838 25840 25708 0 -1 4202560 60484 0 0 0 97 473 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498229280224 0 0 -1 8 0 0 0
[pid=25840/tid=25848] ppid=25838 vsize=5798556 CPUtime=6.69 cores=0-31
/proc/25840/task/25848/stat : 25848 (claspmt) S 25838 25840 25708 0 -1 4202560 55358 0 0 0 146 523 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604505646480864 0 0 -1 30 0 0 0
[pid=25840/tid=25849] ppid=25838 vsize=5798556 CPUtime=4.94 cores=0-31
/proc/25840/task/25849/stat : 25849 (claspmt) S 25838 25840 25708 0 -1 4202560 39818 0 0 0 25 469 0 0 18 0 32 0 24844209 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504872762848 0 0 -1 20 0 0 0
[pid=25840/tid=25850] ppid=25838 vsize=5798556 CPUtime=4.84 cores=0-31
/proc/25840/task/25850/stat : 25850 (claspmt) S 25838 25840 25708 0 -1 4202560 39871 0 0 0 24 460 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502183009760 0 0 -1 6 0 0 0
[pid=25840/tid=25851] ppid=25838 vsize=5798556 CPUtime=6.11 cores=0-31
/proc/25840/task/25851/stat : 25851 (claspmt) S 25838 25840 25708 0 -1 4202560 50715 0 0 0 97 514 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498416057824 0 0 -1 0 0 0 0
[pid=25840/tid=25852] ppid=25838 vsize=5798556 CPUtime=5.91 cores=0-31
/proc/25840/task/25852/stat : 25852 (claspmt) S 25838 25840 25708 0 -1 4202560 59051 0 0 0 104 487 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604499343146464 0 0 -1 25 0 0 0
[pid=25840/tid=25853] ppid=25838 vsize=5798556 CPUtime=4.64 cores=0-31
/proc/25840/task/25853/stat : 25853 (claspmt) S 25838 25840 25708 0 -1 4202560 39860 0 0 0 20 444 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483521207776 0 0 -1 18 0 0 0
[pid=25840/tid=25854] ppid=25838 vsize=5798556 CPUtime=5091.6 cores=0-31
/proc/25840/task/25854/stat : 25854 (claspmt) R 25838 25840 25708 0 -1 4202560 65160 0 0 0 508604 556 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=25840/tid=25855] ppid=25838 vsize=5798556 CPUtime=5.86 cores=0-31
/proc/25840/task/25855/stat : 25855 (claspmt) S 25838 25840 25708 0 -1 4202560 57385 0 0 0 103 483 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604483408436704 0 0 -1 11 0 0 0
[pid=25840/tid=25856] ppid=25838 vsize=5798556 CPUtime=6.65 cores=0-31
/proc/25840/task/25856/stat : 25856 (claspmt) S 25838 25840 25708 0 -1 4202560 53459 0 0 0 148 517 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604503756709344 0 0 -1 14 0 0 0
[pid=25840/tid=25857] ppid=25838 vsize=5798556 CPUtime=4.86 cores=0-31
/proc/25840/task/25857/stat : 25857 (claspmt) S 25838 25840 25708 0 -1 4202560 38591 0 0 0 23 463 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995271136 0 0 -1 5 0 0 0
[pid=25840/tid=25858] ppid=25838 vsize=5798556 CPUtime=4.76 cores=0-31
/proc/25840/task/25858/stat : 25858 (claspmt) S 25838 25840 25708 0 -1 4202560 38997 0 0 0 26 450 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851856864 0 0 -1 4 0 0 0
[pid=25840/tid=25859] ppid=25838 vsize=5798556 CPUtime=5.87 cores=0-31
/proc/25840/task/25859/stat : 25859 (claspmt) S 25838 25840 25708 0 -1 4202560 60728 0 0 0 99 488 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604492362194400 0 0 -1 10 0 0 0
[pid=25840/tid=25860] ppid=25838 vsize=5798556 CPUtime=6.02 cores=0-31
/proc/25840/task/25860/stat : 25860 (claspmt) S 25838 25840 25708 0 -1 4202560 57202 0 0 0 102 500 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604498416049632 0 0 -1 22 0 0 0
[pid=25840/tid=25861] ppid=25838 vsize=5798556 CPUtime=4.59 cores=0-31
/proc/25840/task/25861/stat : 25861 (claspmt) S 25838 25840 25708 0 -1 4202560 39766 0 0 0 18 441 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501456297440 0 0 -1 24 0 0 0
[pid=25840/tid=25862] ppid=25838 vsize=5798556 CPUtime=5092.15 cores=0-31
/proc/25840/task/25862/stat : 25862 (claspmt) R 25838 25840 25708 0 -1 4202560 65200 0 0 0 508729 486 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4399617 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=25840/tid=25863] ppid=25838 vsize=5798556 CPUtime=6.04 cores=0-31
/proc/25840/task/25863/stat : 25863 (claspmt) S 25838 25840 25708 0 -1 4202560 55630 0 0 0 109 495 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604486995238368 0 0 -1 12 0 0 0
[pid=25840/tid=25864] ppid=25838 vsize=5798556 CPUtime=6.44 cores=0-31
/proc/25840/task/25864/stat : 25864 (claspmt) S 25838 25840 25708 0 -1 4202560 55327 0 0 0 168 476 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504586984928 0 0 -1 4 0 0 0
[pid=25840/tid=25865] ppid=25838 vsize=5798556 CPUtime=4.61 cores=0-31
/proc/25840/task/25865/stat : 25865 (claspmt) S 25838 25840 25708 0 -1 4202560 39819 0 0 0 22 439 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502036692448 0 0 -1 26 0 0 0
[pid=25840/tid=25866] ppid=25838 vsize=5798556 CPUtime=4.52 cores=0-31
/proc/25840/task/25866/stat : 25866 (claspmt) S 25838 25840 25708 0 -1 4202560 39764 0 0 0 24 428 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501509373408 0 0 -1 19 0 0 0
[pid=25840/tid=25867] ppid=25838 vsize=5798556 CPUtime=5.92 cores=0-31
/proc/25840/task/25867/stat : 25867 (claspmt) S 25838 25840 25708 0 -1 4202560 58708 0 0 0 104 488 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851873248 0 0 -1 17 0 0 0
[pid=25840/tid=25868] ppid=25838 vsize=5798556 CPUtime=5.94 cores=0-31
/proc/25840/task/25868/stat : 25868 (claspmt) S 25838 25840 25708 0 -1 4202560 56223 0 0 0 102 492 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604502036708832 0 0 -1 28 0 0 0
[pid=25840/tid=25869] ppid=25838 vsize=5798556 CPUtime=4.6 cores=0-31
/proc/25840/task/25869/stat : 25869 (claspmt) S 25838 25840 25708 0 -1 4202560 39791 0 0 0 19 441 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604505860537824 0 0 -1 16 0 0 0
[pid=25840/tid=25870] ppid=25838 vsize=5798556 CPUtime=5091.78 cores=0-31
/proc/25840/task/25870/stat : 25870 (claspmt) R 25838 25840 25708 0 -1 4202560 59341 0 0 0 508634 544 0 0 25 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 4669136 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=25840/tid=25871] ppid=25838 vsize=5798556 CPUtime=5.94 cores=0-31
/proc/25840/task/25871/stat : 25871 (claspmt) S 25838 25840 25708 0 -1 4202560 57109 0 0 0 104 490 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604501456305632 0 0 -1 9 0 0 0
[pid=25840/tid=25872] ppid=25838 vsize=5798556 CPUtime=6.42 cores=0-31
/proc/25840/task/25872/stat : 25872 (claspmt) S 25838 25840 25708 0 -1 4202560 53864 0 0 0 147 495 0 0 18 0 32 0 24844210 5937721344 1247369 270582939648 4194304 4964800 140736103120848 18446744073709551615 258662772457 0 0 4096 18946 18446604504851815904 0 0 -1 21 0 0 0
Current children cumulated CPU time (s) 20519.8
Current children cumulated vsize (KiB) 5798556

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -25840

Solver just ended. Dumping a history of the last processes samples

[startup+5100.7 s]
/proc/loadavg: 4.02 4.03 4.05 2/415 26033
/proc/meminfo: memFree=257906060/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=5240548 CPUtime=20520.6 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 1727209 0 0 0 2037035 15024 0 0 18 0 1 0 24843894 5366321152 1133933 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650604972 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 1310137 1133933 445 189 0 1304486 0
Current children cumulated CPU time (s) 20520.6
Current children cumulated vsize (KiB) 5240548

[startup+5101.5 s]
/proc/loadavg: 4.02 4.03 4.05 2/415 26033
/proc/meminfo: memFree=257906060/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=4186740 CPUtime=20521.3 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 1727209 0 0 0 2037105 15030 0 0 19 0 1 0 24843894 4287221760 873119 270582939648 4194304 4964800 140736103120848 18446744073709551615 258650604748 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 1046685 873119 445 189 0 1041034 0
Current children cumulated CPU time (s) 20521.4
Current children cumulated vsize (KiB) 4186740

[startup+5101.94 s]
/proc/loadavg: 4.02 4.03 4.05 2/415 26033
/proc/meminfo: memFree=259683724/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=3271264 CPUtime=20521.8 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4202496 1727209 0 0 0 2037143 15036 0 0 20 0 1 0 24843894 3349774336 649277 270582939648 4194304 4964800 140736103120848 18446744073709551615 4646717 0 0 4096 18946 0 0 0 17 28 0 0 0
/proc/25840/statm: 817816 649277 445 189 0 812165 0
Current children cumulated CPU time (s) 20521.8
Current children cumulated vsize (KiB) 3271264

[startup+5102.1 s]
/proc/loadavg: 4.02 4.03 4.05 2/415 26033
/proc/meminfo: memFree=259683724/264257624 swapFree=67111528/67111528
[pid=25840] ppid=25838 vsize=0 CPUtime=20522 cores=0-31
/proc/25840/stat : 25840 (claspmt) R 25838 25840 25708 0 -1 4203524 1727209 0 0 0 2037151 15045 0 0 21 0 1 0 24843894 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 28 0 0 0
/proc/25840/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 20522
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 5102.18
CPU time (s): 20522
CPU user time (s): 20371.5
CPU system time (s): 150.524
CPU usage (%): 402.221
Max. virtual memory (cumulated for all children) (KiB): 5798556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20371.5
system time used= 150.524
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1727209
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 683849
involuntary context switches= 32372

runsolver used 26.311 second user time and 111.557 second system time

The end

Launcher Data 

Begin job on node200 at 2011-06-09 06:42:50
IDJOB=3472382
IDBENCH=82404
IDSOLVER=1961
FILE ID=node200/3472382-1307594563
RUNJOBID= node200-1307592793-25722
PBS_JOBID= 13547691
Free space on /tmp= 61584 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3472382-1307594563/watcher-3472382-1307594563 -o /tmp/evaluation-result-3472382-1307594563/solver-3472382-1307594563 -C 160000 -W 5100 -M 256000  HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472382-1307594563.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 256000 MiB
NBCORE= 32

MD5SUM BENCH= 6c2d25eda70423643946d76935ceb950
RANDOM SEED=1825963774

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      262449152 kB
Buffers:        211164 kB
Cached:        1311296 kB
SwapCached:          0 kB
Active:         394336 kB
Inactive:      1191612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      262449152 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          166400 kB
Writeback:           0 kB
AnonPages:       63344 kB
Mapped:          14468 kB
Slab:           145888 kB
PageTables:       4340 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   166820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61580 MiB
End job on node200 at 2011-06-09 08:07:52