Trace number 3311445

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.3 1208.73

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v175-c3727-S82160031-050.SATISFIABLE.cnf
MD5SUM90ea123f6d02a54bb761f724a5a1c9d1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.43278
Satisfiable
(Un)Satisfiability was proved
Number of variables175
Number of clauses3727
Sum of the clauses size18635
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53727
Number of clauses of size over 50

Solver Data

0.10/0.11	44:07 INFO : Reading from input HOME/instance-3311445-1304127847.cnf
0.27/0.29	Executor set job limit to 1000000
0.27/0.29	Executor set job limit to 1000000
0.27/0.29	Executor set job limit to 1000000
0.27/0.29	Executor set job limit to 1000000
0.27/0.29	Starting Executor!
0.27/0.29	Starting Executor!
0.27/0.29	Starting Executor!
0.27/0.29	Starting Executor!
1.08/0.50	44:08 INFO : 175 variables remaining out of 175
1.08/0.50	44:08 INFO : 22362 literals remaining out of 22362

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311445-1304127847/watcher-3311445-1304127847 -o /tmp/evaluation-result-3311445-1304127847/solver-3311445-1304127847 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311445-1304127847.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.00 7.69 2/196 12320
/proc/meminfo: memFree=30852448/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=24004 CPUtime=0 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 1383 0 0 0 0 0 0 0 25 0 2 0 524384332 24580096 862 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 6001 863 660 9 0 381 0
[pid=12320/tid=12321] ppid=12318 vsize=26088 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) R 12318 12320 11661 0 -1 4202560 56 0 0 0 0 0 0 0 25 0 2 0 524384332 26714112 885 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210642222727 0 2147483391 4096 0 0 0 0 -1 4 0 0 0

[startup+0.028638 s]
/proc/loadavg: 8.01 8.00 7.69 2/196 12320
/proc/meminfo: memFree=30852448/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15604248 CPUtime=0.01 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 3561 0 1 0 1 0 0 0 25 0 13 0 524384332 15978749952 3001 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16784584 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3901062 3001 1667 9 0 3891810 0
[pid=12320/tid=12321] ppid=12318 vsize=15604248 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) R 12318 12320 11661 0 -1 4202560 2171 0 1 0 1 0 0 0 25 0 13 0 524384332 15978749952 3001 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658973131 0 4 0 16784584 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15604248

[startup+0.100615 s]
/proc/loadavg: 8.01 8.00 7.69 2/196 12320
/proc/meminfo: memFree=30852448/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15676832 CPUtime=0.1 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 5562 0 1 0 9 1 0 0 25 0 18 0 524384332 16053075968 5001 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3919208 5002 2117 9 0 3909927 0
[pid=12320/tid=12321] ppid=12318 vsize=15676832 CPUtime=0.09 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) R 12318 12320 11661 0 -1 4202560 3477 0 1 0 8 1 0 0 18 0 18 0 524384332 16053075968 5002 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658973131 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676832

[startup+0.300564 s]
/proc/loadavg: 8.01 8.00 7.69 2/196 12320
/proc/meminfo: memFree=30852448/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15687232 CPUtime=0.52 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 13446 0 1 0 50 2 0 0 25 0 22 0 524384332 16063725568 11723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3921808 11723 2209 9 0 3912527 0
[pid=12320/tid=12321] ppid=12318 vsize=15687232 CPUtime=0.28 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) R 12318 12320 11661 0 -1 4202560 8220 0 1 0 27 1 0 0 19 0 22 0 524384332 16063725568 11724 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 47671238015827 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15687232

[startup+0.706812 s]
/proc/loadavg: 8.01 8.00 7.69 2/196 12320
/proc/meminfo: memFree=30852448/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15700016 CPUtime=1.67 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 26642 0 1 0 163 4 0 0 25 0 22 0 524384332 16076816384 21686 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3925004 21687 2261 9 0 3915723 0
[pid=12320/tid=12321] ppid=12318 vsize=15700016 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16076816384 21687 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.67
Current children cumulated vsize (KiB) 15700016

[startup+1.50131 s]
/proc/loadavg: 8.01 8.00 7.69 17/218 12342
/proc/meminfo: memFree=30555664/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15697760 CPUtime=4.83 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 58405 0 1 0 475 8 0 0 25 0 22 0 524384332 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924440 51052 2285 9 0 3915159 0
[pid=12320/tid=12321] ppid=12318 vsize=15697760 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) S 12318 12320 11661 0 -1 4202560 561 0 0 0 0 0 0 0 16 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) S 12318 12320 11661 0 -1 4202560 1221 0 0 0 0 0 0 0 16 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 1187 0 0 0 0 0 0 0 16 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 466 0 0 0 0 0 0 0 15 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 701 0 0 0 0 0 0 0 16 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 448 0 0 0 0 0 0 0 15 0 22 0 524384333 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12331] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12331/stat : 12331 (java) S 12318 12320 11661 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 524384334 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 0 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12332] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12332/stat : 12332 (java) S 12318 12320 11661 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 524384334 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12333] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12333/stat : 12333 (java) S 12318 12320 11661 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524384334 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12334] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12334/stat : 12334 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658970033 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12335] ppid=12318 vsize=15697760 CPUtime=0.86 cores=0,2,4,6
/proc/12320/task/12335/stat : 12335 (java) R 12318 12320 11661 0 -1 4202560 6579 0 0 0 86 0 0 0 18 0 22 0 524384336 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12336] ppid=12318 vsize=15697760 CPUtime=0.88 cores=0,2,4,6
/proc/12320/task/12336/stat : 12336 (java) S 12318 12320 11661 0 -1 4202560 10247 0 0 0 87 1 0 0 15 0 22 0 524384336 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12337] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12337/stat : 12337 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12338] ppid=12318 vsize=15697760 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12338/stat : 12338 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524384336 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12339] ppid=12318 vsize=15697760 CPUtime=0.57 cores=0,2,4,6
/proc/12320/task/12339/stat : 12339 (java) R 12318 12320 11661 0 -1 4202560 2182 0 0 0 57 0 0 0 17 0 22 0 524384361 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 47671237338231 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12340] ppid=12318 vsize=15697760 CPUtime=0.5 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) R 12318 12320 11661 0 -1 4202560 8164 0 0 0 50 0 0 0 16 0 22 0 524384361 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505937257 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15697760 CPUtime=0.71 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) R 12318 12320 11661 0 -1 4202560 8643 0 0 0 71 0 0 0 17 0 22 0 524384361 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505726634 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15697760 CPUtime=0.74 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) R 12318 12320 11661 0 -1 4202560 7751 0 0 0 73 1 0 0 18 0 22 0 524384361 16074506240 51052 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505937462 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.83
Current children cumulated vsize (KiB) 15697760

[startup+3.10104 s]
/proc/loadavg: 8.01 8.00 7.69 11/218 12342
/proc/meminfo: memFree=30379956/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15698084 CPUtime=10.73 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 111781 0 1 0 1048 25 0 0 25 0 22 0 524384332 16074838016 104415 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924521 104420 2285 9 0 3915240 0
[pid=12320/tid=12321] ppid=12318 vsize=15698084 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16074838016 104422 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15698084 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) S 12318 12320 11661 0 -1 4202560 1728 0 0 0 1 0 0 0 15 0 22 0 524384333 16074838016 104425 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) S 12318 12320 11661 0 -1 4202560 97 0 0 0 0 0 0 0 15 0 22 0 524384333 16074838016 104428 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15698084 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 1478 0 0 0 1 0 0 0 16 0 22 0 524384333 16074838016 104431 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15698084 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) S 12318 12320 11661 0 -1 4202560 2064 0 0 0 1 0 0 0 16 0 22 0 524384333 16074838016 104433 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15698084 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 2652 0 0 0 1 0 0 0 15 0 22 0 524384333 16074838016 104436 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15698084 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 1850 0 0 0 1 0 0 0 16 0 22 0 524384333 16074838016 104440 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 1859 0 0 0 0 0 0 0 15 0 22 0 524384333 16074838016 104442 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 529 0 0 0 0 0 0 0 15 0 22 0 524384333 16074838016 104444 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12331] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12331/stat : 12331 (java) S 12318 12320 11661 0 -1 4202560 189 0 0 0 0 0 0 0 15 0 22 0 524384334 16074838016 104445 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 0 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12332] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12332/stat : 12332 (java) S 12318 12320 11661 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 524384334 16074838016 104447 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12333] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12333/stat : 12333 (java) S 12318 12320 11661 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524384334 16074838016 104450 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12334] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12334/stat : 12334 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16074838016 104452 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658970033 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12335] ppid=12318 vsize=15698084 CPUtime=0.95 cores=0,2,4,6
/proc/12320/task/12335/stat : 12335 (java) S 12318 12320 11661 0 -1 4202560 6791 0 0 0 95 0 0 0 15 0 22 0 524384336 16074838016 104453 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12336] ppid=12318 vsize=15698084 CPUtime=0.93 cores=0,2,4,6
/proc/12320/task/12336/stat : 12336 (java) S 12318 12320 11661 0 -1 4202560 10254 0 0 0 92 1 0 0 15 0 22 0 524384336 16074838016 104455 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12337] ppid=12318 vsize=15698084 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12337/stat : 12337 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16074838016 104457 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12338] ppid=12318 vsize=15698084 CPUtime=0.1 cores=0,2,4,6
/proc/12320/task/12338/stat : 12338 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 4 6 0 0 15 0 22 0 524384336 16074838016 104469 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12339] ppid=12318 vsize=15698084 CPUtime=1.64 cores=0,2,4,6
/proc/12320/task/12339/stat : 12339 (java) R 12318 12320 11661 0 -1 4202560 8627 0 0 0 161 3 0 0 18 0 22 0 524384361 16074838016 104477 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505858258 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12340] ppid=12318 vsize=15698084 CPUtime=2.05 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) R 12318 12320 11661 0 -1 4202560 21268 0 0 0 203 2 0 0 17 0 22 0 524384361 16074838016 104486 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505818129 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15698084 CPUtime=2.23 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) R 12318 12320 11661 0 -1 4202560 21860 0 0 0 219 4 0 0 18 0 22 0 524384361 16074838016 104489 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912506169144 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15698084 CPUtime=2.13 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) R 12318 12320 11661 0 -1 4202560 20368 0 0 0 212 1 0 0 19 0 22 0 524384361 16074838016 104492 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912506142427 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.73
Current children cumulated vsize (KiB) 15698084

[startup+6.3015 s]
/proc/loadavg: 8.01 8.00 7.69 9/218 12342
/proc/meminfo: memFree=29749976/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15698316 CPUtime=23.16 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 279974 0 1 0 2260 56 0 0 25 0 22 0 524384332 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924579 272519 2285 9 0 3915298 0
[pid=12320/tid=12321] ppid=12318 vsize=15698316 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15698316 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) S 12318 12320 11661 0 -1 4202560 1809 0 0 0 1 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15698316 CPUtime=0.02 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) S 12318 12320 11661 0 -1 4202560 1015 0 0 0 2 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15698316 CPUtime=0.02 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 2197 0 0 0 2 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15698316 CPUtime=0.02 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) S 12318 12320 11661 0 -1 4202560 2131 0 0 0 2 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15698316 CPUtime=0.02 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 2731 0 0 0 2 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15698316 CPUtime=0.03 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 3008 0 0 0 3 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15698316 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 1974 0 0 0 1 0 0 0 16 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15698316 CPUtime=0.01 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 529 0 0 0 1 0 0 0 15 0 22 0 524384333 16075075584 272519 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=12320/tid=12340] ppid=12318 vsize=15698316 CPUtime=1107.85 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) R 12318 12320 11661 0 -1 4202560 233515 0 0 0 110711 74 0 0 25 0 22 0 524384361 16075075584 97795 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912506142196 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15698316 CPUtime=1106.65 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) R 12318 12320 11661 0 -1 4202560 240846 0 0 0 110608 57 0 0 25 0 22 0 524384361 16075075584 97795 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505835723 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15698316 CPUtime=1106.72 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) R 12318 12320 11661 0 -1 4202560 237757 0 0 0 110589 83 0 0 19 0 22 0 524384361 16075075584 97795 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 47671237338161 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4456.81
Current children cumulated vsize (KiB) 15698316

[startup+1182.3 s]
/proc/loadavg: 7.92 8.08 7.96 10/218 12898
/proc/meminfo: memFree=30257496/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15698316 CPUtime=4695.27 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 1432221 0 1 0 469014 513 0 0 25 0 22 0 524384332 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924579 66087 2298 9 0 3915298 0
[pid=12320/tid=12321] ppid=12318 vsize=15698316 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15698316 CPUtime=3.14 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) R 12318 12320 11661 0 -1 4202560 56657 0 0 0 299 15 0 0 15 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658963398 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15698316 CPUtime=3.13 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) R 12318 12320 11661 0 -1 4202560 54688 0 0 0 298 15 0 0 15 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 47671232811868 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15698316 CPUtime=3.09 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 54440 0 0 0 294 15 0 0 16 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15698316 CPUtime=3.09 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) R 12318 12320 11661 0 -1 4202560 55801 0 0 0 296 13 0 0 15 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15698316 CPUtime=3.12 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 55891 0 0 0 297 15 0 0 15 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15698316 CPUtime=3.13 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 58403 0 0 0 298 15 0 0 15 0 22 0 524384333 16075075584 66087 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15698316 CPUtime=2.95 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 54983 0 0 0 282 13 0 0 15 0 22 0 524384333 16075075584 66088 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15698316 CPUtime=3.12 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 53599 0 0 0 297 15 0 0 15 0 22 0 524384333 16075075584 66098 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12331] ppid=12318 vsize=15698316 CPUtime=2.31 cores=0,2,4,6
/proc/12320/task/12331/stat : 12331 (java) R 12318 12320 11661 0 -1 4202560 3223 0 0 0 152 79 0 0 16 0 22 0 524384334 16075075584 66107 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658972341 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12332] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12332/stat : 12332 (java) S 12318 12320 11661 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 524384334 16075075584 66118 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12333] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12333/stat : 12333 (java) S 12318 12320 11661 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524384334 16075075584 66128 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12334] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12334/stat : 12334 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 66132 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658970033 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12335] ppid=12318 vsize=15698316 CPUtime=1.1 cores=0,2,4,6
/proc/12320/task/12335/stat : 12335 (java) S 12318 12320 11661 0 -1 4202560 6852 0 0 0 110 0 0 0 15 0 22 0 524384336 16075075584 66140 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12336] ppid=12318 vsize=15698316 CPUtime=1.01 cores=0,2,4,6
/proc/12320/task/12336/stat : 12336 (java) S 12318 12320 11661 0 -1 4202560 10267 0 0 0 100 1 0 0 16 0 22 0 524384336 16075075584 66145 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12337] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12337/stat : 12337 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 66156 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12338] ppid=12318 vsize=15698316 CPUtime=0.26 cores=0,2,4,6
/proc/12320/task/12338/stat : 12338 (java) S 12318 12320 11661 0 -1 4202560 64 0 0 0 11 15 0 0 15 0 22 0 524384336 16075075584 66169 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12339] ppid=12318 vsize=15698316 CPUtime=1166.14 cores=0,2,4,6
/proc/12320/task/12339/stat : 12339 (java) S 12318 12320 11661 0 -1 4202560 220587 0 0 0 116543 71 0 0 25 0 22 0 524384361 16075075584 66180 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12340] ppid=12318 vsize=15698316 CPUtime=1167.19 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) S 12318 12320 11661 0 -1 4202560 241816 0 0 0 116642 77 0 0 25 0 22 0 524384361 16075075584 66189 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15698316 CPUtime=1165.94 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) S 12318 12320 11661 0 -1 4202560 249133 0 0 0 116533 61 0 0 25 0 22 0 524384361 16075075584 66199 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15698316 CPUtime=1165.9 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) S 12318 12320 11661 0 -1 4202560 245576 0 0 0 116506 84 0 0 25 0 22 0 524384361 16075075584 66214 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4695.27
Current children cumulated vsize (KiB) 15698316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1208.7 s]
/proc/loadavg: 8.01 8.09 7.96 9/218 12899
/proc/meminfo: memFree=30193492/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15698316 CPUtime=4800.24 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 1476066 0 1 0 479499 525 0 0 25 0 22 0 524384332 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924579 80723 2298 9 0 3915298 0
[pid=12320/tid=12321] ppid=12318 vsize=15698316 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) S 12318 12320 11661 0 -1 4202560 58553 0 0 0 305 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) S 12318 12320 11661 0 -1 4202560 57183 0 0 0 304 16 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15698316 CPUtime=3.17 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 56775 0 0 0 302 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15698316 CPUtime=3.18 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) S 12318 12320 11661 0 -1 4202560 58284 0 0 0 304 14 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15698316 CPUtime=3.21 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 57413 0 0 0 305 16 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 60109 0 0 0 305 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15698316 CPUtime=3.01 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 56770 0 0 0 288 13 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15698316 CPUtime=3.19 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 56044 0 0 0 304 15 0 0 16 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12331] ppid=12318 vsize=15698316 CPUtime=2.36 cores=0,2,4,6
/proc/12320/task/12331/stat : 12331 (java) S 12318 12320 11661 0 -1 4202560 3343 0 0 0 155 81 0 0 16 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 0 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12332] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12332/stat : 12332 (java) S 12318 12320 11661 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12333] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12333/stat : 12333 (java) S 12318 12320 11661 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12334] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12334/stat : 12334 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658970033 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12335] ppid=12318 vsize=15698316 CPUtime=1.1 cores=0,2,4,6
/proc/12320/task/12335/stat : 12335 (java) S 12318 12320 11661 0 -1 4202560 6852 0 0 0 110 0 0 0 15 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12336] ppid=12318 vsize=15698316 CPUtime=1.01 cores=0,2,4,6
/proc/12320/task/12336/stat : 12336 (java) S 12318 12320 11661 0 -1 4202560 10267 0 0 0 100 1 0 0 16 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12337] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12337/stat : 12337 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12338] ppid=12318 vsize=15698316 CPUtime=0.26 cores=0,2,4,6
/proc/12320/task/12338/stat : 12338 (java) S 12318 12320 11661 0 -1 4202560 66 0 0 0 11 15 0 0 15 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12339] ppid=12318 vsize=15698316 CPUtime=1192.21 cores=0,2,4,6
/proc/12320/task/12339/stat : 12339 (java) R 12318 12320 11661 0 -1 4202560 227320 0 0 0 119148 73 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505663360 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12340] ppid=12318 vsize=15698316 CPUtime=1193.28 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) R 12318 12320 11661 0 -1 4202560 248653 0 0 0 119250 78 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505818805 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15698316 CPUtime=1192.04 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) R 12318 12320 11661 0 -1 4202560 255814 0 0 0 119142 62 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505820396 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15698316 CPUtime=1191.98 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) R 12318 12320 11661 0 -1 4202560 252379 0 0 0 119112 86 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505937443 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 15698316

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1208.7 s]
/proc/loadavg: 8.01 8.09 7.96 9/218 12899
/proc/meminfo: memFree=30193492/32951132 swapFree=67080200/67111528
[pid=12320] ppid=12318 vsize=15698316 CPUtime=4800.24 cores=0,2,4,6
/proc/12320/stat : 12320 (java) S 12318 12320 11661 0 -1 4202496 1476066 0 1 0 479499 525 0 0 25 0 22 0 524384332 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/12320/statm: 3924579 80723 2298 9 0 3915298 0
[pid=12320/tid=12321] ppid=12318 vsize=15698316 CPUtime=0.49 cores=0,2,4,6
/proc/12320/task/12321/stat : 12321 (java) S 12318 12320 11661 0 -1 4202560 8857 0 1 0 48 1 0 0 20 0 22 0 524384332 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12323] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12323/stat : 12323 (java) S 12318 12320 11661 0 -1 4202560 58553 0 0 0 305 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12324] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12324/stat : 12324 (java) S 12318 12320 11661 0 -1 4202560 57183 0 0 0 304 16 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12325] ppid=12318 vsize=15698316 CPUtime=3.17 cores=0,2,4,6
/proc/12320/task/12325/stat : 12325 (java) S 12318 12320 11661 0 -1 4202560 56775 0 0 0 302 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12326] ppid=12318 vsize=15698316 CPUtime=3.18 cores=0,2,4,6
/proc/12320/task/12326/stat : 12326 (java) S 12318 12320 11661 0 -1 4202560 58284 0 0 0 304 14 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12327] ppid=12318 vsize=15698316 CPUtime=3.21 cores=0,2,4,6
/proc/12320/task/12327/stat : 12327 (java) S 12318 12320 11661 0 -1 4202560 57413 0 0 0 305 16 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12328] ppid=12318 vsize=15698316 CPUtime=3.2 cores=0,2,4,6
/proc/12320/task/12328/stat : 12328 (java) S 12318 12320 11661 0 -1 4202560 60109 0 0 0 305 15 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12329] ppid=12318 vsize=15698316 CPUtime=3.01 cores=0,2,4,6
/proc/12320/task/12329/stat : 12329 (java) S 12318 12320 11661 0 -1 4202560 56770 0 0 0 288 13 0 0 15 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12330] ppid=12318 vsize=15698316 CPUtime=3.19 cores=0,2,4,6
/proc/12320/task/12330/stat : 12330 (java) S 12318 12320 11661 0 -1 4202560 56044 0 0 0 304 15 0 0 16 0 22 0 524384333 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12331] ppid=12318 vsize=15698316 CPUtime=2.36 cores=0,2,4,6
/proc/12320/task/12331/stat : 12331 (java) S 12318 12320 11661 0 -1 4202560 3343 0 0 0 155 81 0 0 16 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 0 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12332] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12332/stat : 12332 (java) S 12318 12320 11661 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12333] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12333/stat : 12333 (java) S 12318 12320 11661 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524384334 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 0 0 0 0
[pid=12320/tid=12334] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12334/stat : 12334 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658970033 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12335] ppid=12318 vsize=15698316 CPUtime=1.1 cores=0,2,4,6
/proc/12320/task/12335/stat : 12335 (java) S 12318 12320 11661 0 -1 4202560 6852 0 0 0 110 0 0 0 15 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 2 0 0 0
[pid=12320/tid=12336] ppid=12318 vsize=15698316 CPUtime=1.01 cores=0,2,4,6
/proc/12320/task/12336/stat : 12336 (java) S 12318 12320 11661 0 -1 4202560 10267 0 0 0 100 1 0 0 16 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12337] ppid=12318 vsize=15698316 CPUtime=0 cores=0,2,4,6
/proc/12320/task/12337/stat : 12337 (java) S 12318 12320 11661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962329 0 4 0 16800975 18446604453857706304 0 0 -1 4 0 0 0
[pid=12320/tid=12338] ppid=12318 vsize=15698316 CPUtime=0.26 cores=0,2,4,6
/proc/12320/task/12338/stat : 12338 (java) S 12318 12320 11661 0 -1 4202560 66 0 0 0 11 15 0 0 15 0 22 0 524384336 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 210658962944 0 4 0 16800975 18446604453857706304 0 0 -1 6 0 0 0
[pid=12320/tid=12339] ppid=12318 vsize=15698316 CPUtime=1192.21 cores=0,2,4,6
/proc/12320/task/12339/stat : 12339 (java) R 12318 12320 11661 0 -1 4202560 227320 0 0 0 119148 73 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505663360 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=12320/tid=12340] ppid=12318 vsize=15698316 CPUtime=1193.28 cores=0,2,4,6
/proc/12320/task/12340/stat : 12340 (java) R 12318 12320 11661 0 -1 4202560 248653 0 0 0 119250 78 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505818805 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=12320/tid=12341] ppid=12318 vsize=15698316 CPUtime=1192.04 cores=0,2,4,6
/proc/12320/task/12341/stat : 12341 (java) R 12318 12320 11661 0 -1 4202560 255814 0 0 0 119142 62 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505820396 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=12320/tid=12342] ppid=12318 vsize=15698316 CPUtime=1191.98 cores=0,2,4,6
/proc/12320/task/12342/stat : 12342 (java) R 12318 12320 11661 0 -1 4202560 252379 0 0 0 119112 86 0 0 25 0 22 0 524384361 16075075584 80723 33554432000 1073741824 1073778376 140734581072304 18446744073709551615 46912505937443 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 15698316

Child status: 143
Real time (s): 1208.73
CPU time (s): 4800.3
CPU user time (s): 4795.02
CPU system time (s): 5.2732
CPU usage (%): 397.135
Max. virtual memory (cumulated for all children) (KiB): 15700024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.02
system time used= 5.2732
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1476093
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 299674
involuntary context switches= 171095

runsolver used 1.9547 second user time and 4.70528 second system time

The end

Launcher Data

Begin job on node129 at 2011-04-30 03:44:07
IDJOB=3311445
IDBENCH=82830
IDSOLVER=1698
FILE ID=node129/3311445-1304127847
RUNJOBID= node129-1304126637-12145
PBS_JOBID= 13170749
Free space on /tmp= 66368 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v175-c3727-S82160031-050.SATISFIABLE.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311445-1304127847/watcher-3311445-1304127847 -o /tmp/evaluation-result-3311445-1304127847/solver-3311445-1304127847 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311445-1304127847.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 90ea123f6d02a54bb761f724a5a1c9d1
RANDOM SEED=2066887098

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30852720 kB
Buffers:        253236 kB
Cached:        1425844 kB
SwapCached:       4836 kB
Active:         142840 kB
Inactive:      1615852 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30852720 kB
SwapTotal:    67111528 kB
SwapFree:     67080200 kB
Dirty:            3216 kB
Writeback:           0 kB
AnonPages:       76996 kB
Mapped:          20940 kB
Slab:           276064 kB
PageTables:       4280 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   799456 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 67248 MiB
End job on node129 at 2011-04-30 04:04:18