Trace number 3313135

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.12 1207.43

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-5_528.cnf
MD5SUM7c7070bd15b57ddd9a06dd3709baef54
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark157.607
Satisfiable
(Un)Satisfiability was proved
Number of variables527
Number of clauses12692
Sum of the clauses size38748
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 312356
Number of clauses of size 40
Number of clauses of size 5336
Number of clauses of size over 50

Solver Data 

0.10/0.12	22:07 INFO : Reading from input HOME/instance-3313135-1304184127.cnf
0.50/0.34	Executor set job limit to 1000000
0.50/0.34	Executor set job limit to 1000000
0.50/0.34	Executor set job limit to 1000000
0.50/0.34	Executor set job limit to 1000000
0.50/0.34	Starting Executor!
0.50/0.34	Starting Executor!
0.50/0.34	Starting Executor!
0.50/0.34	Starting Executor!
1.22/0.68	22:08 INFO : 491 variables remaining out of 527
1.22/0.68	22:08 INFO : 42252 literals remaining out of 51440

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313135-1304184127/watcher-3313135-1304184127 -o /tmp/evaluation-result-3313135-1304184127/solver-3313135-1304184127 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313135-1304184127.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.77 6.34 7.14 2/174 16229
/proc/meminfo: memFree=30889196/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/16229/stat : 16229 (java) R 16227 16229 16197 0 -1 4202496 1127 0 0 0 0 0 0 0 25 0 1 0 530013134 23580672 613 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230804203285 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16229/statm: 5757 625 467 9 0 124 0

[startup+0.00824995 s]
/proc/loadavg: 3.77 6.34 7.14 2/174 16229
/proc/meminfo: memFree=30889196/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=27172 CPUtime=0 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 1424 0 0 0 0 0 0 0 25 0 2 0 530013134 27824128 894 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 6793 894 684 9 0 381 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 27172

[startup+0.100239 s]
/proc/loadavg: 3.77 6.34 7.14 2/174 16229
/proc/meminfo: memFree=30889196/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15676696 CPUtime=0.1 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 5557 0 1 0 9 1 0 0 25 0 18 0 530013134 16052936704 4953 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3919174 4953 2117 9 0 3909893 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676696

[startup+0.300181 s]
/proc/loadavg: 3.77 6.34 7.14 2/174 16229
/proc/meminfo: memFree=30889196/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15679856 CPUtime=0.5 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 13771 0 1 0 48 2 0 0 25 0 18 0 530013134 16056172544 12243 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3919964 12247 2207 9 0 3910683 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 15679856

[startup+0.701123 s]
/proc/loadavg: 3.77 6.34 7.14 2/174 16229
/proc/meminfo: memFree=30889196/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15702896 CPUtime=1.5 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 29265 0 1 0 146 4 0 0 25 0 22 0 530013134 16079765504 25462 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925724 25462 2249 9 0 3916443 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 15702896

[startup+1.50093 s]
/proc/loadavg: 3.77 6.34 7.14 9/220 16278
/proc/meminfo: memFree=30570012/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=4.62 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 55859 0 1 0 453 9 0 0 25 0 22 0 530013134 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 49411 2279 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 541 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 652 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 215 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 287 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 441 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 677 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 538 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 22 0 530013137 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.71 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) S 16227 16229 16197 0 -1 4202560 5408 0 0 0 71 0 0 0 25 0 22 0 530013139 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16245] ppid=16227 vsize=15701376 CPUtime=1.02 cores=1,3,5,7
/proc/16229/task/16245/stat : 16245 (java) S 16227 16229 16197 0 -1 4202560 10088 0 0 0 101 1 0 0 16 0 22 0 530013140 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16246] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16246/stat : 16246 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013140 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16247] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16247/stat : 16247 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530013140 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16271] ppid=16227 vsize=15701376 CPUtime=0.51 cores=1,3,5,7
/proc/16229/task/16271/stat : 16271 (java) R 16227 16229 16197 0 -1 4202560 6001 0 0 0 51 0 0 0 16 0 22 0 530013169 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505937728 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=0.72 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 6832 0 0 0 71 1 0 0 18 0 22 0 530013169 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 47489462116576 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=0.4 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 2379 0 0 0 40 0 0 0 17 0 22 0 530013169 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505120883 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=0.5 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 5813 0 0 0 50 0 0 0 16 0 22 0 530013169 16078209024 49411 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505216091 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.62
Current children cumulated vsize (KiB) 15701376

[startup+3.10164 s]
/proc/loadavg: 3.95 6.33 7.14 6/220 16278
/proc/meminfo: memFree=30374836/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=11 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 152356 0 1 0 1078 22 0 0 25 0 22 0 530013134 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 144156 2279 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 1338 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 949 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 779 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 1942 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 694 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 630 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 1744 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 2145 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 184 0 0 0 0 0 0 0 16 0 22 0 530013137 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.72 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) R 16227 16229 16197 0 -1 4202560 5410 0 0 0 72 0 0 0 22 0 22 0 530013139 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 47489462458216 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16229/tid=16245] ppid=16227 vsize=15701376 CPUtime=1.22 cores=1,3,5,7
/proc/16229/task/16245/stat : 16245 (java) S 16227 16229 16197 0 -1 4202560 10099 0 0 0 121 1 0 0 15 0 22 0 530013140 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16246] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16246/stat : 16246 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013140 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16247] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16247/stat : 16247 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530013140 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16271] ppid=16227 vsize=15701376 CPUtime=2.1 cores=1,3,5,7
/proc/16229/task/16271/stat : 16271 (java) R 16227 16229 16197 0 -1 4202560 28200 0 0 0 207 3 0 0 18 0 22 0 530013169 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 47489462117383 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=2.3 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 29023 0 0 0 226 4 0 0 20 0 22 0 530013169 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 47489462118020 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=1.78 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 24322 0 0 0 176 2 0 0 18 0 22 0 530013169 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505717760 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=2.09 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 28983 0 0 0 206 3 0 0 18 0 22 0 530013169 16078209024 144156 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912506085715 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11
Current children cumulated vsize (KiB) 15701376

[startup+6.30105 s]
/proc/loadavg: 3.95 6.33 7.14 9/220 16278
/proc/meminfo: memFree=29593344/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=23.76 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 153185 0 1 0 2354 22 0 0 25 0 22 0 530013134 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 137780 2286 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 1388 0 0 0 0 0 0 0 16 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 1218 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 787 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 2014 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 903 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 662 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 1792 0 0 0 0 0 0 0 15 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 2148 0 0 0 0 0 0 0 16 0 22 0 530013136 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 184 0 0 0 0 0 0 0 15 0 22 0 530013137 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.76 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) S 16227 16229 16197 0 -1 4202560 5422 0 0 0 76 0 0 0 15 0 22 0 530013139 16078209024 137780 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=1049.03 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 200158 0 0 0 104867 36 0 0 25 0 22 0 530013169 16078209024 77210 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505819888 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=1048.48 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 190966 0 0 0 104814 34 0 0 25 0 22 0 530013169 16078209024 77210 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912506061698 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=1048.46 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 205351 0 0 0 104809 37 0 0 25 0 22 0 530013169 16078209024 77210 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912506061943 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4223.13
Current children cumulated vsize (KiB) 15701376

[startup+1122.3 s]
/proc/loadavg: 8.06 8.02 7.77 9/220 16308
/proc/meminfo: memFree=29224940/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=4461.69 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 1545127 0 1 0 445793 376 0 0 25 0 22 0 530013134 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 81366 2300 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=3.15 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 82377 0 0 0 296 19 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=3.11 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 81205 0 0 0 295 16 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=3.15 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 83107 0 0 0 297 18 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=3.19 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 81672 0 0 0 299 20 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=3.16 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 84649 0 0 0 296 20 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=3.1 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 84804 0 0 0 293 17 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=3.09 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 86797 0 0 0 291 18 0 0 16 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=3.17 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 83238 0 0 0 301 16 0 0 15 0 22 0 530013136 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=2.17 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 4109 0 0 0 151 66 0 0 15 0 22 0 530013137 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.92 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) S 16227 16229 16197 0 -1 4202560 5450 0 0 0 92 0 0 0 15 0 22 0 530013139 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16245] ppid=16227 vsize=15701376 CPUtime=1.4 cores=1,3,5,7
/proc/16229/task/16245/stat : 16245 (java) S 16227 16229 16197 0 -1 4202560 10215 0 0 0 139 1 0 0 16 0 22 0 530013140 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16246] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16246/stat : 16246 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013140 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16247] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16247/stat : 16247 (java) S 16227 16229 16197 0 -1 4202560 62 0 0 0 0 0 0 0 15 0 22 0 530013140 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16271] ppid=16227 vsize=15701376 CPUtime=1107.5 cores=1,3,5,7
/proc/16229/task/16271/stat : 16271 (java) R 16227 16229 16197 0 -1 4202560 210776 0 0 0 110711 39 0 0 25 0 22 0 530013169 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505912046 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=1108.38 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 211642 0 0 0 110799 39 0 0 25 0 22 0 530013169 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505865358 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=1107.78 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 201973 0 0 0 110742 36 0 0 25 0 22 0 530013169 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912506162113 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=1107.6 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 217138 0 0 0 110720 40 0 0 25 0 22 0 530013169 16078209024 81366 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912506061146 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4461.69
Current children cumulated vsize (KiB) 15701376

[startup+1182.3 s]
/proc/loadavg: 8.10 8.05 7.80 10/220 16310
/proc/meminfo: memFree=29217060/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=4700.27 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 1626798 0 1 0 469634 393 0 0 25 0 22 0 530013134 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 92188 2300 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=3.3 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 85087 0 0 0 311 19 0 0 16 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=3.25 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 83805 0 0 0 309 16 0 0 15 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=3.32 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 85930 0 0 0 313 19 0 0 16 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=3.33 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 83965 0 0 0 313 20 0 0 16 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=3.33 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 87335 0 0 0 312 21 0 0 15 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=3.26 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 87496 0 0 0 308 18 0 0 15 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=3.26 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 89822 0 0 0 307 19 0 0 16 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=3.32 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 85669 0 0 0 315 17 0 0 15 0 22 0 530013136 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=2.29 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 4338 0 0 0 160 69 0 0 15 0 22 0 530013137 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.92 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) S 16227 16229 16197 0 -1 4202560 5451 0 0 0 92 0 0 0 15 0 22 0 530013139 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16245] ppid=16227 vsize=15701376 CPUtime=1.41 cores=1,3,5,7
/proc/16229/task/16245/stat : 16245 (java) S 16227 16229 16197 0 -1 4202560 10215 0 0 0 140 1 0 0 15 0 22 0 530013140 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16246] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16246/stat : 16246 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013140 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16247] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16247/stat : 16247 (java) S 16227 16229 16197 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 530013140 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16271] ppid=16227 vsize=15701376 CPUtime=1166.78 cores=1,3,5,7
/proc/16229/task/16271/stat : 16271 (java) R 16227 16229 16197 0 -1 4202560 225265 0 0 0 116636 42 0 0 25 0 22 0 530013169 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 47489462117187 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=1167.64 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 227144 0 0 0 116724 40 0 0 25 0 22 0 530013169 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505937736 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=1167.09 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 216849 0 0 0 116672 37 0 0 25 0 22 0 530013169 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505891105 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=1166.92 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 232448 0 0 0 116650 42 0 0 25 0 22 0 530013169 16078209024 92188 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505816588 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4700.27
Current children cumulated vsize (KiB) 15701376



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.4 s]
/proc/loadavg: 7.85 8.00 7.79 6/216 16358
/proc/meminfo: memFree=30465772/32951124 swapFree=67111448/67111528
[pid=16229] ppid=16227 vsize=15701376 CPUtime=4800.06 cores=1,3,5,7
/proc/16229/stat : 16229 (java) S 16227 16229 16197 0 -1 4202496 1650738 0 1 0 479606 400 0 0 25 0 22 0 530013134 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16229/statm: 3925344 84834 2300 9 0 3916063 0
[pid=16229/tid=16231] ppid=16227 vsize=15701376 CPUtime=0.66 cores=1,3,5,7
/proc/16229/task/16231/stat : 16231 (java) S 16227 16229 16197 0 -1 4202560 14528 0 1 0 63 3 0 0 20 0 22 0 530013135 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16232] ppid=16227 vsize=15701376 CPUtime=3.39 cores=1,3,5,7
/proc/16229/task/16232/stat : 16232 (java) S 16227 16229 16197 0 -1 4202560 85727 0 0 0 319 20 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16233] ppid=16227 vsize=15701376 CPUtime=3.33 cores=1,3,5,7
/proc/16229/task/16233/stat : 16233 (java) S 16227 16229 16197 0 -1 4202560 84197 0 0 0 317 16 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16234] ppid=16227 vsize=15701376 CPUtime=3.39 cores=1,3,5,7
/proc/16229/task/16234/stat : 16234 (java) S 16227 16229 16197 0 -1 4202560 86383 0 0 0 320 19 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16235] ppid=16227 vsize=15701376 CPUtime=3.41 cores=1,3,5,7
/proc/16229/task/16235/stat : 16235 (java) S 16227 16229 16197 0 -1 4202560 84727 0 0 0 320 21 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16236] ppid=16227 vsize=15701376 CPUtime=3.4 cores=1,3,5,7
/proc/16229/task/16236/stat : 16236 (java) S 16227 16229 16197 0 -1 4202560 88025 0 0 0 319 21 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16237] ppid=16227 vsize=15701376 CPUtime=3.34 cores=1,3,5,7
/proc/16229/task/16237/stat : 16237 (java) S 16227 16229 16197 0 -1 4202560 88699 0 0 0 315 19 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16238] ppid=16227 vsize=15701376 CPUtime=3.33 cores=1,3,5,7
/proc/16229/task/16238/stat : 16238 (java) S 16227 16229 16197 0 -1 4202560 90789 0 0 0 314 19 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 3 0 0 0
[pid=16229/tid=16239] ppid=16227 vsize=15701376 CPUtime=3.4 cores=1,3,5,7
/proc/16229/task/16239/stat : 16239 (java) S 16227 16229 16197 0 -1 4202560 86195 0 0 0 323 17 0 0 15 0 22 0 530013136 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16240] ppid=16227 vsize=15701376 CPUtime=2.35 cores=1,3,5,7
/proc/16229/task/16240/stat : 16240 (java) S 16227 16229 16197 0 -1 4202560 4412 0 0 0 164 71 0 0 15 0 22 0 530013137 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 0 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16241] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16241/stat : 16241 (java) S 16227 16229 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16242] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16242/stat : 16242 (java) S 16227 16229 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530013137 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16243] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16243/stat : 16243 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013139 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820989361 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16244] ppid=16227 vsize=15701376 CPUtime=0.92 cores=1,3,5,7
/proc/16229/task/16244/stat : 16244 (java) S 16227 16229 16197 0 -1 4202560 5451 0 0 0 92 0 0 0 15 0 22 0 530013139 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16245] ppid=16227 vsize=15701376 CPUtime=1.41 cores=1,3,5,7
/proc/16229/task/16245/stat : 16245 (java) S 16227 16229 16197 0 -1 4202560 10215 0 0 0 140 1 0 0 15 0 22 0 530013140 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 1 0 0 0
[pid=16229/tid=16246] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16246/stat : 16246 (java) S 16227 16229 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530013140 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820981657 0 4 0 16800975 18446604471132991936 0 0 -1 5 0 0 0
[pid=16229/tid=16247] ppid=16227 vsize=15701376 CPUtime=0 cores=1,3,5,7
/proc/16229/task/16247/stat : 16247 (java) S 16227 16229 16197 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 530013140 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 230820982272 0 4 0 16800975 18446604471132991936 0 0 -1 7 0 0 0
[pid=16229/tid=16271] ppid=16227 vsize=15701376 CPUtime=1191.52 cores=1,3,5,7
/proc/16229/task/16271/stat : 16271 (java) R 16227 16229 16197 0 -1 4202560 229899 0 0 0 119109 43 0 0 25 0 22 0 530013169 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505891138 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16229/tid=16272] ppid=16227 vsize=15701376 CPUtime=1192.45 cores=1,3,5,7
/proc/16229/task/16272/stat : 16272 (java) R 16227 16229 16197 0 -1 4202560 231785 0 0 0 119204 41 0 0 25 0 22 0 530013169 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505785194 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16229/tid=16273] ppid=16227 vsize=15701376 CPUtime=1191.86 cores=1,3,5,7
/proc/16229/task/16273/stat : 16273 (java) R 16227 16229 16197 0 -1 4202560 221255 0 0 0 119148 38 0 0 25 0 22 0 530013169 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505865770 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16229/tid=16274] ppid=16227 vsize=15701376 CPUtime=1191.75 cores=1,3,5,7
/proc/16229/task/16274/stat : 16274 (java) R 16227 16229 16197 0 -1 4202560 236998 0 0 0 119132 43 0 0 25 0 22 0 530013169 16078209024 84834 33554432000 1073741824 1073778376 140735145671520 18446744073709551615 46912505785201 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 15701376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1207.43
CPU time (s): 4800.12
CPU user time (s): 4796.09
CPU system time (s): 4.02539
CPU usage (%): 397.548
Max. virtual memory (cumulated for all children) (KiB): 15702896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.09
system time used= 4.02539
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1650765
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 291306
involuntary context switches= 162862

runsolver used 2.12368 second user time and 4.51731 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-30 19:22:07
IDJOB=3313135
IDBENCH=83256
IDSOLVER=1699
FILE ID=node104/3313135-1304184127
RUNJOBID= node104-1304184127-16216
PBS_JOBID= 13172466
Free space on /tmp= 72544 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-5_528.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313135-1304184127/watcher-3313135-1304184127 -o /tmp/evaluation-result-3313135-1304184127/solver-3313135-1304184127 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313135-1304184127.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7c7070bd15b57ddd9a06dd3709baef54
RANDOM SEED=1588583316

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30889840 kB
Buffers:        428044 kB
Cached:        1153676 kB
SwapCached:         80 kB
Active:         207964 kB
Inactive:      1441796 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30889840 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            2060 kB
Writeback:           0 kB
AnonPages:       68884 kB
Mapped:          13648 kB
Slab:           345448 kB
PageTables:       4856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   190788 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72540 MiB
End job on node104 at 2011-04-30 19:42:16