Trace number 3312204

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 1675.42 1300.23

General information on the benchmark

NameSAT-Race-2010-CNF/software-verification/
nec/hard-18-U-10652.cnf
MD5SUMf0f11935e861485056485b47c5e1a7c3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3.08
Satisfiable
(Un)Satisfiability was proved
Number of variables1987351
Number of clauses5963534
Sum of the clauses size14253662
Maximum clause length1155
Minimum clause length1
Number of clauses of size 1109
Number of clauses of size 23971661
Number of clauses of size 31984242
Number of clauses of size 4766
Number of clauses of size 5765
Number of clauses of size over 55991

Solver Data 

0.05/0.36	47:11 INFO : Reading from input HOME/instance-3312204-1304189230.cnf
19.38/19.12	Executor set job limit to 1000000
19.38/19.12	Executor set job limit to 1000000
19.38/19.12	Executor set job limit to 1000000
19.38/19.12	Executor set job limit to 1000000
19.38/19.12	Starting Executor!
19.38/19.12	Starting Executor!
19.38/19.12	Starting Executor!
19.38/19.12	Starting Executor!
916.52/907.47	02:18 INFO : 1767001 variables remaining out of 1987351
916.52/907.47	02:18 INFO : 69878129 literals remaining out of 20217196

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312204-1304189230/watcher-3312204-1304189230 -o /tmp/evaluation-result-3312204-1304189230/solver-3312204-1304189230 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312204-1304189230.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/30597/stat : 30597 (runsolver) S 30595 30597 29917 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 1 0 530523482 12083200 51 33554432000 4194304 5434984 140737379869168 18446744073709551615 4881607 0 2147483391 4096 24578 18446744071699960631 0 0 17 5 0 0 0
/proc/30597/statm: 2950 51 31 303 0 2644 0

[startup+0.01784 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/30597/stat : 30597 (run) S 30595 30597 29917 0 -1 4202496 320 0 0 0 0 0 0 0 18 0 1 0 530523482 8908800 256 33554432000 4194304 4922060 140734298955456 18446744073709551615 253640855397 0 2147483391 4100 65536 18446744071699199166 0 0 17 7 0 0 0
/proc/30597/statm: 2175 256 215 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100857 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=9100 CPUtime=0 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 486 0 0 0 0 0 0 0 17 0 1 0 530523482 9318400 147 33554432000 1073741824 1073778376 140735295197616 18446744073709551615 253640857600 0 2147483391 4096 0 18446744071699199166 0 0 17 1 0 0 0
/proc/30597/statm: 2275 147 118 9 0 67 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9100

[startup+0.300781 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15609780 CPUtime=0.05 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 4178 0 1 0 4 1 0 0 16 0 18 0 530523482 15984414720 3617 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3902445 3618 1755 9 0 3893164 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609780

[startup+1.29764 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15680872 CPUtime=1.31 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 49275 0 1 0 124 7 0 0 16 0 18 0 530523482 16057212928 47721 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3920218 47721 2223 9 0 3910937 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 15680872

[startup+1.50057 s]
/proc/loadavg: 3.71 4.06 5.04 1/173 30597
/proc/meminfo: memFree=29832428/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15680872 CPUtime=1.5 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 63585 0 1 0 142 8 0 0 16 0 18 0 530523482 16057212928 62031 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3920218 62038 2223 9 0 3910937 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 15680872

[startup+3.10127 s]
/proc/loadavg: 3.73 4.06 5.03 5/212 30638
/proc/meminfo: memFree=28665112/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15680872 CPUtime=3.18 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 144138 0 1 0 300 18 0 0 16 0 18 0 530523482 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3920218 142579 2241 9 0 3910937 0
[pid=30597/tid=30599] ppid=30595 vsize=15680872 CPUtime=2.8 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) R 30595 30597 29917 0 -1 4202560 120084 0 1 0 266 14 0 0 21 0 18 0 530523497 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505643099 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30597/tid=30600] ppid=30595 vsize=15680872 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30600/stat : 30600 (java) S 30595 30597 29917 0 -1 4202560 2745 0 0 0 1 0 0 0 16 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30601] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30601/stat : 30601 (java) S 30595 30597 29917 0 -1 4202560 2 0 0 0 0 0 0 0 15 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30602] ppid=30595 vsize=15680872 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 8 0 0 0 1 0 0 0 15 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15680872 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 6379 0 0 0 0 1 0 0 16 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15680872 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 4095 0 0 0 1 0 0 0 15 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 5268 0 0 0 0 0 0 0 15 0 18 0 530523507 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 443 0 0 0 0 0 0 0 15 0 18 0 530523508 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 530523509 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 18 0 530523509 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 530523511 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15680872 CPUtime=0.13 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 1379 0 0 0 13 0 0 0 16 0 18 0 530523511 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15680872 CPUtime=0.14 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 2346 0 0 0 14 0 0 0 15 0 18 0 530523511 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 530523511 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15680872 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 530523511 16057212928 142579 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.18
Current children cumulated vsize (KiB) 15680872

[startup+6.3067 s]
/proc/loadavg: 3.73 4.06 5.03 3/212 30638
/proc/meminfo: memFree=27524180/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15679796 CPUtime=6.47 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 286185 0 1 0 613 34 0 0 16 0 18 0 530523482 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3919949 283614 2241 9 0 3910668 0
[pid=30597/tid=30599] ppid=30595 vsize=15679796 CPUtime=5.97 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) R 30595 30597 29917 0 -1 4202560 246462 0 1 0 569 28 0 0 20 0 18 0 530523497 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505643088 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30597/tid=30600] ppid=30595 vsize=15679796 CPUtime=0.03 cores=1,3,5,7
/proc/30597/task/30600/stat : 30600 (java) S 30595 30597 29917 0 -1 4202560 7868 0 0 0 3 0 0 0 16 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30601] ppid=30595 vsize=15679796 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30601/stat : 30601 (java) S 30595 30597 29917 0 -1 4202560 2 0 0 0 1 0 0 0 15 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30602] ppid=30595 vsize=15679796 CPUtime=0.02 cores=1,3,5,7
/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 10249 0 0 0 1 1 0 0 16 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15679796 CPUtime=0.01 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 1 0 0 0 16 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15679796 CPUtime=0.03 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 6380 0 0 0 2 1 0 0 16 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15679796 CPUtime=0.02 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 4095 0 0 0 2 0 0 0 15 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15679796 CPUtime=0.02 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 5269 0 0 0 2 0 0 0 15 0 18 0 530523507 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 18 0 530523508 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 530523509 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 18 0 530523509 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 530523511 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15679796 CPUtime=0.13 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 1379 0 0 0 13 0 0 0 16 0 18 0 530523511 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15679796 CPUtime=0.14 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 2346 0 0 0 14 0 0 0 15 0 18 0 530523511 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 530523511 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 530523511 16056111104 283614 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.47
Current children cumulated vsize (KiB) 15679796

[startup+12.7015 s]
/proc/loadavg: 3.59 4.03 5.01 3/212 30638
/proc/meminfo: memFree=26831380/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15679796 CPUtime=12.98 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 461208 0 1 0 1243 55 0 0 16 0 18 0 530523482 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3919949 458615 2241 9 0 3910668 0
[pid=30597/tid=30599] ppid=30595 vsize=15679796 CPUtime=12.34 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) R 30595 30597 29917 0 -1 4202560 400621 0 1 0 1187 47 0 0 25 0 18 0 530523497 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505640866 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30597/tid=30600] ppid=30595 vsize=15679796 CPUtime=0.04 cores=1,3,5,7
/proc/30597/task/30600/stat : 30600 (java) S 30595 30597 29917 0 -1 4202560 7868 0 0 0 4 0 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30601] ppid=30595 vsize=15679796 CPUtime=0.03 cores=1,3,5,7
/proc/30597/task/30601/stat : 30601 (java) S 30595 30597 29917 0 -1 4202560 3 0 0 0 3 0 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30602] ppid=30595 vsize=15679796 CPUtime=0.04 cores=1,3,5,7
/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 10250 0 0 0 3 1 0 0 16 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15679796 CPUtime=0.02 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 2 0 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15679796 CPUtime=0.03 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 3 0 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15679796 CPUtime=0.05 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 6380 0 0 0 4 1 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15679796 CPUtime=0.06 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 24575 0 0 0 4 2 0 0 16 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15679796 CPUtime=0.03 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 5269 0 0 0 3 0 0 0 15 0 18 0 530523507 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 1128 0 0 0 0 0 0 0 15 0 18 0 530523508 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 530523509 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 18 0 530523509 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 530523511 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15679796 CPUtime=0.13 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 1379 0 0 0 13 0 0 0 15 0 18 0 530523511 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15679796 CPUtime=0.14 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 2346 0 0 0 14 0 0 0 15 0 18 0 530523511 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 530523511 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15679796 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 530523511 16056111104 458615 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.98

################
# More data... #
################

/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 175844 0 0 0 248 23 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15707712 CPUtime=3.03 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 148240 0 0 0 280 23 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15707712 CPUtime=3.49 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 167659 0 0 0 324 25 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15707712 CPUtime=3.11 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 247842 0 0 0 278 33 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15707712 CPUtime=3.47 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 189720 0 0 0 321 26 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15707712 CPUtime=4.13 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 191927 0 0 0 381 32 0 0 16 0 22 0 530523507 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15707712 CPUtime=16.46 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 160696 0 0 0 1265 381 0 0 15 0 22 0 530523508 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 530523511 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15707712 CPUtime=1.86 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 11881 0 0 0 185 1 0 0 16 0 22 0 530523511 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15707712 CPUtime=0.98 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 3790 0 0 0 98 0 0 0 15 0 22 0 530523511 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530523511 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 530523511 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30639] ppid=30595 vsize=15707712 CPUtime=23.2 cores=1,3,5,7
/proc/30597/task/30639/stat : 30639 (java) S 30595 30597 29917 0 -1 4202560 18722 0 0 0 2318 2 0 0 15 0 22 0 530525394 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30640] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30640/stat : 30640 (java) S 30595 30597 29917 0 -1 4202560 23 0 0 0 0 0 0 0 15 0 22 0 530525394 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30641] ppid=30595 vsize=15707712 CPUtime=255.9 cores=1,3,5,7
/proc/30597/task/30641/stat : 30641 (java) R 30595 30597 29917 0 -1 4202560 18633 0 0 0 25589 1 0 0 25 0 22 0 530525394 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912506436513 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30597/tid=30642] ppid=30595 vsize=15707712 CPUtime=5.1 cores=1,3,5,7
/proc/30597/task/30642/stat : 30642 (java) S 30595 30597 29917 0 -1 4202560 36 0 0 0 510 0 0 0 15 0 22 0 530525394 16084697088 2021699 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1227.18
Current children cumulated vsize (KiB) 15707712

[startup+1242.3 s]
/proc/loadavg: 6.73 5.52 5.14 9/220 30691
/proc/meminfo: memFree=9566864/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15707712 CPUtime=1445.93 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 2743007 0 1 0 143731 862 0 0 16 0 22 0 530523482 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3926928 1519038 2302 9 0 3917647 0
[pid=30597/tid=30599] ppid=30595 vsize=15707712 CPUtime=897.94 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) S 30595 30597 29917 0 -1 4202560 400795 0 1 0 89745 49 0 0 25 0 22 0 530523497 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30600] ppid=30595 vsize=15707712 CPUtime=3.79 cores=1,3,5,7
/proc/30597/task/30600/stat : 30600 (java) S 30595 30597 29917 0 -1 4202560 193435 0 0 0 354 25 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30601] ppid=30595 vsize=15707712 CPUtime=3.41 cores=1,3,5,7
/proc/30597/task/30601/stat : 30601 (java) S 30595 30597 29917 0 -1 4202560 433390 0 0 0 287 54 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30602] ppid=30595 vsize=15707712 CPUtime=3.64 cores=1,3,5,7
/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 251593 0 0 0 328 36 0 0 16 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15707712 CPUtime=4.04 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 283489 0 0 0 364 40 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15707712 CPUtime=4.56 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 199785 0 0 0 427 29 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15707712 CPUtime=4.06 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 336092 0 0 0 359 47 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15707712 CPUtime=4.43 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 215254 0 0 0 413 30 0 0 16 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15707712 CPUtime=4.92 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 212228 0 0 0 457 35 0 0 15 0 22 0 530523507 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15707712 CPUtime=17.79 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 160698 0 0 0 1382 397 0 0 15 0 22 0 530523508 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 530523511 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15707712 CPUtime=2.37 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 13475 0 0 0 236 1 0 0 15 0 22 0 530523511 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15707712 CPUtime=1.23 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 3822 0 0 0 123 0 0 0 15 0 22 0 530523511 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530523511 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 530523511 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30639] ppid=30595 vsize=15707712 CPUtime=74.26 cores=1,3,5,7
/proc/30597/task/30639/stat : 30639 (java) R 30595 30597 29917 0 -1 4202560 18739 0 0 0 7395 31 0 0 18 0 22 0 530525394 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912506296025 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30597/tid=30640] ppid=30595 vsize=15707712 CPUtime=51.11 cores=1,3,5,7
/proc/30597/task/30640/stat : 30640 (java) R 30595 30597 29917 0 -1 4202560 40 0 0 0 5084 27 0 0 18 0 22 0 530525394 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912506135330 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30597/tid=30641] ppid=30595 vsize=15707712 CPUtime=309.25 cores=1,3,5,7
/proc/30597/task/30641/stat : 30641 (java) R 30595 30597 29917 0 -1 4202560 18650 0 0 0 30899 26 0 0 18 0 22 0 530525394 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505713222 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30597/tid=30642] ppid=30595 vsize=15707712 CPUtime=58.97 cores=1,3,5,7
/proc/30597/task/30642/stat : 30642 (java) R 30595 30597 29917 0 -1 4202560 63 0 0 0 5871 26 0 0 18 0 22 0 530525394 16084697088 1519038 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912506318026 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1445.93
Current children cumulated vsize (KiB) 15707712



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 7.04 5.84 5.27 5/194 30712
/proc/meminfo: memFree=23700004/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=15707712 CPUtime=1675.15 cores=1,3,5,7
/proc/30597/stat : 30597 (java) S 30595 30597 29917 0 -1 4202496 2779077 0 1 0 166496 1019 0 0 16 0 22 0 530523482 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 3926928 1544853 2302 9 0 3917647 0
[pid=30597/tid=30599] ppid=30595 vsize=15707712 CPUtime=897.94 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) S 30595 30597 29917 0 -1 4202560 400795 0 1 0 89745 49 0 0 25 0 22 0 530523497 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30600] ppid=30595 vsize=15707712 CPUtime=3.96 cores=1,3,5,7
/proc/30597/task/30600/stat : 30600 (java) S 30595 30597 29917 0 -1 4202560 193836 0 0 0 371 25 0 0 16 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30601] ppid=30595 vsize=15707712 CPUtime=3.53 cores=1,3,5,7
/proc/30597/task/30601/stat : 30601 (java) S 30595 30597 29917 0 -1 4202560 434140 0 0 0 299 54 0 0 15 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 7 0 0 0
[pid=30597/tid=30602] ppid=30595 vsize=15707712 CPUtime=3.77 cores=1,3,5,7
/proc/30597/task/30602/stat : 30602 (java) S 30595 30597 29917 0 -1 4202560 252286 0 0 0 341 36 0 0 15 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30603] ppid=30595 vsize=15707712 CPUtime=4.18 cores=1,3,5,7
/proc/30597/task/30603/stat : 30603 (java) S 30595 30597 29917 0 -1 4202560 283875 0 0 0 377 41 0 0 15 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30604] ppid=30595 vsize=15707712 CPUtime=4.69 cores=1,3,5,7
/proc/30597/task/30604/stat : 30604 (java) S 30595 30597 29917 0 -1 4202560 200440 0 0 0 440 29 0 0 15 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30605] ppid=30595 vsize=15707712 CPUtime=4.19 cores=1,3,5,7
/proc/30597/task/30605/stat : 30605 (java) S 30595 30597 29917 0 -1 4202560 337081 0 0 0 371 48 0 0 16 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30606] ppid=30595 vsize=15707712 CPUtime=4.56 cores=1,3,5,7
/proc/30597/task/30606/stat : 30606 (java) S 30595 30597 29917 0 -1 4202560 215875 0 0 0 425 31 0 0 16 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30607] ppid=30595 vsize=15707712 CPUtime=5.06 cores=1,3,5,7
/proc/30597/task/30607/stat : 30607 (java) S 30595 30597 29917 0 -1 4202560 212461 0 0 0 471 35 0 0 16 0 22 0 530523507 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30608] ppid=30595 vsize=15707712 CPUtime=17.8 cores=1,3,5,7
/proc/30597/task/30608/stat : 30608 (java) S 30595 30597 29917 0 -1 4202560 160813 0 0 0 1383 397 0 0 15 0 22 0 530523508 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 0 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30609] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30609/stat : 30609 (java) S 30595 30597 29917 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30610] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30610/stat : 30610 (java) S 30595 30597 29917 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 530523509 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30611] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30611/stat : 30611 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 530523511 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652683185 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30612] ppid=30595 vsize=15707712 CPUtime=2.37 cores=1,3,5,7
/proc/30597/task/30612/stat : 30612 (java) S 30595 30597 29917 0 -1 4202560 13475 0 0 0 236 1 0 0 15 0 22 0 530523511 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 1 0 0 0
[pid=30597/tid=30613] ppid=30595 vsize=15707712 CPUtime=1.23 cores=1,3,5,7
/proc/30597/task/30613/stat : 30613 (java) S 30595 30597 29917 0 -1 4202560 3822 0 0 0 123 0 0 0 15 0 22 0 530523511 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 5 0 0 0
[pid=30597/tid=30614] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30614/stat : 30614 (java) S 30595 30597 29917 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530523511 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652675481 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30615] ppid=30595 vsize=15707712 CPUtime=0 cores=1,3,5,7
/proc/30597/task/30615/stat : 30615 (java) S 30595 30597 29917 0 -1 4202560 77 0 0 0 0 0 0 0 15 0 22 0 530523511 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676096 0 4 0 16800975 18446604460885168576 0 0 -1 3 0 0 0
[pid=30597/tid=30639] ppid=30595 vsize=15707712 CPUtime=131.26 cores=1,3,5,7
/proc/30597/task/30639/stat : 30639 (java) R 30595 30597 29917 0 -1 4202560 27387 0 0 0 13055 71 0 0 18 0 22 0 530525394 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505713286 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30597/tid=30640] ppid=30595 vsize=15707712 CPUtime=108.14 cores=1,3,5,7
/proc/30597/task/30640/stat : 30640 (java) R 30595 30597 29917 0 -1 4202560 7842 0 0 0 10749 65 0 0 18 0 22 0 530525394 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912506671661 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30597/tid=30641] ppid=30595 vsize=15707712 CPUtime=366.29 cores=1,3,5,7
/proc/30597/task/30641/stat : 30641 (java) R 30595 30597 29917 0 -1 4202560 24632 0 0 0 36564 65 0 0 18 0 22 0 530525394 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 253652676550 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30597/tid=30642] ppid=30595 vsize=15707712 CPUtime=116.01 cores=1,3,5,7
/proc/30597/task/30642/stat : 30642 (java) R 30595 30597 29917 0 -1 4202560 8854 0 0 0 11537 64 0 0 18 0 22 0 530525394 16084697088 1544853 33554432000 1073741824 1073778376 140733617115872 18446744073709551615 46912505366048 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1675.15
Current children cumulated vsize (KiB) 15707712

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.11 s]
/proc/loadavg: 7.04 5.84 5.27 2/175 30715
/proc/meminfo: memFree=26362776/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=0 CPUtime=1675.29 cores=1,3,5,7
/proc/30597/stat : 30597 (java) Z 30595 30597 29917 0 -1 4203548 2779104 0 1 0 166501 1028 0 0 15 0 2 0 530523482 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 0 0 0 0 0 0 0
[pid=30597/tid=30599] ppid=30595 vsize=0 CPUtime=898.04 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) R 30595 30597 29917 0 -1 4203588 400795 0 1 0 89745 59 0 0 18 0 2 0 530523497 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1675.29
Current children cumulated vsize (KiB) 0

[startup+1300.21 s]
/proc/loadavg: 7.04 5.84 5.27 2/175 30715
/proc/meminfo: memFree=26362776/32951124 swapFree=67111364/67111528
[pid=30597] ppid=30595 vsize=0 CPUtime=1675.38 cores=1,3,5,7
/proc/30597/stat : 30597 (java) Z 30595 30597 29917 0 -1 4203548 2779104 0 1 0 166501 1037 0 0 15 0 2 0 530523482 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/30597/statm: 0 0 0 0 0 0 0
[pid=30597/tid=30599] ppid=30595 vsize=0 CPUtime=898.13 cores=1,3,5,7
/proc/30597/task/30599/stat : 30599 (java) R 30595 30597 29917 0 -1 4203588 400795 0 1 0 89745 68 0 0 18 0 2 0 530523497 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1675.38
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1300.23
CPU time (s): 1675.42
CPU user time (s): 1665.02
CPU system time (s): 10.4014
CPU usage (%): 128.855
Max. virtual memory (cumulated for all children) (KiB): 15716752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1665.02
system time used= 10.4014
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2779104
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 589095
involuntary context switches= 88413

runsolver used 2.19167 second user time and 4.93025 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-30 20:47:11
IDJOB=3312204
IDBENCH=88172
IDSOLVER=1698
FILE ID=node106/3312204-1304189230
RUNJOBID= node106-1304189230-30586
PBS_JOBID= 13172468
Free space on /tmp= 72708 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT-Race-2010-CNF/software-verification/nec/hard-18-U-10652.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312204-1304189230/watcher-3312204-1304189230 -o /tmp/evaluation-result-3312204-1304189230/solver-3312204-1304189230 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312204-1304189230.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f0f11935e861485056485b47c5e1a7c3
RANDOM SEED=1184246617

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29835388 kB
Buffers:        290716 kB
Cached:        2541748 kB
SwapCached:         88 kB
Active:        1155760 kB
Inactive:      1740924 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29835388 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:          195608 kB
Writeback:           0 kB
AnonPages:       63328 kB
Mapped:          14484 kB
Slab:           154316 kB
PageTables:       4352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72768 MiB
End job on node106 at 2011-04-30 21:08:53