Trace number 3312080

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4720.32 1300.37

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top28.cnf
MD5SUM005e29e99454a24085199b085e720b2f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark368.61
Satisfiable
(Un)Satisfiability was proved
Number of variables88763
Number of clauses282870
Sum of the clauses size691774
Maximum clause length3284
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2171374
Number of clauses of size 3109718
Number of clauses of size 4405
Number of clauses of size 526
Number of clauses of size over 51346

Solver Data 

0.10/0.11	41:31 INFO : Reading from input HOME/instance-3312080-1304181690.cnf
1.34/1.18	Executor set job limit to 1000000
1.34/1.18	Executor set job limit to 1000000
1.34/1.18	Executor set job limit to 1000000
1.34/1.18	Executor set job limit to 1000000
1.34/1.18	Starting Executor!
1.34/1.18	Starting Executor!
1.34/1.18	Starting Executor!
1.34/1.18	Starting Executor!
5.09/3.12	41:34 INFO : Found 8750 xor gates
32.31/29.27	42:00 INFO : 81487 variables remaining out of 88763
32.31/29.27	42:00 INFO : 5761931 literals remaining out of 869644

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312080-1304181690/watcher-3312080-1304181690 -o /tmp/evaluation-result-3312080-1304181690/solver-3312080-1304181690 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312080-1304181690.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.49 7.04 7.68 5/194 15557
/proc/meminfo: memFree=20812092/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=24056 CPUtime=0 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 1391 0 0 0 0 0 0 0 21 0 2 0 529768794 24633344 870 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 6535 871 667 9 0 381 0
[pid=15557/tid=15558] ppid=15555 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) S 15555 15557 15033 0 -1 4202560 56 0 0 0 0 0 0 0 22 0 2 0 529768794 26714112 885 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237273955975 0 2147483391 4096 0 18446744071699199166 0 0 -1 3 0 0 0

[startup+0.049684 s]
/proc/loadavg: 4.49 7.04 7.68 5/194 15557
/proc/meminfo: memFree=20812092/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15609648 CPUtime=0.03 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 4052 0 1 0 3 0 0 0 21 0 18 0 529768794 15984279552 3491 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3902412 3492 1753 9 0 3893131 0
[pid=15557/tid=15558] ppid=15555 vsize=15609648 CPUtime=0.03 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 2634 0 1 0 3 0 0 0 25 0 18 0 529768794 15984279552 3492 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 47729108803491 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15609648

[startup+0.100612 s]
/proc/loadavg: 4.49 7.04 7.68 5/194 15557
/proc/meminfo: memFree=20812092/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15676372 CPUtime=0.1 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 5655 0 1 0 10 0 0 0 21 0 18 0 529768794 16052604928 5055 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3919093 5056 2118 9 0 3909812 0
[pid=15557/tid=15558] ppid=15555 vsize=15676372 CPUtime=0.08 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 3493 0 1 0 8 0 0 0 25 0 18 0 529768794 16052604928 5056 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 47729108803491 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676372

[startup+0.30058 s]
/proc/loadavg: 4.49 7.04 7.68 5/194 15557
/proc/meminfo: memFree=20812092/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15679652 CPUtime=0.51 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 16693 0 1 0 49 2 0 0 21 0 18 0 529768794 16055963648 15150 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3919913 15158 2207 9 0 3910632 0
[pid=15557/tid=15558] ppid=15555 vsize=15679652 CPUtime=0.28 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 11586 0 1 0 27 1 0 0 25 0 18 0 529768794 16055963648 15161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912505640823 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15679652

[startup+0.700507 s]
/proc/loadavg: 4.49 7.04 7.68 5/194 15557
/proc/meminfo: memFree=20812092/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15679652 CPUtime=0.93 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 41913 0 1 0 87 6 0 0 21 0 18 0 529768794 16055963648 40368 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3919913 40368 2223 9 0 3910632 0
[pid=15557/tid=15558] ppid=15555 vsize=15679652 CPUtime=0.68 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 35504 0 1 0 63 5 0 0 25 0 18 0 529768794 16055963648 40368 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290706379 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 15679652

[startup+1.50137 s]
/proc/loadavg: 4.49 7.04 7.68 4/216 15579
/proc/meminfo: memFree=20468068/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15692680 CPUtime=2.04 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 57767 0 1 0 196 8 0 0 21 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3923170 54607 2261 9 0 3913889 0
[pid=15557/tid=15558] ppid=15555 vsize=15692680 CPUtime=1.45 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 35611 0 1 0 140 5 0 0 25 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 47729108792272 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=15557/tid=15560] ppid=15555 vsize=15692680 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15560/stat : 15560 (java) S 15555 15557 15033 0 -1 4202560 4501 0 0 0 2 0 0 0 16 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15561] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15561/stat : 15561 (java) S 15555 15557 15033 0 -1 4202560 365 0 0 0 0 0 0 0 15 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15562] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 26 0 0 0 0 0 0 0 15 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 34 0 0 0 0 0 0 0 15 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15692680 CPUtime=0.01 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 2011 0 0 0 1 0 0 0 16 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15692680 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 3670 0 0 0 2 0 0 0 16 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15692680 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 2353 0 0 0 2 0 0 0 16 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 150 0 0 0 0 0 0 0 15 0 22 0 529768794 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 78 0 0 0 0 0 0 0 15 0 22 0 529768795 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15572] ppid=15555 vsize=15692680 CPUtime=0.22 cores=1,3,5,7
/proc/15557/task/15572/stat : 15572 (java) S 15555 15557 15033 0 -1 4202560 2476 0 0 0 22 0 0 0 15 0 22 0 529768798 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15573] ppid=15555 vsize=15692680 CPUtime=0.23 cores=1,3,5,7
/proc/15557/task/15573/stat : 15573 (java) R 15555 15557 15033 0 -1 4202560 5063 0 0 0 23 0 0 0 16 0 22 0 529768798 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 47729109599532 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=15557/tid=15574] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15574/stat : 15574 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15575] ppid=15555 vsize=15692680 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15575/stat : 15575 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529768798 16069304320 54607 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.04
Current children cumulated vsize (KiB) 15692680

[startup+3.10108 s]
/proc/loadavg: 4.49 7.04 7.68 6/220 15583
/proc/meminfo: memFree=20388924/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15721388 CPUtime=5.09 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 72121 0 1 0 500 9 0 0 21 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3930347 62161 2263 9 0 3921066 0
[pid=15557/tid=15558] ppid=15555 vsize=15721388 CPUtime=2.85 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) D 15555 15557 15033 0 -1 4202560 35623 0 1 0 280 5 0 0 25 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290706379 0 4 0 16800975 18446744071562234166 0 0 -1 5 0 0 0
[pid=15557/tid=15560] ppid=15555 vsize=15721388 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15560/stat : 15560 (java) S 15555 15557 15033 0 -1 4202560 4501 0 0 0 2 0 0 0 16 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15561] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15561/stat : 15561 (java) S 15555 15557 15033 0 -1 4202560 365 0 0 0 0 0 0 0 15 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15562] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 26 0 0 0 0 0 0 0 15 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 34 0 0 0 0 0 0 0 15 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15721388 CPUtime=0.01 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 2011 0 0 0 1 0 0 0 16 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15721388 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 3670 0 0 0 2 0 0 0 16 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15721388 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 2353 0 0 0 2 0 0 0 16 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 150 0 0 0 0 0 0 0 15 0 22 0 529768794 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 78 0 0 0 0 0 0 0 15 0 22 0 529768795 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15572] ppid=15555 vsize=15721388 CPUtime=0.61 cores=1,3,5,7
/proc/15557/task/15572/stat : 15572 (java) S 15555 15557 15033 0 -1 4202560 6084 0 0 0 61 0 0 0 16 0 22 0 529768798 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15573] ppid=15555 vsize=15721388 CPUtime=1.49 cores=1,3,5,7
/proc/15557/task/15573/stat : 15573 (java) S 15555 15557 15033 0 -1 4202560 15796 0 0 0 147 2 0 0 16 0 22 0 529768798 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15574] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15574/stat : 15574 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15575] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15575/stat : 15575 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529768798 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15580] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15580/stat : 15580 (java) S 15555 15557 15033 0 -1 4202560 15 0 0 0 0 0 0 0 15 0 22 0 529768912 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) S 15555 15557 15033 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 529768912 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15582] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15582/stat : 15582 (java) S 15555 15557 15033 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 529768912 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15583] ppid=15555 vsize=15721388 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15583/stat : 15583 (java) S 15555 15557 15033 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 529768912 16098701312 62161 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.09
Current children cumulated vsize (KiB) 15721388

[startup+6.30151 s]
/proc/loadavg: 4.45 6.99 7.66 4/220 15583
/proc/meminfo: memFree=20277636/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15714492 CPUtime=8.61 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 72176 0 1 0 851 10 0 0 21 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3928623 60316 2275 9 0 3919342 0
[pid=15557/tid=15558] ppid=15555 vsize=15714492 CPUtime=6.04 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) R 15555 15557 15033 0 -1 4202560 35639 0 1 0 599 5 0 0 25 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912505583945 0 4 0 16800975 0 0 0 -1 5 0 0 21
[pid=15557/tid=15560] ppid=15555 vsize=15714492 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15560/stat : 15560 (java) S 15555 15557 15033 0 -1 4202560 4501 0 0 0 2 0 0 0 16 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15561] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15561/stat : 15561 (java) S 15555 15557 15033 0 -1 4202560 365 0 0 0 0 0 0 0 15 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15562] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 26 0 0 0 0 0 0 0 15 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 34 0 0 0 0 0 0 0 15 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15714492 CPUtime=0.01 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 2011 0 0 0 1 0 0 0 16 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15714492 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 3670 0 0 0 2 0 0 0 16 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15714492 CPUtime=0.02 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 2353 0 0 0 2 0 0 0 16 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 150 0 0 0 0 0 0 0 15 0 22 0 529768794 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 78 0 0 0 0 0 0 0 15 0 22 0 529768795 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 60316 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0

################
# More data... #
################

/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 293748 0 0 0 332 44 0 0 16 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15714492 CPUtime=3.96 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 323050 0 0 0 345 51 0 0 16 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15714492 CPUtime=4.14 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 261275 0 0 0 373 41 0 0 15 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15714492 CPUtime=3.26 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 287127 0 0 0 285 41 0 0 15 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15714492 CPUtime=4.51 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 309425 0 0 0 402 49 0 0 16 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15714492 CPUtime=3.41 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 260180 0 0 0 302 39 0 0 15 0 22 0 529768794 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15714492 CPUtime=5.14 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 101304 0 0 0 504 10 0 0 15 0 22 0 529768795 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15572] ppid=15555 vsize=15714492 CPUtime=1.61 cores=1,3,5,7
/proc/15557/task/15572/stat : 15572 (java) S 15555 15557 15033 0 -1 4202560 11753 0 0 0 160 1 0 0 15 0 22 0 529768798 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15573] ppid=15555 vsize=15714492 CPUtime=2.14 cores=1,3,5,7
/proc/15557/task/15573/stat : 15573 (java) S 15555 15557 15033 0 -1 4202560 15854 0 0 0 212 2 0 0 16 0 22 0 529768798 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15574] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15574/stat : 15574 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15575] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15575/stat : 15575 (java) S 15555 15557 15033 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 529768798 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15580] ppid=15555 vsize=15714492 CPUtime=1034.2 cores=1,3,5,7
/proc/15557/task/15580/stat : 15580 (java) R 15555 15557 15033 0 -1 4202560 33569 0 0 0 103416 4 0 0 25 0 22 0 529768912 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506416103 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=15714492 CPUtime=1019.22 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) R 15555 15557 15033 0 -1 4202560 15090 0 0 0 101920 2 0 0 25 0 22 0 529768912 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506416103 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=15557/tid=15582] ppid=15555 vsize=15714492 CPUtime=1078.23 cores=1,3,5,7
/proc/15557/task/15582/stat : 15582 (java) R 15555 15557 15033 0 -1 4202560 30861 0 0 0 107819 4 0 0 25 0 22 0 529768912 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506487735 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=15557/tid=15583] ppid=15555 vsize=15714492 CPUtime=1050.08 cores=1,3,5,7
/proc/15557/task/15583/stat : 15583 (java) R 15555 15557 15033 0 -1 4202560 20501 0 0 0 105006 2 0 0 25 0 22 0 529768912 16091639808 2572012 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912505657164 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4249.83
Current children cumulated vsize (KiB) 15714492

[startup+1242.3 s]
/proc/loadavg: 8.12 8.06 7.82 9/220 15676
/proc/meminfo: memFree=10002588/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15714492 CPUtime=4489.46 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 2615738 0 1 0 448549 397 0 0 21 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3928623 2590360 2294 9 0 3919342 0
[pid=15557/tid=15558] ppid=15555 vsize=15714492 CPUtime=28.97 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) S 15555 15557 15033 0 -1 4202560 59915 0 1 0 2889 8 0 0 25 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 21
[pid=15557/tid=15560] ppid=15555 vsize=15714492 CPUtime=2.8 cores=1,3,5,7
/proc/15557/task/15560/stat : 15560 (java) S 15555 15557 15033 0 -1 4202560 207652 0 0 0 250 30 0 0 16 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15561] ppid=15555 vsize=15714492 CPUtime=4.63 cores=1,3,5,7
/proc/15557/task/15561/stat : 15561 (java) S 15555 15557 15033 0 -1 4202560 365879 0 0 0 406 57 0 0 16 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15562] ppid=15555 vsize=15714492 CPUtime=4.04 cores=1,3,5,7
/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 293809 0 0 0 360 44 0 0 16 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15714492 CPUtime=4.14 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 328508 0 0 0 362 52 0 0 15 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15714492 CPUtime=4.29 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 261387 0 0 0 388 41 0 0 15 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15714492 CPUtime=3.51 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 293234 0 0 0 309 42 0 0 15 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15714492 CPUtime=4.84 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 314078 0 0 0 434 50 0 0 16 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15714492 CPUtime=3.59 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 260854 0 0 0 320 39 0 0 15 0 22 0 529768794 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15714492 CPUtime=5.14 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 101328 0 0 0 504 10 0 0 15 0 22 0 529768795 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15572] ppid=15555 vsize=15714492 CPUtime=1.61 cores=1,3,5,7
/proc/15557/task/15572/stat : 15572 (java) S 15555 15557 15033 0 -1 4202560 11753 0 0 0 160 1 0 0 15 0 22 0 529768798 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15573] ppid=15555 vsize=15714492 CPUtime=2.14 cores=1,3,5,7
/proc/15557/task/15573/stat : 15573 (java) S 15555 15557 15033 0 -1 4202560 15854 0 0 0 212 2 0 0 16 0 22 0 529768798 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15574] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15574/stat : 15574 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15575] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15575/stat : 15575 (java) S 15555 15557 15033 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 22 0 529768798 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15580] ppid=15555 vsize=15714492 CPUtime=1093.65 cores=1,3,5,7
/proc/15557/task/15580/stat : 15580 (java) R 15555 15557 15033 0 -1 4202560 33569 0 0 0 109361 4 0 0 25 0 22 0 529768912 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 18446744073699065955 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=15714492 CPUtime=1078.77 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) R 15555 15557 15033 0 -1 4202560 15093 0 0 0 107875 2 0 0 25 0 22 0 529768912 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506661766 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=15557/tid=15582] ppid=15555 vsize=15714492 CPUtime=1137.78 cores=1,3,5,7
/proc/15557/task/15582/stat : 15582 (java) R 15555 15557 15033 0 -1 4202560 30864 0 0 0 113774 4 0 0 25 0 22 0 529768912 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912505583916 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=15557/tid=15583] ppid=15555 vsize=15714492 CPUtime=1109.4 cores=1,3,5,7
/proc/15557/task/15583/stat : 15583 (java) R 15555 15557 15033 0 -1 4202560 20503 0 0 0 110938 2 0 0 25 0 22 0 529768912 16091639808 2590360 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4489.46
Current children cumulated vsize (KiB) 15714492



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.17 8.09 7.84 9/220 15677
/proc/meminfo: memFree=10032892/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=15714492 CPUtime=4719.93 cores=1,3,5,7
/proc/15557/stat : 15557 (java) S 15555 15557 15033 0 -1 4202496 2628721 0 1 0 471594 399 0 0 21 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 3928623 2603313 2294 9 0 3919342 0
[pid=15557/tid=15558] ppid=15555 vsize=15714492 CPUtime=28.97 cores=1,3,5,7
/proc/15557/task/15558/stat : 15558 (java) S 15555 15557 15033 0 -1 4202560 59915 0 1 0 2889 8 0 0 25 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 21
[pid=15557/tid=15560] ppid=15555 vsize=15714492 CPUtime=2.93 cores=1,3,5,7
/proc/15557/task/15560/stat : 15560 (java) S 15555 15557 15033 0 -1 4202560 207652 0 0 0 263 30 0 0 16 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15561] ppid=15555 vsize=15714492 CPUtime=4.69 cores=1,3,5,7
/proc/15557/task/15561/stat : 15561 (java) S 15555 15557 15033 0 -1 4202560 366767 0 0 0 412 57 0 0 15 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15562] ppid=15555 vsize=15714492 CPUtime=4.29 cores=1,3,5,7
/proc/15557/task/15562/stat : 15562 (java) S 15555 15557 15033 0 -1 4202560 297162 0 0 0 384 45 0 0 16 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15563] ppid=15555 vsize=15714492 CPUtime=4.39 cores=1,3,5,7
/proc/15557/task/15563/stat : 15563 (java) S 15555 15557 15033 0 -1 4202560 333007 0 0 0 386 53 0 0 16 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15564] ppid=15555 vsize=15714492 CPUtime=4.48 cores=1,3,5,7
/proc/15557/task/15564/stat : 15564 (java) S 15555 15557 15033 0 -1 4202560 261426 0 0 0 407 41 0 0 16 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15565] ppid=15555 vsize=15714492 CPUtime=3.71 cores=1,3,5,7
/proc/15557/task/15565/stat : 15565 (java) S 15555 15557 15033 0 -1 4202560 296747 0 0 0 328 43 0 0 16 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15566] ppid=15555 vsize=15714492 CPUtime=4.88 cores=1,3,5,7
/proc/15557/task/15566/stat : 15566 (java) S 15555 15557 15033 0 -1 4202560 314431 0 0 0 438 50 0 0 15 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15567] ppid=15555 vsize=15714492 CPUtime=3.74 cores=1,3,5,7
/proc/15557/task/15567/stat : 15567 (java) S 15555 15557 15033 0 -1 4202560 261170 0 0 0 335 39 0 0 15 0 22 0 529768794 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 1 0 0 0
[pid=15557/tid=15568] ppid=15555 vsize=15714492 CPUtime=5.14 cores=1,3,5,7
/proc/15557/task/15568/stat : 15568 (java) S 15555 15557 15033 0 -1 4202560 101341 0 0 0 504 10 0 0 15 0 22 0 529768795 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 0 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15569] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15569/stat : 15569 (java) S 15555 15557 15033 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15570] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15570/stat : 15570 (java) S 15555 15557 15033 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 529768796 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 7 0 0 0
[pid=15557/tid=15571] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15571/stat : 15571 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290703281 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15572] ppid=15555 vsize=15714492 CPUtime=1.61 cores=1,3,5,7
/proc/15557/task/15572/stat : 15572 (java) S 15555 15557 15033 0 -1 4202560 11753 0 0 0 160 1 0 0 15 0 22 0 529768798 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 5 0 0 0
[pid=15557/tid=15573] ppid=15555 vsize=15714492 CPUtime=2.14 cores=1,3,5,7
/proc/15557/task/15573/stat : 15573 (java) S 15555 15557 15033 0 -1 4202560 15854 0 0 0 212 2 0 0 16 0 22 0 529768798 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15574] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15574/stat : 15574 (java) S 15555 15557 15033 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529768798 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290695577 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15575] ppid=15555 vsize=15714492 CPUtime=0 cores=1,3,5,7
/proc/15557/task/15575/stat : 15575 (java) S 15555 15557 15033 0 -1 4202560 76 0 0 0 0 0 0 0 15 0 22 0 529768798 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 237290696192 0 4 0 16800975 18446604471149741248 0 0 -1 3 0 0 0
[pid=15557/tid=15580] ppid=15555 vsize=15714492 CPUtime=1150.87 cores=1,3,5,7
/proc/15557/task/15580/stat : 15580 (java) R 15555 15557 15033 0 -1 4202560 33569 0 0 0 115083 4 0 0 25 0 22 0 529768912 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506489886 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=15714492 CPUtime=1136.15 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) R 15555 15557 15033 0 -1 4202560 15094 0 0 0 113613 2 0 0 25 0 22 0 529768912 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 18446744073699065955 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=15557/tid=15582] ppid=15555 vsize=15714492 CPUtime=1195.17 cores=1,3,5,7
/proc/15557/task/15582/stat : 15582 (java) R 15555 15557 15033 0 -1 4202560 30866 0 0 0 119513 4 0 0 25 0 22 0 529768912 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506487740 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=15557/tid=15583] ppid=15555 vsize=15714492 CPUtime=1166.62 cores=1,3,5,7
/proc/15557/task/15583/stat : 15583 (java) R 15555 15557 15033 0 -1 4202560 20505 0 0 0 116660 2 0 0 25 0 22 0 529768912 16091639808 2603313 33554432000 1073741824 1073778376 140734464074912 18446744073709551615 46912506416145 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4719.93
Current children cumulated vsize (KiB) 15714492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.2 s]
/proc/loadavg: 8.17 8.09 7.84 9/220 15677
/proc/meminfo: memFree=10032892/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=0 CPUtime=4720.15 cores=1,3,5,7
/proc/15557/stat : 15557 (java) Z 15555 15557 15033 0 -1 4203548 2628749 0 1 0 471597 418 0 0 17 0 2 0 529768794 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 0 0 0 0 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=0 CPUtime=1136.34 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) R 15555 15557 15033 0 -1 4203588 15094 0 0 0 113614 20 0 0 25 0 2 0 529768912 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4720.15
Current children cumulated vsize (KiB) 0

[startup+1300.3 s]
/proc/loadavg: 8.17 8.09 7.84 6/201 15680
/proc/meminfo: memFree=18491548/32950904 swapFree=67082284/67111528
[pid=15557] ppid=15555 vsize=0 CPUtime=4720.26 cores=1,3,5,7
/proc/15557/stat : 15557 (java) Z 15555 15557 15033 0 -1 4203548 2628749 0 1 0 471597 429 0 0 17 0 2 0 529768794 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/15557/statm: 0 0 0 0 0 0 0
[pid=15557/tid=15581] ppid=15555 vsize=0 CPUtime=1136.45 cores=1,3,5,7
/proc/15557/task/15581/stat : 15581 (java) R 15555 15557 15033 0 -1 4203588 15094 0 0 0 113614 31 0 0 25 0 2 0 529768912 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4720.26
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1300.37
CPU time (s): 4720.32
CPU user time (s): 4715.97
CPU system time (s): 4.35034
CPU usage (%): 363
Max. virtual memory (cumulated for all children) (KiB): 15722080

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4715.97
system time used= 4.35034
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2628749
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39461
involuntary context switches= 53810

runsolver used 2.23566 second user time and 4.91025 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-30 18:41:30
IDJOB=3312080
IDBENCH=83123
IDSOLVER=1698
FILE ID=node121/3312080-1304181690
RUNJOBID= node121-1304181690-15521
PBS_JOBID= 13172442
Free space on /tmp= 73556 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top28.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312080-1304181690/watcher-3312080-1304181690 -o /tmp/evaluation-result-3312080-1304181690/solver-3312080-1304181690 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312080-1304181690.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 005e29e99454a24085199b085e720b2f
RANDOM SEED=792857749

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20812240 kB
Buffers:       2188816 kB
Cached:        9384572 kB
SwapCached:       2776 kB
Active:        8625532 kB
Inactive:      3002048 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20812240 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:            9400 kB
Writeback:           0 kB
AnonPages:       51700 kB
Mapped:          21676 kB
Slab:           446076 kB
PageTables:       5112 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   777600 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73552 MiB
End job on node121 at 2011-04-30 19:03:12