Trace number 3311256

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.36 1204.46

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v2500-c10500-S89508070-083-UNKNOWN.cnf
MD5SUMcfefee970fb9a956a9dde1bcb9deab97
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.086986
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of clauses10500
Sum of the clauses size31500
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 310500
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	36:43 INFO : Reading from input HOME/instance-3311256-1304116603.cnf
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
1.27/0.68	36:44 INFO : 2490 variables remaining out of 2500
1.27/0.68	36:44 INFO : 41732 literals remaining out of 42000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311256-1304116603/watcher-3311256-1304116603 -o /tmp/evaluation-result-3311256-1304116603/solver-3311256-1304116603 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311256-1304116603.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.64 6.93 7.13 2/173 21936
/proc/meminfo: memFree=30606136/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=20456 CPUtime=0 cores=1,3,5,7
/proc/21936/stat : 21936 (java) R 21933 21936 21203 0 -1 4202496 679 0 0 0 0 0 0 0 17 0 1 0 523262647 20946944 165 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212431093383 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21936/statm: 5757 168 135 9 0 124 0

[startup+0.0763611 s]
/proc/loadavg: 4.64 6.93 7.13 2/173 21936
/proc/meminfo: memFree=30606136/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15609780 CPUtime=0.06 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 4425 0 1 0 5 1 0 0 17 0 18 0 523262647 15984414720 3863 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3902445 3863 1779 9 0 3893164 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15609780

[startup+0.100344 s]
/proc/loadavg: 4.64 6.93 7.13 2/173 21936
/proc/meminfo: memFree=30606136/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15676920 CPUtime=0.1 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 5531 0 1 0 9 1 0 0 17 0 18 0 523262647 16053166080 4969 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3919230 4969 2116 9 0 3909949 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676920

[startup+0.300306 s]
/proc/loadavg: 4.64 6.93 7.13 2/173 21936
/proc/meminfo: memFree=30606136/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15680768 CPUtime=0.51 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 14383 0 1 0 48 3 0 0 17 0 18 0 523262647 16057106432 12841 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3920192 12848 2206 9 0 3910911 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15680768

[startup+0.700231 s]
/proc/loadavg: 4.64 6.93 7.13 2/173 21936
/proc/meminfo: memFree=30606136/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15709620 CPUtime=1.57 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 30228 0 1 0 152 5 0 0 17 0 22 0 523262647 16086650880 26074 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3927405 26074 2253 9 0 3918124 0
Current children cumulated CPU time (s) 1.57
Current children cumulated vsize (KiB) 15709620

[startup+1.50105 s]
/proc/loadavg: 4.75 6.91 7.13 10/220 21984
/proc/meminfo: memFree=30309544/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=4.59 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 66397 0 1 0 449 10 0 0 17 0 22 0 523262647 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 59185 2273 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 2642 0 0 0 0 0 0 0 17 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 1066 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 1387 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 138 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 1859 0 0 0 0 0 0 0 16 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 523262649 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) R 21933 21936 21203 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 7 0 0 0 0 0 0 0 21 0 22 0 523262650 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) R 21933 21936 21203 0 -1 4202560 6227 0 0 0 65 1 0 0 25 0 22 0 523262652 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447842997 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21969] ppid=21933 vsize=15717532 CPUtime=0.86 cores=1,3,5,7
/proc/21936/task/21969/stat : 21969 (java) R 21933 21936 21203 0 -1 4202560 16092 0 0 0 84 2 0 0 25 0 22 0 523262652 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 47517095435584 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21970] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21970/stat : 21970 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 22 0 523262652 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21971] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21971/stat : 21971 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 523262652 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21977] ppid=21933 vsize=15717532 CPUtime=0.51 cores=1,3,5,7
/proc/21936/task/21977/stat : 21977 (java) R 21933 21936 21203 0 -1 4202560 4361 0 0 0 51 0 0 0 16 0 22 0 523262679 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912506015754 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=0.52 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 3240 0 0 0 52 0 0 0 16 0 22 0 523262679 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 47517100432208 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=0.62 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 6750 0 0 0 62 0 0 0 16 0 22 0 523262679 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 47517099754658 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 7837 0 0 0 65 1 0 0 16 0 22 0 523262679 16094752768 59185 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 47517099019824 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.59
Current children cumulated vsize (KiB) 15717532

[startup+3.10074 s]
/proc/loadavg: 4.75 6.91 7.13 14/220 21984
/proc/meminfo: memFree=29918820/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=10.97 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 125263 0 1 0 1078 19 0 0 17 0 22 0 523262647 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 117938 2274 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=0.02 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 6382 0 0 0 1 1 0 0 15 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=0.03 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 6941 0 0 0 2 1 0 0 16 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 3634 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 115 0 0 0 0 0 0 0 15 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 3574 0 0 0 0 0 0 0 16 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=0.03 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 10135 0 0 0 2 1 0 0 16 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=0.01 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 5914 0 0 0 1 0 0 0 16 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=0.02 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 6631 0 0 0 1 1 0 0 15 0 22 0 523262648 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 237 0 0 0 0 0 0 0 15 0 22 0 523262649 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) S 21933 21936 21203 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 523262650 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) R 21933 21936 21203 0 -1 4202560 6227 0 0 0 65 1 0 0 23 0 22 0 523262652 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447842997 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21969] ppid=21933 vsize=15717532 CPUtime=0.86 cores=1,3,5,7
/proc/21936/task/21969/stat : 21969 (java) R 21933 21936 21203 0 -1 4202560 16093 0 0 0 84 2 0 0 19 0 22 0 523262652 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21970] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21970/stat : 21970 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 22 0 523262652 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21971] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21971/stat : 21971 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 523262652 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21977] ppid=21933 vsize=15717532 CPUtime=2.07 cores=1,3,5,7
/proc/21936/task/21977/stat : 21977 (java) R 21933 21936 21203 0 -1 4202560 10391 0 0 0 206 1 0 0 17 0 22 0 523262679 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505788583 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=2.07 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 8484 0 0 0 207 0 0 0 17 0 22 0 523262679 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 47517099818854 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=2.17 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 12734 0 0 0 216 1 0 0 17 0 22 0 523262679 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505857587 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=2.21 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 13067 0 0 0 220 1 0 0 18 0 22 0 523262679 16094752768 117938 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505986434 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 10.97
Current children cumulated vsize (KiB) 15717532

[startup+6.30114 s]
/proc/loadavg: 5.01 6.93 7.13 10/220 21984
/proc/meminfo: memFree=28460380/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=23.75 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 218410 0 1 0 2344 31 0 0 17 0 22 0 523262647 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 208942 2281 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=0.04 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 11863 0 0 0 2 2 0 0 16 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=0.04 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 10260 0 0 0 3 1 0 0 16 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=0.04 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 14873 0 0 0 2 2 0 0 16 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=0.01 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 6167 0 0 0 1 0 0 0 15 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=0.03 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 7203 0 0 0 2 1 0 0 15 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=0.06 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 15855 0 0 0 4 2 0 0 15 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=0.01 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 5914 0 0 0 1 0 0 0 15 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=0.04 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 12323 0 0 0 2 2 0 0 16 0 22 0 523262648 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 514 0 0 0 0 0 0 0 16 0 22 0 523262649 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) S 21933 21936 21203 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 523262650 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.81 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) S 21933 21936 21203 0 -1 4202560 6259 0 0 0 80 1 0 0 16 0 22 0 523262652 16094752768 208942 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=1048.77 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 337354 0 0 0 104837 40 0 0 25 0 22 0 523262679 16094752768 237428 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505740551 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=1049.52 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 349303 0 0 0 104911 41 0 0 25 0 22 0 523262679 16094752768 237428 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505857682 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=1050.64 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 333830 0 0 0 105023 41 0 0 25 0 22 0 523262679 16094752768 237428 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505717836 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4233.66
Current children cumulated vsize (KiB) 15717532

[startup+1122.3 s]
/proc/loadavg: 8.12 8.09 7.80 9/220 22013
/proc/meminfo: memFree=26642028/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=4472.89 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 3480643 0 1 0 446727 562 0 0 17 0 22 0 523262647 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 259266 2296 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=3.98 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 254206 0 0 0 357 41 0 0 15 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=4.03 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 254627 0 0 0 362 41 0 0 15 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=4.02 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 252924 0 0 0 360 42 0 0 15 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=3.72 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 219855 0 0 0 340 32 0 0 16 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=3.96 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 253951 0 0 0 356 40 0 0 16 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=3.93 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 270470 0 0 0 351 42 0 0 15 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=4.03 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 256351 0 0 0 365 38 0 0 16 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=4 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 254085 0 0 0 358 42 0 0 16 0 22 0 523262648 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=1.62 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 9334 0 0 0 104 58 0 0 15 0 22 0 523262649 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) S 21933 21936 21203 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 523262650 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.99 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) S 21933 21936 21203 0 -1 4202560 6284 0 0 0 98 1 0 0 15 0 22 0 523262652 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21969] ppid=21933 vsize=15717532 CPUtime=1.39 cores=1,3,5,7
/proc/21936/task/21969/stat : 21969 (java) S 21933 21936 21203 0 -1 4202560 16593 0 0 0 137 2 0 0 15 0 22 0 523262652 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21970] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21970/stat : 21970 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 22 0 523262652 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21971] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21971/stat : 21971 (java) S 21933 21936 21203 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 523262652 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21977] ppid=21933 vsize=15717532 CPUtime=1109.56 cores=1,3,5,7
/proc/21936/task/21977/stat : 21977 (java) R 21933 21936 21203 0 -1 4202560 358482 0 0 0 110911 45 0 0 25 0 22 0 523262679 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 18446744073699065949 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=1108.16 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 350560 0 0 0 110774 42 0 0 25 0 22 0 523262679 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505749408 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=1108.65 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 360770 0 0 0 110822 43 0 0 25 0 22 0 523262679 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505748781 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=1110.03 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 347382 0 0 0 110960 43 0 0 25 0 22 0 523262679 16094752768 259266 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505749442 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4472.89
Current children cumulated vsize (KiB) 15717532

[startup+1182.3 s]
/proc/loadavg: 8.13 8.10 7.82 9/220 22015
/proc/meminfo: memFree=27799356/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=4712.07 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 3616546 0 1 0 470619 588 0 0 17 0 22 0 523262647 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 202697 2296 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=4.19 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 268555 0 0 0 375 44 0 0 16 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=4.25 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 270079 0 0 0 382 43 0 0 15 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=4.25 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 264317 0 0 0 381 44 0 0 15 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=3.91 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 228584 0 0 0 357 34 0 0 16 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=4.19 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 263192 0 0 0 377 42 0 0 16 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=4.14 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 282572 0 0 0 370 44 0 0 15 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=4.26 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 269579 0 0 0 385 41 0 0 16 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=4.22 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 271626 0 0 0 377 45 0 0 15 0 22 0 523262648 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=1.71 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 9723 0 0 0 110 61 0 0 16 0 22 0 523262649 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) S 21933 21936 21203 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 523262650 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.99 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) S 21933 21936 21203 0 -1 4202560 6284 0 0 0 98 1 0 0 15 0 22 0 523262652 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21969] ppid=21933 vsize=15717532 CPUtime=1.39 cores=1,3,5,7
/proc/21936/task/21969/stat : 21969 (java) S 21933 21936 21203 0 -1 4202560 16593 0 0 0 137 2 0 0 15 0 22 0 523262652 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21970] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21970/stat : 21970 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 22 0 523262652 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21971] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21971/stat : 21971 (java) S 21933 21936 21203 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 523262652 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21977] ppid=21933 vsize=15717532 CPUtime=1168.98 cores=1,3,5,7
/proc/21936/task/21977/stat : 21977 (java) R 21933 21936 21203 0 -1 4202560 365842 0 0 0 116852 46 0 0 25 0 22 0 523262679 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=1167.57 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 359622 0 0 0 116714 43 0 0 25 0 22 0 523262679 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912506169053 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=1167.89 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 367915 0 0 0 116744 45 0 0 25 0 22 0 523262679 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912506310108 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=1169.32 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 357290 0 0 0 116887 45 0 0 25 0 22 0 523262679 16094752768 202697 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505601205 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4712.07
Current children cumulated vsize (KiB) 15717532



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.4 s]
/proc/loadavg: 8.25 8.13 7.83 5/197 22019
/proc/meminfo: memFree=29663248/32951124 swapFree=67111416/67111528
[pid=21936] ppid=21933 vsize=15717532 CPUtime=4800.3 cores=1,3,5,7
/proc/21936/stat : 21936 (java) S 21933 21936 21203 0 -1 4202496 3692935 0 1 0 479429 601 0 0 17 0 22 0 523262647 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/21936/statm: 3929383 235672 2296 9 0 3920102 0
[pid=21936/tid=21938] ppid=21933 vsize=15717532 CPUtime=0.66 cores=1,3,5,7
/proc/21936/task/21938/stat : 21938 (java) S 21933 21936 21203 0 -1 4202560 13317 0 1 0 64 2 0 0 20 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21943] ppid=21933 vsize=15717532 CPUtime=4.31 cores=1,3,5,7
/proc/21936/task/21943/stat : 21943 (java) S 21933 21936 21203 0 -1 4202560 282376 0 0 0 385 46 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21944] ppid=21933 vsize=15717532 CPUtime=4.33 cores=1,3,5,7
/proc/21936/task/21944/stat : 21944 (java) S 21933 21936 21203 0 -1 4202560 276492 0 0 0 389 44 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21945] ppid=21933 vsize=15717532 CPUtime=4.32 cores=1,3,5,7
/proc/21936/task/21945/stat : 21945 (java) S 21933 21936 21203 0 -1 4202560 269035 0 0 0 388 44 0 0 16 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21946] ppid=21933 vsize=15717532 CPUtime=3.99 cores=1,3,5,7
/proc/21936/task/21946/stat : 21946 (java) S 21933 21936 21203 0 -1 4202560 233710 0 0 0 364 35 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21947] ppid=21933 vsize=15717532 CPUtime=4.27 cores=1,3,5,7
/proc/21936/task/21947/stat : 21947 (java) S 21933 21936 21203 0 -1 4202560 271923 0 0 0 384 43 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21948] ppid=21933 vsize=15717532 CPUtime=4.24 cores=1,3,5,7
/proc/21936/task/21948/stat : 21948 (java) S 21933 21936 21203 0 -1 4202560 288954 0 0 0 379 45 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21949] ppid=21933 vsize=15717532 CPUtime=4.34 cores=1,3,5,7
/proc/21936/task/21949/stat : 21949 (java) S 21933 21936 21203 0 -1 4202560 276454 0 0 0 392 42 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21950] ppid=21933 vsize=15717532 CPUtime=4.32 cores=1,3,5,7
/proc/21936/task/21950/stat : 21950 (java) S 21933 21936 21203 0 -1 4202560 279808 0 0 0 386 46 0 0 15 0 22 0 523262648 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21961] ppid=21933 vsize=15717532 CPUtime=1.72 cores=1,3,5,7
/proc/21936/task/21961/stat : 21961 (java) S 21933 21936 21203 0 -1 4202560 9945 0 0 0 110 62 0 0 16 0 22 0 523262649 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 0 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21962] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21962/stat : 21962 (java) S 21933 21936 21203 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 523262650 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 3 0 0 0
[pid=21936/tid=21963] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21963/stat : 21963 (java) S 21933 21936 21203 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 523262650 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21967] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21967/stat : 21967 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 22 0 523262652 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447840689 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21968] ppid=21933 vsize=15717532 CPUtime=0.99 cores=1,3,5,7
/proc/21936/task/21968/stat : 21968 (java) S 21933 21936 21203 0 -1 4202560 6284 0 0 0 98 1 0 0 15 0 22 0 523262652 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21969] ppid=21933 vsize=15717532 CPUtime=1.39 cores=1,3,5,7
/proc/21936/task/21969/stat : 21969 (java) S 21933 21936 21203 0 -1 4202560 16593 0 0 0 137 2 0 0 15 0 22 0 523262652 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 1 0 0 0
[pid=21936/tid=21970] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21970/stat : 21970 (java) S 21933 21936 21203 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 22 0 523262652 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447832985 0 4 0 16800975 18446604471107934272 0 0 -1 5 0 0 0
[pid=21936/tid=21971] ppid=21933 vsize=15717532 CPUtime=0 cores=1,3,5,7
/proc/21936/task/21971/stat : 21971 (java) S 21933 21936 21203 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 22 0 523262652 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 212447833600 0 4 0 16800975 18446604471107934272 0 0 -1 7 0 0 0
[pid=21936/tid=21977] ppid=21933 vsize=15717532 CPUtime=1190.88 cores=1,3,5,7
/proc/21936/task/21977/stat : 21977 (java) R 21933 21936 21203 0 -1 4202560 371339 0 0 0 119041 47 0 0 25 0 22 0 523262679 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505757846 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=21936/tid=21978] ppid=21933 vsize=15717532 CPUtime=1189.4 cores=1,3,5,7
/proc/21936/task/21978/stat : 21978 (java) R 21933 21936 21203 0 -1 4202560 364101 0 0 0 118896 44 0 0 25 0 22 0 523262679 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505601211 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=21936/tid=21979] ppid=21933 vsize=15717532 CPUtime=1189.79 cores=1,3,5,7
/proc/21936/task/21979/stat : 21979 (java) R 21933 21936 21203 0 -1 4202560 371650 0 0 0 118934 45 0 0 25 0 22 0 523262679 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505635968 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=21936/tid=21980] ppid=21933 vsize=15717532 CPUtime=1191.17 cores=1,3,5,7
/proc/21936/task/21980/stat : 21980 (java) R 21933 21936 21203 0 -1 4202560 359496 0 0 0 119071 46 0 0 25 0 22 0 523262679 16094752768 235672 33554432000 1073741824 1073778376 140734976393792 18446744073709551615 46912505924658 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 15717532

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1204.46
CPU time (s): 4800.36
CPU user time (s): 4794.31
CPU system time (s): 6.04908
CPU usage (%): 398.549
Max. virtual memory (cumulated for all children) (KiB): 15721272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.31
system time used= 6.04908
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3692961
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 76404
involuntary context switches= 87815

runsolver used 2.06669 second user time and 4.5693 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-30 00:36:43
IDJOB=3311256
IDBENCH=82641
IDSOLVER=1698
FILE ID=node102/3311256-1304116603
RUNJOBID= node102-1304116603-21922
PBS_JOBID= 13170678
Free space on /tmp= 71560 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v2500-c10500-S89508070-083-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311256-1304116603/watcher-3311256-1304116603 -o /tmp/evaluation-result-3311256-1304116603/solver-3311256-1304116603 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311256-1304116603.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cfefee970fb9a956a9dde1bcb9deab97
RANDOM SEED=1083926416

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30605176 kB
Buffers:        602980 kB
Cached:        1262624 kB
SwapCached:          0 kB
Active:         137676 kB
Inactive:      1793816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30605176 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:            2080 kB
Writeback:           0 kB
AnonPages:       65496 kB
Mapped:          14452 kB
Slab:           351788 kB
PageTables:       4580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   193064 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71560 MiB
End job on node102 at 2011-04-30 00:56:49