Trace number 3312939

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.26 1207.46

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-4_512.cnf
MD5SUMc1f047ec179094963b21d7b90509d2b9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables510
Number of clauses4492
Sum of the clauses size17968
Maximum clause length4
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 44492
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	17:45 INFO : Reading from input HOME/instance-3312939-1304183864.cnf
0.27/0.30	Executor set job limit to 1000000
0.27/0.30	Executor set job limit to 1000000
0.27/0.30	Executor set job limit to 1000000
0.27/0.30	Executor set job limit to 1000000
0.27/0.30	Starting Executor!
0.27/0.30	Starting Executor!
0.52/0.30	Starting Executor!
0.52/0.30	Starting Executor!
1.04/0.54	17:45 INFO : 510 variables remaining out of 510
1.04/0.54	17:45 INFO : 22460 literals remaining out of 22460

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312939-1304183864/watcher-3312939-1304183864 -o /tmp/evaluation-result-3312939-1304183864/solver-3312939-1304183864 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312939-1304183864.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.65 7.10 7.64 2/174 23890
/proc/meminfo: memFree=23480868/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=9020 CPUtime=0 cores=0,2,4,6
/proc/23890/stat : 23890 (java) R 23888 23890 23046 0 -1 4194304 563 0 0 0 0 0 0 0 22 0 1 0 529986882 9236480 67 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244441977124 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23890/statm: 2255 83 67 9 0 34 0

[startup+0.050214 s]
/proc/loadavg: 4.65 7.10 7.64 2/174 23890
/proc/meminfo: memFree=23480868/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15604248 CPUtime=0.03 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 3882 0 1 0 3 0 0 0 22 0 13 0 529986882 15978749952 3320 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800971 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3901062 3320 1689 9 0 3891810 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15604248

[startup+0.103246 s]
/proc/loadavg: 4.65 7.10 7.64 2/174 23890
/proc/meminfo: memFree=23480868/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15676792 CPUtime=0.1 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 5553 0 1 0 9 1 0 0 22 0 18 0 529986882 16053035008 4978 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3919198 4978 2117 9 0 3909917 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676792

[startup+0.303302 s]
/proc/loadavg: 4.65 7.10 7.64 2/174 23890
/proc/meminfo: memFree=23480868/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15684236 CPUtime=0.52 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 13367 0 1 0 50 2 0 0 22 0 21 0 529986882 16060657664 11843 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3921059 11843 2215 9 0 3911778 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15684236

[startup+0.715847 s]
/proc/loadavg: 4.65 7.10 7.64 2/174 23890
/proc/meminfo: memFree=23480868/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15693380 CPUtime=1.75 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 24937 0 1 0 171 4 0 0 22 0 22 0 529986882 16070021120 19509 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3923345 19520 2261 9 0 3914064 0
Current children cumulated CPU time (s) 1.75
Current children cumulated vsize (KiB) 15693380

[startup+1.50092 s]
/proc/loadavg: 4.65 7.10 7.64 8/220 23939
/proc/meminfo: memFree=23176632/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15693380 CPUtime=4.87 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 57528 0 1 0 478 9 0 0 22 0 22 0 529986882 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3923345 46939 2285 9 0 3914064 0
[pid=23890/tid=23892] ppid=23888 vsize=15693380 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 423 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 836 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 39 0 0 0 0 0 0 0 16 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 571 0 0 0 0 0 0 0 16 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 230 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 633 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 543 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 668 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) S 23888 23890 23046 0 -1 4202560 74 0 0 0 0 0 0 0 16 0 22 0 529986885 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 0 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15693380 CPUtime=0.56 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) R 23888 23890 23046 0 -1 4202560 5038 0 0 0 56 0 0 0 25 0 22 0 529986887 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458771125 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23890/tid=23906] ppid=23888 vsize=15693380 CPUtime=1.07 cores=0,2,4,6
/proc/23890/task/23906/stat : 23906 (java) S 23888 23890 23046 0 -1 4202560 11438 0 0 0 105 2 0 0 16 0 22 0 529986887 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23907] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23907/stat : 23907 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23908] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23908/stat : 23908 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529986887 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23932] ppid=23888 vsize=15693380 CPUtime=0.42 cores=0,2,4,6
/proc/23890/task/23932/stat : 23932 (java) R 23888 23890 23046 0 -1 4202560 2851 0 0 0 42 0 0 0 17 0 22 0 529986912 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505988260 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23890/tid=23933] ppid=23888 vsize=15693380 CPUtime=0.8 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 9129 0 0 0 79 1 0 0 18 0 22 0 529986912 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505809406 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15693380 CPUtime=0.7 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) R 23888 23890 23046 0 -1 4202560 7341 0 0 0 70 0 0 0 17 0 22 0 529986913 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505768399 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15693380 CPUtime=0.71 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) R 23888 23890 23046 0 -1 4202560 7384 0 0 0 71 0 0 0 17 0 22 0 529986913 16070021120 46939 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822238136191 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.87
Current children cumulated vsize (KiB) 15693380

[startup+3.1016 s]
/proc/loadavg: 4.65 7.10 7.64 6/220 23939
/proc/meminfo: memFree=22991252/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15693380 CPUtime=11.25 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 154714 0 1 0 1104 21 0 0 22 0 22 0 529986882 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3923345 142734 2285 9 0 3914064 0
[pid=23890/tid=23892] ppid=23888 vsize=15693380 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 1272 0 0 0 0 0 0 0 16 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 2424 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 406 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 1615 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 279 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 2062 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 1917 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 1606 0 0 0 0 0 0 0 15 0 22 0 529986884 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) S 23888 23890 23046 0 -1 4202560 440 0 0 0 0 0 0 0 16 0 22 0 529986885 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 0 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15693380 CPUtime=0.56 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) R 23888 23890 23046 0 -1 4202560 5040 0 0 0 56 0 0 0 23 0 22 0 529986887 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822237201102 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23890/tid=23906] ppid=23888 vsize=15693380 CPUtime=1.23 cores=0,2,4,6
/proc/23890/task/23906/stat : 23906 (java) S 23888 23890 23046 0 -1 4202560 12773 0 0 0 121 2 0 0 15 0 22 0 529986887 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23907] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23907/stat : 23907 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23908] ppid=23888 vsize=15693380 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23908/stat : 23908 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529986887 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23932] ppid=23888 vsize=15693380 CPUtime=2 cores=0,2,4,6
/proc/23890/task/23932/stat : 23932 (java) R 23888 23890 23046 0 -1 4202560 25346 0 0 0 198 2 0 0 18 0 22 0 529986912 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505979209 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23890/tid=23933] ppid=23888 vsize=15693380 CPUtime=2.23 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 31295 0 0 0 219 4 0 0 20 0 22 0 529986912 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 18446744073699065904 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15693380 CPUtime=2.28 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) R 23888 23890 23046 0 -1 4202560 29252 0 0 0 225 3 0 0 18 0 22 0 529986913 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912506066493 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15693380 CPUtime=2.29 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) R 23888 23890 23046 0 -1 4202560 28657 0 0 0 226 3 0 0 19 0 22 0 529986913 16070021120 142734 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822238134893 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.25
Current children cumulated vsize (KiB) 15693380

[startup+6.301 s]
/proc/loadavg: 4.92 7.12 7.65 9/220 23939
/proc/meminfo: memFree=22228040/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15689940 CPUtime=24 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 157715 0 1 0 2379 21 0 0 22 0 22 0 529986882 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3922485 142990 2288 9 0 3913204 0
[pid=23890/tid=23892] ppid=23888 vsize=15689940 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 1371 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15689940 CPUtime=0.01 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 2713 0 0 0 1 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 734 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 1893 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 548 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 2686 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 2056 0 0 0 0 0 0 0 15 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 2225 0 0 0 0 0 0 0 16 0 22 0 529986884 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) S 23888 23890 23046 0 -1 4202560 440 0 0 0 0 0 0 0 15 0 22 0 529986885 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 0 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15689940 CPUtime=0.67 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) S 23888 23890 23046 0 -1 4202560 5055 0 0 0 67 0 0 0 15 0 22 0 529986887 16066498560 142990 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=23890/tid=23933] ppid=23888 vsize=15689940 CPUtime=1048.91 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 189550 0 0 0 104856 35 0 0 25 0 22 0 529986912 16066498560 78599 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912506155274 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15689940 CPUtime=1049.24 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) R 23888 23890 23046 0 -1 4202560 180599 0 0 0 104891 33 0 0 25 0 22 0 529986913 16066498560 78599 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505916036 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15689940 CPUtime=1048.71 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) R 23888 23890 23046 0 -1 4202560 178572 0 0 0 104838 33 0 0 25 0 22 0 529986913 16066498560 78599 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822238136181 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4223.31
Current children cumulated vsize (KiB) 15689940

[startup+1122.3 s]
/proc/loadavg: 8.22 8.15 7.97 9/220 23969
/proc/meminfo: memFree=22646688/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15689940 CPUtime=4461.76 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 1383869 0 1 0 445827 349 0 0 22 0 22 0 529986882 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3922485 80943 2299 9 0 3913204 0
[pid=23890/tid=23892] ppid=23888 vsize=15689940 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15689940 CPUtime=3.05 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 71343 0 0 0 291 14 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15689940 CPUtime=3.15 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 74075 0 0 0 297 18 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15689940 CPUtime=3.09 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 70980 0 0 0 292 17 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15689940 CPUtime=3.07 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 71687 0 0 0 290 17 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15689940 CPUtime=3.17 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 71571 0 0 0 301 16 0 0 16 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15689940 CPUtime=3.09 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 72100 0 0 0 291 18 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15689940 CPUtime=3.08 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 73606 0 0 0 292 16 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15689940 CPUtime=3.15 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 76123 0 0 0 297 18 0 0 15 0 22 0 529986884 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15689940 CPUtime=2.12 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) S 23888 23890 23046 0 -1 4202560 3521 0 0 0 149 63 0 0 15 0 22 0 529986885 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 0 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15689940 CPUtime=0.71 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) S 23888 23890 23046 0 -1 4202560 5063 0 0 0 71 0 0 0 15 0 22 0 529986887 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23906] ppid=23888 vsize=15689940 CPUtime=1.32 cores=0,2,4,6
/proc/23890/task/23906/stat : 23906 (java) S 23888 23890 23046 0 -1 4202560 12791 0 0 0 130 2 0 0 16 0 22 0 529986887 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23907] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23907/stat : 23907 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23908] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23908/stat : 23908 (java) S 23888 23890 23046 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 529986887 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23932] ppid=23888 vsize=15689940 CPUtime=1107.4 cores=0,2,4,6
/proc/23890/task/23932/stat : 23932 (java) R 23888 23890 23046 0 -1 4202560 195299 0 0 0 110708 32 0 0 25 0 22 0 529986912 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822238136637 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23890/tid=23933] ppid=23888 vsize=15689940 CPUtime=1108.22 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 198706 0 0 0 110784 38 0 0 25 0 22 0 529986912 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912506155622 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15689940 CPUtime=1108.55 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) R 23888 23890 23046 0 -1 4202560 189538 0 0 0 110820 35 0 0 25 0 22 0 529986913 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505722543 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15689940 CPUtime=1107.92 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) R 23888 23890 23046 0 -1 4202560 187074 0 0 0 110757 35 0 0 25 0 22 0 529986913 16066498560 80943 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 47822238135207 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4461.76
Current children cumulated vsize (KiB) 15689940

[startup+1182.3 s]
/proc/loadavg: 7.91 8.08 7.95 9/220 23970
/proc/meminfo: memFree=22601864/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15689940 CPUtime=4700.33 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 1458326 0 1 0 469666 367 0 0 22 0 22 0 529986882 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3922485 85293 2299 9 0 3913204 0
[pid=23890/tid=23892] ppid=23888 vsize=15689940 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15689940 CPUtime=3.19 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 74792 0 0 0 304 15 0 0 16 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15689940 CPUtime=3.3 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 78454 0 0 0 311 19 0 0 16 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15689940 CPUtime=3.23 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 74546 0 0 0 305 18 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15689940 CPUtime=3.23 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 76072 0 0 0 305 18 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15689940 CPUtime=3.34 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 76388 0 0 0 317 17 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15689940 CPUtime=3.26 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 75721 0 0 0 307 19 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15689940 CPUtime=3.23 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 76436 0 0 0 307 16 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15689940 CPUtime=3.32 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 80265 0 0 0 313 19 0 0 15 0 22 0 529986884 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15689940 CPUtime=2.23 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) S 23888 23890 23046 0 -1 4202560 3721 0 0 0 156 67 0 0 15 0 22 0 529986885 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 0 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15689940 CPUtime=0.71 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) S 23888 23890 23046 0 -1 4202560 5063 0 0 0 71 0 0 0 15 0 22 0 529986887 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23906] ppid=23888 vsize=15689940 CPUtime=1.32 cores=0,2,4,6
/proc/23890/task/23906/stat : 23906 (java) S 23888 23890 23046 0 -1 4202560 12791 0 0 0 130 2 0 0 16 0 22 0 529986887 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23907] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23907/stat : 23907 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23908] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23908/stat : 23908 (java) S 23888 23890 23046 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 529986887 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23932] ppid=23888 vsize=15689940 CPUtime=1166.72 cores=0,2,4,6
/proc/23890/task/23932/stat : 23932 (java) R 23888 23890 23046 0 -1 4202560 206511 0 0 0 116638 34 0 0 25 0 22 0 529986912 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505809132 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23890/tid=23933] ppid=23888 vsize=15689940 CPUtime=1167.56 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 209845 0 0 0 116716 40 0 0 25 0 22 0 529986912 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505802894 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15689940 CPUtime=1167.83 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) R 23888 23890 23046 0 -1 4202560 200028 0 0 0 116746 37 0 0 25 0 22 0 529986913 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505908515 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15689940 CPUtime=1167.18 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) R 23888 23890 23046 0 -1 4202560 197297 0 0 0 116681 37 0 0 25 0 22 0 529986913 16066498560 85293 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505802150 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4700.33
Current children cumulated vsize (KiB) 15689940



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.4 s]
/proc/loadavg: 7.94 8.07 7.95 6/197 23974
/proc/meminfo: memFree=23185464/32951124 swapFree=67111524/67111528
[pid=23890] ppid=23888 vsize=15689940 CPUtime=4800.11 cores=0,2,4,6
/proc/23890/stat : 23890 (java) S 23888 23890 23046 0 -1 4202496 1478774 0 1 0 479638 373 0 0 22 0 22 0 529986882 16066498560 74675 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23890/statm: 3922485 74675 2299 9 0 3913204 0
[pid=23890/tid=23892] ppid=23888 vsize=15689940 CPUtime=0.51 cores=0,2,4,6
/proc/23890/task/23892/stat : 23892 (java) S 23888 23890 23046 0 -1 4202560 8944 0 1 0 50 1 0 0 20 0 22 0 529986883 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23893] ppid=23888 vsize=15689940 CPUtime=3.25 cores=0,2,4,6
/proc/23890/task/23893/stat : 23893 (java) S 23888 23890 23046 0 -1 4202560 75647 0 0 0 310 15 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23894] ppid=23888 vsize=15689940 CPUtime=3.37 cores=0,2,4,6
/proc/23890/task/23894/stat : 23894 (java) S 23888 23890 23046 0 -1 4202560 79793 0 0 0 318 19 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23895] ppid=23888 vsize=15689940 CPUtime=3.3 cores=0,2,4,6
/proc/23890/task/23895/stat : 23895 (java) S 23888 23890 23046 0 -1 4202560 76255 0 0 0 312 18 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23896] ppid=23888 vsize=15689940 CPUtime=3.28 cores=0,2,4,6
/proc/23890/task/23896/stat : 23896 (java) S 23888 23890 23046 0 -1 4202560 77311 0 0 0 310 18 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23897] ppid=23888 vsize=15689940 CPUtime=3.4 cores=0,2,4,6
/proc/23890/task/23897/stat : 23897 (java) S 23888 23890 23046 0 -1 4202560 77691 0 0 0 323 17 0 0 16 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23898] ppid=23888 vsize=15689940 CPUtime=3.32 cores=0,2,4,6
/proc/23890/task/23898/stat : 23898 (java) S 23888 23890 23046 0 -1 4202560 77067 0 0 0 313 19 0 0 16 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23899] ppid=23888 vsize=15689940 CPUtime=3.3 cores=0,2,4,6
/proc/23890/task/23899/stat : 23899 (java) S 23888 23890 23046 0 -1 4202560 77191 0 0 0 314 16 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23900] ppid=23888 vsize=15689940 CPUtime=3.38 cores=0,2,4,6
/proc/23890/task/23900/stat : 23900 (java) S 23888 23890 23046 0 -1 4202560 81312 0 0 0 319 19 0 0 15 0 22 0 529986884 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23901] ppid=23888 vsize=15689940 CPUtime=2.29 cores=0,2,4,6
/proc/23890/task/23901/stat : 23901 (java) R 23888 23890 23046 0 -1 4202560 3780 0 0 0 161 68 0 0 15 0 22 0 529986885 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244446898487 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=23890/tid=23902] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23902/stat : 23902 (java) S 23888 23890 23046 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 529986885 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23903] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23903/stat : 23903 (java) S 23888 23890 23046 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529986885 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23904] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23904/stat : 23904 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458768817 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23905] ppid=23888 vsize=15689940 CPUtime=0.71 cores=0,2,4,6
/proc/23890/task/23905/stat : 23905 (java) S 23888 23890 23046 0 -1 4202560 5063 0 0 0 71 0 0 0 15 0 22 0 529986887 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
[pid=23890/tid=23906] ppid=23888 vsize=15689940 CPUtime=1.32 cores=0,2,4,6
/proc/23890/task/23906/stat : 23906 (java) S 23888 23890 23046 0 -1 4202560 12791 0 0 0 130 2 0 0 16 0 22 0 529986887 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23907] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23907/stat : 23907 (java) S 23888 23890 23046 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529986887 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 6 0 0 0
[pid=23890/tid=23908] ppid=23888 vsize=15689940 CPUtime=0 cores=0,2,4,6
/proc/23890/task/23908/stat : 23908 (java) S 23888 23890 23046 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 529986887 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761728 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23932] ppid=23888 vsize=15689940 CPUtime=1191.54 cores=0,2,4,6
/proc/23890/task/23932/stat : 23932 (java) S 23888 23890 23046 0 -1 4202560 209428 0 0 0 119119 35 0 0 25 0 22 0 529986912 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 0 0 0 0
[pid=23890/tid=23933] ppid=23888 vsize=15689940 CPUtime=1192.31 cores=0,2,4,6
/proc/23890/task/23933/stat : 23933 (java) R 23888 23890 23046 0 -1 4202560 212454 0 0 0 119191 40 0 0 25 0 22 0 529986912 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 46912505323552 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23890/tid=23934] ppid=23888 vsize=15689940 CPUtime=1192.66 cores=0,2,4,6
/proc/23890/task/23934/stat : 23934 (java) S 23888 23890 23046 0 -1 4202560 202810 0 0 0 119228 38 0 0 25 0 22 0 529986913 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 4 0 0 0
[pid=23890/tid=23935] ppid=23888 vsize=15689940 CPUtime=1191.98 cores=0,2,4,6
/proc/23890/task/23935/stat : 23935 (java) S 23888 23890 23046 0 -1 4202560 199784 0 0 0 119160 38 0 0 18 0 22 0 529986913 16066498560 74676 33554432000 1073741824 1073778376 140733602922192 18446744073709551615 244458761113 0 4 0 16800975 18446604453865468352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 15689940

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1207.46
CPU time (s): 4800.26
CPU user time (s): 4796.5
CPU system time (s): 3.75543
CPU usage (%): 397.551
Max. virtual memory (cumulated for all children) (KiB): 15694408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.5
system time used= 3.75543
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1478928
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 315653
involuntary context switches= 164415

runsolver used 1.9577 second user time and 4.69029 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-30 19:17:44
IDJOB=3312939
IDBENCH=83247
IDSOLVER=1699
FILE ID=node105/3312939-1304183864
RUNJOBID= node105-1304183864-23876
PBS_JOBID= 13172437
Free space on /tmp= 73044 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-4_512.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312939-1304183864/watcher-3312939-1304183864 -o /tmp/evaluation-result-3312939-1304183864/solver-3312939-1304183864 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312939-1304183864.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c1f047ec179094963b21d7b90509d2b9
RANDOM SEED=2108710454

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23481388 kB
Buffers:       2181636 kB
Cached:        6671884 kB
SwapCached:          4 kB
Active:         669932 kB
Inactive:      8249272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23481388 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            2008 kB
Writeback:           8 kB
AnonPages:       64988 kB
Mapped:          14404 kB
Slab:           488152 kB
PageTables:       4432 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188976 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73040 MiB
End job on node105 at 2011-04-30 19:37:54