Trace number 3313390

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.8 1294.33

General information on the benchmark

Nameindustrial/palacios/medium/
blocks-4-ipc5-h21-unknown.cnf
MD5SUM3b8c6114a974b09e9b1601ba0718cbf3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark10.5654
Satisfiable
(Un)Satisfiability was proved
Number of variables135534
Number of clauses905980
Sum of the clauses size2447966
Maximum clause length417
Minimum clause length1
Number of clauses of size 1125
Number of clauses of size 2771665
Number of clauses of size 3128198
Number of clauses of size 41424
Number of clauses of size 579
Number of clauses of size over 54489

Solver Data 

0.10/0.11	51:06 INFO : Reading from input HOME/instance-3313390-1304074266.cnf
3.65/3.31	Executor set job limit to 1000000
3.65/3.31	Executor set job limit to 1000000
3.65/3.31	Executor set job limit to 1000000
3.65/3.31	Executor set job limit to 1000000
3.65/3.31	Starting Executor!
3.65/3.31	Starting Executor!
3.65/3.31	Starting Executor!
3.65/3.32	Starting Executor!
34.15/31.55	51:38 INFO : 134479 variables remaining out of 136756
34.15/31.55	51:38 INFO : 8883808 literals remaining out of 3353946

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313390-1304074266/watcher-3313390-1304074266 -o /tmp/evaluation-result-3313390-1304074266/solver-3313390-1304074266 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313390-1304074266.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.51 7.94 7.76 8/196 23290
/proc/meminfo: memFree=25040820/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=28436 CPUtime=0 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 1434 0 0 0 0 0 0 0 22 0 2 0 519026272 29118464 905 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 7645 909 695 9 0 383 0
[pid=23290/tid=23291] ppid=23288 vsize=30580 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 102 0 0 0 0 0 0 0 24 0 2 0 519026273 31313920 928 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274659845608 0 0 4096 0 0 0 0 -1 2 0 0 0

[startup+0.076044 s]
/proc/loadavg: 7.51 7.94 7.76 8/196 23290
/proc/meminfo: memFree=25040820/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15675728 CPUtime=0.07 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 4752 0 1 0 7 0 0 0 22 0 18 0 519026272 16051945472 4193 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3918932 4193 1939 9 0 3909651 0
[pid=23290/tid=23291] ppid=23288 vsize=15675728 CPUtime=0.06 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 3112 0 1 0 6 0 0 0 25 0 18 0 519026273 16051945472 4193 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 47257723893972 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 15675728

[startup+0.105085 s]
/proc/loadavg: 7.51 7.94 7.76 8/196 23290
/proc/meminfo: memFree=25040820/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15742268 CPUtime=0.1 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 5694 0 1 0 10 0 0 0 22 0 18 0 519026272 16120082432 5106 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3935567 5106 2117 9 0 3926286 0
[pid=23290/tid=23291] ppid=23288 vsize=15742268 CPUtime=0.08 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 3538 0 1 0 8 0 0 0 18 0 18 0 519026273 16120082432 5107 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 47257722647299 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15742268

[startup+0.30105 s]
/proc/loadavg: 7.51 7.94 7.76 8/196 23290
/proc/meminfo: memFree=25040820/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15745664 CPUtime=0.52 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 15780 0 1 0 50 2 0 0 22 0 18 0 519026272 16123559936 14245 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3936416 14252 2206 9 0 3927135 0
[pid=23290/tid=23291] ppid=23288 vsize=15745664 CPUtime=0.29 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 10704 0 1 0 27 2 0 0 18 0 18 0 519026273 16123559936 14255 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505638624 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15745664

[startup+0.700986 s]
/proc/loadavg: 7.51 7.94 7.76 8/196 23290
/proc/meminfo: memFree=25040820/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15745664 CPUtime=0.93 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 42020 0 1 0 88 5 0 0 22 0 18 0 519026272 16123559936 40482 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3936416 40482 2222 9 0 3927135 0
[pid=23290/tid=23291] ppid=23288 vsize=15745664 CPUtime=0.68 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 35547 0 1 0 64 4 0 0 18 0 18 0 519026273 16123559936 40482 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505641352 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 15745664

[startup+1.50084 s]
/proc/loadavg: 7.51 7.94 7.76 7/214 23308
/proc/meminfo: memFree=24763536/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15745664 CPUtime=1.76 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 57241 0 1 0 169 7 0 0 22 0 18 0 519026272 16123559936 55685 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3936416 55692 2222 9 0 3927135 0
[pid=23290/tid=23291] ppid=23288 vsize=15745664 CPUtime=1.47 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 47618 0 1 0 141 6 0 0 19 0 18 0 519026273 16123559936 55696 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505586014 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23290/tid=23293] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23293/stat : 23293 (java) S 23288 23290 22498 0 -1 4202560 156 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 55700 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23294] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23294/stat : 23294 (java) S 23288 23290 22498 0 -1 4202560 27 0 0 0 0 0 0 0 16 0 18 0 519026273 16123559936 55704 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23295] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23295/stat : 23295 (java) S 23288 23290 22498 0 -1 4202560 31 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 55708 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23296] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23296/stat : 23296 (java) S 23288 23290 22498 0 -1 4202560 2225 0 0 0 0 0 0 0 16 0 18 0 519026273 16123559936 55709 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23297] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23297/stat : 23297 (java) S 23288 23290 22498 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 55712 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23298] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23298/stat : 23298 (java) S 23288 23290 22498 0 -1 4202560 500 0 0 0 0 0 0 0 16 0 18 0 519026273 16123559936 55717 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23299] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23299/stat : 23299 (java) S 23288 23290 22498 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 55721 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23300] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23300/stat : 23300 (java) S 23288 23290 22498 0 -1 4202560 816 0 0 0 0 0 0 0 16 0 18 0 519026273 16123559936 55725 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23301] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 18 0 519026274 16123559936 55729 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 18 0 519026275 16123559936 55733 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 519026275 16123559936 55738 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519026277 16123559936 55741 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15745664 CPUtime=0.12 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 2323 0 0 0 12 0 0 0 15 0 18 0 519026277 16123559936 55746 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15745664 CPUtime=0.1 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 1371 0 0 0 10 0 0 0 25 0 18 0 519026277 16123559936 55748 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519026277 16123559936 55753 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 519026277 16123559936 55757 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 15745664

[startup+3.10159 s]
/proc/loadavg: 7.31 7.90 7.75 6/214 23308
/proc/meminfo: memFree=24495756/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15745664 CPUtime=3.42 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 139877 0 1 0 326 16 0 0 22 0 18 0 519026272 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3936416 138311 2240 9 0 3927135 0
[pid=23290/tid=23291] ppid=23288 vsize=15745664 CPUtime=3.06 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 127302 0 1 0 291 15 0 0 23 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676635083 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23290/tid=23293] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23293/stat : 23293 (java) S 23288 23290 22498 0 -1 4202560 156 0 0 0 0 0 0 0 16 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23294] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23294/stat : 23294 (java) S 23288 23290 22498 0 -1 4202560 93 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23295] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23295/stat : 23295 (java) S 23288 23290 22498 0 -1 4202560 32 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23296] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23296/stat : 23296 (java) S 23288 23290 22498 0 -1 4202560 2225 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23297] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23297/stat : 23297 (java) S 23288 23290 22498 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23298] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23298/stat : 23298 (java) S 23288 23290 22498 0 -1 4202560 500 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23299] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23299/stat : 23299 (java) S 23288 23290 22498 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23300] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23300/stat : 23300 (java) S 23288 23290 22498 0 -1 4202560 3515 0 0 0 0 0 0 0 15 0 18 0 519026273 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23301] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 198 0 0 0 0 0 0 0 15 0 18 0 519026274 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 18 0 519026275 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 519026275 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519026277 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15745664 CPUtime=0.15 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 2359 0 0 0 15 0 0 0 15 0 18 0 519026277 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15745664 CPUtime=0.12 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 1385 0 0 0 12 0 0 0 15 0 18 0 519026277 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519026277 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15745664 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 519026277 16123559936 138311 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.42
Current children cumulated vsize (KiB) 15745664

[startup+6.60268 s]
/proc/loadavg: 7.31 7.90 7.75 6/214 23308
/proc/meminfo: memFree=24222712/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15783676 CPUtime=8.51 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 165024 0 1 0 831 20 0 0 22 0 22 0 519026272 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3945919 153624 2264 9 0 3936638 0
[pid=23290/tid=23291] ppid=23288 vsize=15783676 CPUtime=6.6 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) R 23288 23290 22498 0 -1 4202560 127439 0 1 0 645 15 0 0 21 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506083548 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23290/tid=23293] ppid=23288 vsize=15783676 CPUtime=0.01 cores=0,2,4,6
/proc/23290/task/23293/stat : 23293 (java) S 23288 23290 22498 0 -1 4202560 5277 0 0 0 1 0 0 0 16 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23294] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23294/stat : 23294 (java) S 23288 23290 22498 0 -1 4202560 93 0 0 0 0 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23295] ppid=23288 vsize=15783676 CPUtime=0.01 cores=0,2,4,6
/proc/23290/task/23295/stat : 23295 (java) S 23288 23290 22498 0 -1 4202560 32 0 0 0 1 0 0 0 16 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23296] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23296/stat : 23296 (java) S 23288 23290 22498 0 -1 4202560 2225 0 0 0 0 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23297] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23297/stat : 23297 (java) S 23288 23290 22498 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23298] ppid=23288 vsize=15783676 CPUtime=0.01 cores=0,2,4,6
/proc/23290/task/23298/stat : 23298 (java) S 23288 23290 22498 0 -1 4202560 501 0 0 0 1 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23299] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23299/stat : 23299 (java) S 23288 23290 22498 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23300] ppid=23288 vsize=15783676 CPUtime=0.01 cores=0,2,4,6
/proc/23290/task/23300/stat : 23300 (java) S 23288 23290 22498 0 -1 4202560 3515 0 0 0 1 0 0 0 15 0 22 0 519026273 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23301] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 337 0 0 0 0 0 0 0 15 0 22 0 519026274 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 519026275 16162484224 153624 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 519026275 16162484224 153634 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 153634 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15783676 CPUtime=0.56 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 5473 0 0 0 56 0 0 0 15 0 22 0 519026277 16162484224 153634 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15783676 CPUtime=1.25 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 17987 0 0 0 124 1 0 0 15 0 22 0 519026277 16162484224 153634 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 153634 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 519026277 16162484224 153635 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=23290/tid=23301] ppid=23288 vsize=15783676 CPUtime=46.9 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 69852 0 0 0 4682 8 0 0 15 0 22 0 519026274 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15783676 CPUtime=1.2 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 5824 0 0 0 120 0 0 0 15 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15783676 CPUtime=1.91 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 19264 0 0 0 189 2 0 0 16 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=15783676 CPUtime=1026.07 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4202560 62 0 0 0 102607 0 0 0 20 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506376488 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23290/tid=23310] ppid=23288 vsize=15783676 CPUtime=1044.04 cores=0,2,4,6
/proc/23290/task/23310/stat : 23310 (java) R 23288 23290 22498 0 -1 4202560 95 0 0 0 104374 30 0 0 20 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505880752 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23290/tid=23311] ppid=23288 vsize=15783676 CPUtime=1075.77 cores=0,2,4,6
/proc/23290/task/23311/stat : 23311 (java) R 23288 23290 22498 0 -1 4202560 95 0 0 0 107568 9 0 0 20 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505880891 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23290/tid=23312] ppid=23288 vsize=15783676 CPUtime=1052.4 cores=0,2,4,6
/proc/23290/task/23312/stat : 23312 (java) R 23288 23290 22498 0 -1 4202560 91 0 0 0 105240 0 0 0 20 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506376408 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4376.89
Current children cumulated vsize (KiB) 15783676

[startup+1242.3 s]
/proc/loadavg: 6.37 7.62 7.74 5/191 23378
/proc/meminfo: memFree=9642848/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15783676 CPUtime=4602.63 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 3970589 0 1 0 459527 736 0 0 22 0 22 0 519026272 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3945919 3857506 2294 9 0 3936638 0
[pid=23290/tid=23291] ppid=23288 vsize=15783676 CPUtime=31.41 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) S 23288 23290 22498 0 -1 4202560 127488 0 1 0 3126 15 0 0 25 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23293] ppid=23288 vsize=15783676 CPUtime=12.55 cores=0,2,4,6
/proc/23290/task/23293/stat : 23293 (java) S 23288 23290 22498 0 -1 4202560 575513 0 0 0 1154 101 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23294] ppid=23288 vsize=15783676 CPUtime=13.7 cores=0,2,4,6
/proc/23290/task/23294/stat : 23294 (java) S 23288 23290 22498 0 -1 4202560 522779 0 0 0 1281 89 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23295] ppid=23288 vsize=15783676 CPUtime=10.71 cores=0,2,4,6
/proc/23290/task/23295/stat : 23295 (java) S 23288 23290 22498 0 -1 4202560 351716 0 0 0 1011 60 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23296] ppid=23288 vsize=15783676 CPUtime=11.97 cores=0,2,4,6
/proc/23290/task/23296/stat : 23296 (java) S 23288 23290 22498 0 -1 4202560 445035 0 0 0 1114 83 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23297] ppid=23288 vsize=15783676 CPUtime=12.13 cores=0,2,4,6
/proc/23290/task/23297/stat : 23297 (java) S 23288 23290 22498 0 -1 4202560 377162 0 0 0 1145 68 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23298] ppid=23288 vsize=15783676 CPUtime=13.02 cores=0,2,4,6
/proc/23290/task/23298/stat : 23298 (java) S 23288 23290 22498 0 -1 4202560 534478 0 0 0 1207 95 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23299] ppid=23288 vsize=15783676 CPUtime=12.45 cores=0,2,4,6
/proc/23290/task/23299/stat : 23299 (java) S 23288 23290 22498 0 -1 4202560 428316 0 0 0 1169 76 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23300] ppid=23288 vsize=15783676 CPUtime=12.16 cores=0,2,4,6
/proc/23290/task/23300/stat : 23300 (java) S 23288 23290 22498 0 -1 4202560 511352 0 0 0 1127 89 0 0 16 0 22 0 519026273 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23301] ppid=23288 vsize=15783676 CPUtime=51.54 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 69856 0 0 0 5146 8 0 0 15 0 22 0 519026274 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15783676 CPUtime=1.2 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 5824 0 0 0 120 0 0 0 15 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15783676 CPUtime=1.91 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 19264 0 0 0 189 2 0 0 16 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 519026277 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=15783676 CPUtime=1081.02 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4202560 66 0 0 0 108102 0 0 0 25 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506104329 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23290/tid=23310] ppid=23288 vsize=15783676 CPUtime=1098.99 cores=0,2,4,6
/proc/23290/task/23310/stat : 23310 (java) R 23288 23290 22498 0 -1 4202560 96 0 0 0 109869 30 0 0 25 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506147503 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23290/tid=23311] ppid=23288 vsize=15783676 CPUtime=1130.37 cores=0,2,4,6
/proc/23290/task/23311/stat : 23311 (java) R 23288 23290 22498 0 -1 4202560 97 0 0 0 113026 11 0 0 25 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912505806272 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23290/tid=23312] ppid=23288 vsize=15783676 CPUtime=1107.35 cores=0,2,4,6
/proc/23290/task/23312/stat : 23312 (java) R 23288 23290 22498 0 -1 4202560 91 0 0 0 110735 0 0 0 25 0 22 0 519026604 16162484224 3857506 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506104363 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4602.63
Current children cumulated vsize (KiB) 15783676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1293.7 s]
/proc/loadavg: 5.07 7.08 7.54 5/191 23379
/proc/meminfo: memFree=9642848/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=15783676 CPUtime=4800.15 cores=0,2,4,6
/proc/23290/stat : 23290 (java) S 23288 23290 22498 0 -1 4202496 3970601 0 1 0 479276 739 0 0 22 0 22 0 519026272 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 3945919 3857508 2294 9 0 3936638 0
[pid=23290/tid=23291] ppid=23288 vsize=15783676 CPUtime=31.41 cores=0,2,4,6
/proc/23290/task/23291/stat : 23291 (java) S 23288 23290 22498 0 -1 4202560 127488 0 1 0 3126 15 0 0 25 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23293] ppid=23288 vsize=15783676 CPUtime=12.69 cores=0,2,4,6
/proc/23290/task/23293/stat : 23293 (java) S 23288 23290 22498 0 -1 4202560 575513 0 0 0 1168 101 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23294] ppid=23288 vsize=15783676 CPUtime=13.74 cores=0,2,4,6
/proc/23290/task/23294/stat : 23294 (java) S 23288 23290 22498 0 -1 4202560 522779 0 0 0 1285 89 0 0 15 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23295] ppid=23288 vsize=15783676 CPUtime=10.96 cores=0,2,4,6
/proc/23290/task/23295/stat : 23295 (java) S 23288 23290 22498 0 -1 4202560 351716 0 0 0 1036 60 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23296] ppid=23288 vsize=15783676 CPUtime=11.97 cores=0,2,4,6
/proc/23290/task/23296/stat : 23296 (java) S 23288 23290 22498 0 -1 4202560 445035 0 0 0 1114 83 0 0 15 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23297] ppid=23288 vsize=15783676 CPUtime=12.19 cores=0,2,4,6
/proc/23290/task/23297/stat : 23297 (java) S 23288 23290 22498 0 -1 4202560 377162 0 0 0 1151 68 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23298] ppid=23288 vsize=15783676 CPUtime=13.23 cores=0,2,4,6
/proc/23290/task/23298/stat : 23298 (java) S 23288 23290 22498 0 -1 4202560 534478 0 0 0 1228 95 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23299] ppid=23288 vsize=15783676 CPUtime=12.57 cores=0,2,4,6
/proc/23290/task/23299/stat : 23299 (java) S 23288 23290 22498 0 -1 4202560 428316 0 0 0 1180 77 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23300] ppid=23288 vsize=15783676 CPUtime=12.42 cores=0,2,4,6
/proc/23290/task/23300/stat : 23300 (java) S 23288 23290 22498 0 -1 4202560 511352 0 0 0 1153 89 0 0 16 0 22 0 519026273 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23301] ppid=23288 vsize=15783676 CPUtime=54.14 cores=0,2,4,6
/proc/23290/task/23301/stat : 23301 (java) S 23288 23290 22498 0 -1 4202560 69858 0 0 0 5406 8 0 0 16 0 22 0 519026274 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 0 0 16800975 18446604453720906624 0 0 -1 2 0 0 0
[pid=23290/tid=23302] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23302/stat : 23302 (java) S 23288 23290 22498 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23303] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23303/stat : 23303 (java) S 23288 23290 22498 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519026275 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23304] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23304/stat : 23304 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676631985 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23305] ppid=23288 vsize=15783676 CPUtime=1.2 cores=0,2,4,6
/proc/23290/task/23305/stat : 23305 (java) S 23288 23290 22498 0 -1 4202560 5824 0 0 0 120 0 0 0 15 0 22 0 519026277 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23306] ppid=23288 vsize=15783676 CPUtime=1.91 cores=0,2,4,6
/proc/23290/task/23306/stat : 23306 (java) S 23288 23290 22498 0 -1 4202560 19264 0 0 0 189 2 0 0 16 0 22 0 519026277 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 4 0 0 0
[pid=23290/tid=23307] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23307/stat : 23307 (java) S 23288 23290 22498 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519026277 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624281 0 4 0 16800975 18446604453720906624 0 0 -1 6 0 0 0
[pid=23290/tid=23308] ppid=23288 vsize=15783676 CPUtime=0 cores=0,2,4,6
/proc/23290/task/23308/stat : 23308 (java) S 23288 23290 22498 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 519026277 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 274676624896 0 4 0 16800975 18446604453720906624 0 0 -1 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=15783676 CPUtime=1129.55 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4202560 67 0 0 0 112955 0 0 0 22 0 22 0 519026604 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506326067 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23290/tid=23310] ppid=23288 vsize=15783676 CPUtime=1147.52 cores=0,2,4,6
/proc/23290/task/23310/stat : 23310 (java) R 23288 23290 22498 0 -1 4202560 101 0 0 0 114722 30 0 0 22 0 22 0 519026604 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506376307 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23290/tid=23311] ppid=23288 vsize=15783676 CPUtime=1178.6 cores=0,2,4,6
/proc/23290/task/23311/stat : 23311 (java) R 23288 23290 22498 0 -1 4202560 98 0 0 0 117847 13 0 0 22 0 22 0 519026604 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506536600 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23290/tid=23312] ppid=23288 vsize=15783676 CPUtime=1155.88 cores=0,2,4,6
/proc/23290/task/23312/stat : 23312 (java) R 23288 23290 22498 0 -1 4202560 92 0 0 0 115588 0 0 0 22 0 22 0 519026604 16162484224 3857508 33554432000 1073741824 1073778376 140736958234528 18446744073709551615 46912506326072 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 15783676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1293.81 s]
/proc/loadavg: 5.07 7.08 7.54 5/191 23379
/proc/meminfo: memFree=9642848/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=0 CPUtime=4800.28 cores=0,2,4,6
/proc/23290/stat : 23290 (java) Z 23288 23290 22498 0 -1 4203548 3970627 0 1 0 479279 749 0 0 17 0 2 0 519026272 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 0 0 0 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=0 CPUtime=1129.65 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4203588 67 0 0 0 112955 10 0 0 22 0 2 0 519026604 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 0

[startup+1294.2 s]
/proc/loadavg: 5.07 7.08 7.54 5/191 23379
/proc/meminfo: memFree=9642848/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=0 CPUtime=4800.67 cores=0,2,4,6
/proc/23290/stat : 23290 (java) Z 23288 23290 22498 0 -1 4203548 3970627 0 1 0 479279 788 0 0 17 0 2 0 519026272 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 0 0 0 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=0 CPUtime=1130.04 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4203588 67 0 0 0 112955 49 0 0 23 0 2 0 519026604 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.67
Current children cumulated vsize (KiB) 0

[startup+1294.3 s]
/proc/loadavg: 5.07 7.08 7.54 5/191 23379
/proc/meminfo: memFree=9642848/32951132 swapFree=67111524/67111528
[pid=23290] ppid=23288 vsize=0 CPUtime=4800.77 cores=0,2,4,6
/proc/23290/stat : 23290 (java) Z 23288 23290 22498 0 -1 4203548 3970627 0 1 0 479279 798 0 0 17 0 2 0 519026272 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23290/statm: 0 0 0 0 0 0 0
[pid=23290/tid=23309] ppid=23288 vsize=0 CPUtime=1130.14 cores=0,2,4,6
/proc/23290/task/23309/stat : 23309 (java) R 23288 23290 22498 0 -1 4203588 67 0 0 0 112955 59 0 0 24 0 2 0 519026604 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.77
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1294.33
CPU time (s): 4800.8
CPU user time (s): 4792.79
CPU system time (s): 8.00878
CPU usage (%): 370.911
Max. virtual memory (cumulated for all children) (KiB): 15783676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.79
system time used= 8.00878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3970627
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38892
involuntary context switches= 86692

runsolver used 2.83257 second user time and 6.75497 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-29 12:51:06
IDJOB=3313390
IDBENCH=20431
IDSOLVER=1699
FILE ID=node131/3313390-1304074266
RUNJOBID= node131-1304074266-23249
PBS_JOBID= 13170464
Free space on /tmp= 71368 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT07/industrial/palacios/medium/blocks-4-ipc5-h21-unknown.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313390-1304074266/watcher-3313390-1304074266 -o /tmp/evaluation-result-3313390-1304074266/solver-3313390-1304074266 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313390-1304074266.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3b8c6114a974b09e9b1601ba0718cbf3
RANDOM SEED=611700423

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      25041092 kB
Buffers:        960220 kB
Cached:        6336640 kB
SwapCached:          4 kB
Active:         387816 kB
Inactive:      7026152 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      25041092 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           19976 kB
Writeback:           8 kB
AnonPages:      115940 kB
Mapped:          22904 kB
Slab:           432716 kB
PageTables:       5372 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   802276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71368 MiB
End job on node131 at 2011-04-29 13:12:42