Trace number 3311865

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.46 1207.44

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf
MD5SUM17624c574c7f9ee0eff4cc4a13e42e12
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark671.855
Satisfiable
(Un)Satisfiability was proved
Number of variables184
Number of clauses896
Sum of the clauses size3042
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 214
Number of clauses of size 3514
Number of clauses of size 4368
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	59:20 INFO : Reading from input HOME/instance-3311865-1304186360.cnf
0.28/0.21	Executor set job limit to 1000000
0.28/0.21	Executor set job limit to 1000000
0.28/0.21	Executor set job limit to 1000000
0.28/0.21	Executor set job limit to 1000000
0.28/0.21	Starting Executor!
0.28/0.21	Starting Executor!
0.28/0.21	Starting Executor!
0.28/0.21	Starting Executor!
0.28/0.24	59:20 INFO : Found 50 xor gates
0.28/0.28	59:20 INFO : 183 variables remaining out of 184
0.28/0.28	59:20 INFO : 3986 literals remaining out of 2280
22.80/6.03	log4j:WARN No appenders could be found for logger (ibis.constellation.impl.SingleThreadedConstellation.CID: 0:4).
22.80/6.03	log4j:WARN Please initialize the log4j system properly.
22.80/6.03	log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311865-1304186360/watcher-3311865-1304186360 -o /tmp/evaluation-result-3311865-1304186360/solver-3311865-1304186360 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311865-1304186360.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=26140 CPUtime=0 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 1394 0 0 0 0 0 0 0 25 0 2 0 511051914 26767360 874 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 6522 870 664 9 0 381 0
[pid=13231/tid=13232] ppid=13229 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) R 13229 13231 13038 0 -1 4202560 52 0 0 0 0 0 0 0 25 0 2 0 511051914 26714112 881 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220816232453 0 0 4096 0 0 0 0 -1 5 0 0 0

[startup+0.0213941 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15602060 CPUtime=0.01 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 3309 0 1 0 1 0 0 0 25 0 11 0 511051914 15976509440 2751 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3900515 2752 1598 9 0 3891263 0
[pid=13231/tid=13232] ppid=13229 vsize=15602060 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) R 13229 13231 13038 0 -1 4202560 1943 0 1 0 0 0 0 0 25 0 11 0 511051914 15976509440 2752 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 47035624779808 0 4 0 16784584 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15602060

[startup+0.10038 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15676992 CPUtime=0.1 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 5608 0 1 0 9 1 0 0 25 0 18 0 511051914 16053239808 5031 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3919248 5031 2117 9 0 3909967 0
[pid=13231/tid=13232] ppid=13229 vsize=15676992 CPUtime=0.08 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) R 13229 13231 13038 0 -1 4202560 3452 0 1 0 7 1 0 0 18 0 18 0 511051914 16053239808 5031 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 47035627289496 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676992

[startup+0.305347 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15686984 CPUtime=0.48 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 13547 0 1 0 45 3 0 0 25 0 22 0 511051914 16063471616 11029 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3921746 11029 2211 9 0 3912465 0
[pid=13231/tid=13232] ppid=13229 vsize=15686984 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16063471616 11029 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 15686984

[startup+1.46735 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15699952 CPUtime=4.82 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 52957 0 1 0 473 9 0 0 25 0 22 0 511051914 16076750848 45395 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924988 45395 2242 9 0 3915707 0
[pid=13231/tid=13232] ppid=13229 vsize=15700168 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16076972032 45398 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.82
Current children cumulated vsize (KiB) 15699952

[startup+1.50109 s]
/proc/loadavg: 7.42 7.93 7.96 9/198 13231
/proc/meminfo: memFree=30256256/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15702196 CPUtime=4.96 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 54177 0 1 0 486 10 0 0 25 0 22 0 511051914 16079048704 46614 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3925549 46614 2249 9 0 3916268 0
[pid=13231/tid=13232] ppid=13229 vsize=15702196 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16079048704 46614 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.96
Current children cumulated vsize (KiB) 15702196

[startup+3.10079 s]
/proc/loadavg: 7.42 7.93 7.96 9/220 13253
/proc/meminfo: memFree=29918428/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15707088 CPUtime=11.28 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 67265 0 1 0 1117 11 0 0 25 0 22 0 511051914 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3926772 58361 2288 9 0 3917491 0
[pid=13231/tid=13232] ppid=13229 vsize=15707088 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 270 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13236/stat : 13236 (java) S 13229 13231 13038 0 -1 4202560 595 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13237] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13237/stat : 13237 (java) S 13229 13231 13038 0 -1 4202560 377 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13238] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13238/stat : 13238 (java) S 13229 13231 13038 0 -1 4202560 179 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13239] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13239/stat : 13239 (java) S 13229 13231 13038 0 -1 4202560 135 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13240] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13240/stat : 13240 (java) S 13229 13231 13038 0 -1 4202560 477 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13241] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13241/stat : 13241 (java) S 13229 13231 13038 0 -1 4202560 235 0 0 0 0 0 0 0 15 0 22 0 511051915 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13242] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13242/stat : 13242 (java) S 13229 13231 13038 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 511051916 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 0 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13243] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13243/stat : 13243 (java) S 13229 13231 13038 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 511051916 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13244] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13244/stat : 13244 (java) S 13229 13231 13038 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 511051916 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13245] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13245/stat : 13245 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828060081 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13246] ppid=13229 vsize=15707088 CPUtime=0.78 cores=1,3,5,7
/proc/13231/task/13246/stat : 13246 (java) S 13229 13231 13038 0 -1 4202560 5275 0 0 0 78 0 0 0 15 0 22 0 511051918 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13247] ppid=13229 vsize=15707088 CPUtime=1.76 cores=1,3,5,7
/proc/13231/task/13247/stat : 13247 (java) S 13229 13231 13038 0 -1 4202560 22577 0 0 0 173 3 0 0 15 0 22 0 511051918 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13248] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13248/stat : 13248 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13249] ppid=13229 vsize=15707088 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13249/stat : 13249 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511051918 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13250] ppid=13229 vsize=15707088 CPUtime=2.24 cores=1,3,5,7
/proc/13231/task/13250/stat : 13250 (java) R 13229 13231 13038 0 -1 4202560 7055 0 0 0 223 1 0 0 21 0 22 0 511051935 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506298797 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13231/tid=13251] ppid=13229 vsize=15707088 CPUtime=2.36 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 11562 0 0 0 235 1 0 0 21 0 22 0 511051935 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505524165 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15707088 CPUtime=2.1 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 6897 0 0 0 209 1 0 0 20 0 22 0 511051935 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505682748 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15707088 CPUtime=1.67 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 4950 0 0 0 167 0 0 0 21 0 22 0 511051935 16084058112 58361 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506350616 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.28
Current children cumulated vsize (KiB) 15707088

[startup+6.3072 s]
/proc/loadavg: 7.46 7.93 7.96 9/220 13253
/proc/meminfo: memFree=29955408/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15698768 CPUtime=24.01 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 68436 0 1 0 2389 12 0 0 25 0 22 0 511051914 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924692 51733 2288 9 0 3915411 0
[pid=13231/tid=13232] ppid=13229 vsize=15698768 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 422 0 0 0 0 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 222 0 0 0 0 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15698768 CPUtime=0.01 cores=1,3,5,7
/proc/13231/task/13236/stat : 13236 (java) S 13229 13231 13038 0 -1 4202560 792 0 0 0 1 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13237] ppid=13229 vsize=15698768 CPUtime=0.01 cores=1,3,5,7
/proc/13231/task/13237/stat : 13237 (java) S 13229 13231 13038 0 -1 4202560 530 0 0 0 1 0 0 0 16 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13238] ppid=13229 vsize=15698768 CPUtime=0.01 cores=1,3,5,7
/proc/13231/task/13238/stat : 13238 (java) S 13229 13231 13038 0 -1 4202560 326 0 0 0 1 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13239] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13239/stat : 13239 (java) S 13229 13231 13038 0 -1 4202560 232 0 0 0 0 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13240] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13240/stat : 13240 (java) S 13229 13231 13038 0 -1 4202560 590 0 0 0 0 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13241] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13241/stat : 13241 (java) S 13229 13231 13038 0 -1 4202560 333 0 0 0 0 0 0 0 15 0 22 0 511051915 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13242] ppid=13229 vsize=15698768 CPUtime=0.01 cores=1,3,5,7
/proc/13231/task/13242/stat : 13242 (java) S 13229 13231 13038 0 -1 4202560 15 0 0 0 1 0 0 0 15 0 22 0 511051916 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 0 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13243] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13243/stat : 13243 (java) S 13229 13231 13038 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13244] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13244/stat : 13244 (java) S 13229 13231 13038 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13245] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13245/stat : 13245 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828060081 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13246] ppid=13229 vsize=15698768 CPUtime=0.78 cores=1,3,5,7
/proc/13231/task/13246/stat : 13246 (java) S 13229 13231 13038 0 -1 4202560 5275 0 0 0 78 0 0 0 15 0 22 0 511051918 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13247] ppid=13229 vsize=15698768 CPUtime=1.76 cores=1,3,5,7
/proc/13231/task/13247/stat : 13247 (java) S 13229 13231 13038 0 -1 4202560 22577 0 0 0 173 3 0 0 15 0 22 0 511051918 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13248] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13248/stat : 13248 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13249] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13249/stat : 13249 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511051918 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13250] ppid=13229 vsize=15698768 CPUtime=5.42 cores=1,3,5,7
/proc/13231/task/13250/stat : 13250 (java) R 13229 13231 13038 0 -1 4202560 7071 0 0 0 541 1 0 0 25 0 22 0 511051935 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505653640 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13231/tid=13251] ppid=13229 vsize=15698768 CPUtime=5.53 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 11574 0 0 0 552 1 0 0 25 0 22 0 511051935 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505591852 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15698768 CPUtime=5.25 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 6909 0 0 0 524 1 0 0 25 0 22 0 511051935 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506348194 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15698768 CPUtime=4.84 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 4969 0 0 0 484 0 0 0 25 0 22 0 511051935 16075538432 51733 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 18446744073699065863 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.01
Current children cumulated vsize (KiB) 15698768

[startup+12.701 s]
/proc/loadavg: 7.51 7.93 7.96 9/220 13253
/proc/meminfo: memFree=29983452/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15698768 CPUtime=49.43 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 70353 0 1 0 4928 15 0 0 25 0 22 0 511051914 16075538432 49403 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924692 49403 2288 9 0 3915411 0
[pid=13231/tid=13232] ppid=13229 vsize=15698768 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16075538432 49403 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15698768 CPUtime=0.02 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 709 0 0 0 2 0 0 0 15 0 22 0 511051915 16075538432 49403 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15698768 CPUtime=0.02 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 541 0 0 0 2 0 0 0 15 0 22 0 511051915 16075538432 49403 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15698768 CPUtime=0.03 cores=1,3,5,7

################
# More data... #
################

[pid=13231/tid=13251] ppid=13229 vsize=15698768 CPUtime=1049.17 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 68916 0 0 0 104883 34 0 0 25 0 22 0 511051935 16075538432 107783 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506042231 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15698768 CPUtime=1048.8 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 64122 0 0 0 104846 34 0 0 22 0 22 0 511051935 16075538432 107783 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 47035627852827 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15698768 CPUtime=1048.32 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 62137 0 0 0 104797 35 0 0 25 0 22 0 511051935 16075538432 107783 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505591907 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4223.64
Current children cumulated vsize (KiB) 15698768

[startup+1122.3 s]
/proc/loadavg: 8.04 8.05 8.00 9/220 13292
/proc/meminfo: memFree=29671652/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15698768 CPUtime=4462.18 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 557032 0 1 0 445918 300 0 0 25 0 22 0 511051914 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924692 104353 2296 9 0 3915411 0
[pid=13231/tid=13232] ppid=13229 vsize=15698768 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15698768 CPUtime=3.14 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 32178 0 0 0 302 12 0 0 16 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15698768 CPUtime=3.1 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 30740 0 0 0 297 13 0 0 15 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15698768 CPUtime=3.07 cores=1,3,5,7
/proc/13231/task/13236/stat : 13236 (java) S 13229 13231 13038 0 -1 4202560 31675 0 0 0 294 13 0 0 16 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13237] ppid=13229 vsize=15698768 CPUtime=3.08 cores=1,3,5,7
/proc/13231/task/13237/stat : 13237 (java) S 13229 13231 13038 0 -1 4202560 31284 0 0 0 296 12 0 0 15 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13238] ppid=13229 vsize=15698768 CPUtime=3.11 cores=1,3,5,7
/proc/13231/task/13238/stat : 13238 (java) S 13229 13231 13038 0 -1 4202560 31908 0 0 0 301 10 0 0 15 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13239] ppid=13229 vsize=15698768 CPUtime=3.07 cores=1,3,5,7
/proc/13231/task/13239/stat : 13239 (java) S 13229 13231 13038 0 -1 4202560 31735 0 0 0 295 12 0 0 16 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13240] ppid=13229 vsize=15698768 CPUtime=3.19 cores=1,3,5,7
/proc/13231/task/13240/stat : 13240 (java) S 13229 13231 13038 0 -1 4202560 32134 0 0 0 306 13 0 0 15 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13241] ppid=13229 vsize=15698768 CPUtime=3.1 cores=1,3,5,7
/proc/13231/task/13241/stat : 13241 (java) S 13229 13231 13038 0 -1 4202560 31747 0 0 0 297 13 0 0 16 0 22 0 511051915 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13242] ppid=13229 vsize=15698768 CPUtime=1.84 cores=1,3,5,7
/proc/13231/task/13242/stat : 13242 (java) S 13229 13231 13038 0 -1 4202560 1262 0 0 0 138 46 0 0 16 0 22 0 511051916 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 0 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13243] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13243/stat : 13243 (java) S 13229 13231 13038 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13244] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13244/stat : 13244 (java) S 13229 13231 13038 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13245] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13245/stat : 13245 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828060081 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13246] ppid=13229 vsize=15698768 CPUtime=0.78 cores=1,3,5,7
/proc/13231/task/13246/stat : 13246 (java) S 13229 13231 13038 0 -1 4202560 5275 0 0 0 78 0 0 0 15 0 22 0 511051918 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13247] ppid=13229 vsize=15698768 CPUtime=1.84 cores=1,3,5,7
/proc/13231/task/13247/stat : 13247 (java) S 13229 13231 13038 0 -1 4202560 22592 0 0 0 181 3 0 0 16 0 22 0 511051918 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13248] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13248/stat : 13248 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13249] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13249/stat : 13249 (java) S 13229 13231 13038 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 511051918 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13250] ppid=13229 vsize=15698768 CPUtime=1108.21 cores=1,3,5,7
/proc/13231/task/13250/stat : 13250 (java) R 13229 13231 13038 0 -1 4202560 66364 0 0 0 110787 34 0 0 18 0 22 0 511051935 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506347559 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13231/tid=13251] ppid=13229 vsize=15698768 CPUtime=1108.41 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 70993 0 0 0 110805 36 0 0 25 0 22 0 511051935 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506067685 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15698768 CPUtime=1108.18 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 66183 0 0 0 110782 36 0 0 25 0 22 0 511051935 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506042350 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15698768 CPUtime=1107.61 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 64298 0 0 0 110725 36 0 0 25 0 22 0 511051935 16075538432 104353 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 18446744073699065894 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4462.18
Current children cumulated vsize (KiB) 15698768

[startup+1182.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/220 13294
/proc/meminfo: memFree=29687248/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15698768 CPUtime=4700.58 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 572529 0 1 0 469741 317 0 0 25 0 22 0 511051914 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924692 90188 2296 9 0 3915411 0
[pid=13231/tid=13232] ppid=13229 vsize=15698768 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15698768 CPUtime=3.29 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 33617 0 0 0 317 12 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15698768 CPUtime=3.29 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 32531 0 0 0 315 14 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15698768 CPUtime=3.24 cores=1,3,5,7
/proc/13231/task/13236/stat : 13236 (java) S 13229 13231 13038 0 -1 4202560 33074 0 0 0 310 14 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13237] ppid=13229 vsize=15698768 CPUtime=3.25 cores=1,3,5,7
/proc/13231/task/13237/stat : 13237 (java) S 13229 13231 13038 0 -1 4202560 32932 0 0 0 312 13 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13238] ppid=13229 vsize=15698768 CPUtime=3.29 cores=1,3,5,7
/proc/13231/task/13238/stat : 13238 (java) S 13229 13231 13038 0 -1 4202560 33400 0 0 0 318 11 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13239] ppid=13229 vsize=15698768 CPUtime=3.24 cores=1,3,5,7
/proc/13231/task/13239/stat : 13239 (java) S 13229 13231 13038 0 -1 4202560 33454 0 0 0 311 13 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13240] ppid=13229 vsize=15698768 CPUtime=3.33 cores=1,3,5,7
/proc/13231/task/13240/stat : 13240 (java) S 13229 13231 13038 0 -1 4202560 33470 0 0 0 320 13 0 0 15 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13241] ppid=13229 vsize=15698768 CPUtime=3.3 cores=1,3,5,7
/proc/13231/task/13241/stat : 13241 (java) S 13229 13231 13038 0 -1 4202560 33344 0 0 0 316 14 0 0 16 0 22 0 511051915 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13242] ppid=13229 vsize=15698768 CPUtime=1.98 cores=1,3,5,7
/proc/13231/task/13242/stat : 13242 (java) S 13229 13231 13038 0 -1 4202560 1297 0 0 0 149 49 0 0 15 0 22 0 511051916 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 0 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13243] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13243/stat : 13243 (java) S 13229 13231 13038 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13244] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13244/stat : 13244 (java) S 13229 13231 13038 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13245] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13245/stat : 13245 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828060081 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13246] ppid=13229 vsize=15698768 CPUtime=0.78 cores=1,3,5,7
/proc/13231/task/13246/stat : 13246 (java) S 13229 13231 13038 0 -1 4202560 5275 0 0 0 78 0 0 0 15 0 22 0 511051918 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13247] ppid=13229 vsize=15698768 CPUtime=1.84 cores=1,3,5,7
/proc/13231/task/13247/stat : 13247 (java) S 13229 13231 13038 0 -1 4202560 22592 0 0 0 181 3 0 0 16 0 22 0 511051918 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13248] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13248/stat : 13248 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13249] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13249/stat : 13249 (java) S 13229 13231 13038 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 511051918 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13250] ppid=13229 vsize=15698768 CPUtime=1167.34 cores=1,3,5,7
/proc/13231/task/13250/stat : 13250 (java) R 13229 13231 13038 0 -1 4202560 67169 0 0 0 116698 36 0 0 25 0 22 0 511051935 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 18446744073699065955 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13231/tid=13251] ppid=13229 vsize=15698768 CPUtime=1167.69 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 71819 0 0 0 116731 38 0 0 25 0 22 0 511051935 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505591907 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15698768 CPUtime=1167.34 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 66885 0 0 0 116696 38 0 0 25 0 22 0 511051935 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505524136 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15698768 CPUtime=1166.93 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 65002 0 0 0 116654 39 0 0 25 0 22 0 511051935 16075538432 90188 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505654265 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4700.58
Current children cumulated vsize (KiB) 15698768



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.4 s]
/proc/loadavg: 8.11 8.06 8.01 5/197 13297
/proc/meminfo: memFree=30002388/32951124 swapFree=67105204/67111528
[pid=13231] ppid=13229 vsize=15698768 CPUtime=4800.4 cores=1,3,5,7
/proc/13231/stat : 13231 (java) S 13229 13231 13038 0 -1 4202496 603847 0 1 0 479713 327 0 0 25 0 22 0 511051914 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828039141 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/13231/statm: 3924692 112015 2296 9 0 3915411 0
[pid=13231/tid=13232] ppid=13229 vsize=15698768 CPUtime=0.26 cores=1,3,5,7
/proc/13231/task/13232/stat : 13232 (java) S 13229 13231 13038 0 -1 4202560 5215 0 1 0 25 1 0 0 20 0 22 0 511051914 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13234] ppid=13229 vsize=15698768 CPUtime=3.35 cores=1,3,5,7
/proc/13231/task/13234/stat : 13234 (java) S 13229 13231 13038 0 -1 4202560 33990 0 0 0 323 12 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13235] ppid=13229 vsize=15698768 CPUtime=3.35 cores=1,3,5,7
/proc/13231/task/13235/stat : 13235 (java) S 13229 13231 13038 0 -1 4202560 32945 0 0 0 321 14 0 0 16 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13236] ppid=13229 vsize=15698768 CPUtime=3.3 cores=1,3,5,7
/proc/13231/task/13236/stat : 13236 (java) S 13229 13231 13038 0 -1 4202560 33700 0 0 0 316 14 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13237] ppid=13229 vsize=15698768 CPUtime=3.32 cores=1,3,5,7
/proc/13231/task/13237/stat : 13237 (java) S 13229 13231 13038 0 -1 4202560 33264 0 0 0 319 13 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13238] ppid=13229 vsize=15698768 CPUtime=3.37 cores=1,3,5,7
/proc/13231/task/13238/stat : 13238 (java) S 13229 13231 13038 0 -1 4202560 33884 0 0 0 325 12 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13239] ppid=13229 vsize=15698768 CPUtime=3.3 cores=1,3,5,7
/proc/13231/task/13239/stat : 13239 (java) S 13229 13231 13038 0 -1 4202560 33842 0 0 0 317 13 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13240] ppid=13229 vsize=15698768 CPUtime=3.4 cores=1,3,5,7
/proc/13231/task/13240/stat : 13240 (java) S 13229 13231 13038 0 -1 4202560 34104 0 0 0 327 13 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 7 0 0 0
[pid=13231/tid=13241] ppid=13229 vsize=15698768 CPUtime=3.36 cores=1,3,5,7
/proc/13231/task/13241/stat : 13241 (java) S 13229 13231 13038 0 -1 4202560 33805 0 0 0 321 15 0 0 15 0 22 0 511051915 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13242] ppid=13229 vsize=15698768 CPUtime=2.04 cores=1,3,5,7
/proc/13231/task/13242/stat : 13242 (java) S 13229 13231 13038 0 -1 4202560 1371 0 0 0 153 51 0 0 15 0 22 0 511051916 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 0 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13243] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13243/stat : 13243 (java) S 13229 13231 13038 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13244] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13244/stat : 13244 (java) S 13229 13231 13038 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 511051916 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13245] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13245/stat : 13245 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828060081 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13246] ppid=13229 vsize=15698768 CPUtime=0.78 cores=1,3,5,7
/proc/13231/task/13246/stat : 13246 (java) S 13229 13231 13038 0 -1 4202560 5275 0 0 0 78 0 0 0 15 0 22 0 511051918 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13247] ppid=13229 vsize=15698768 CPUtime=1.84 cores=1,3,5,7
/proc/13231/task/13247/stat : 13247 (java) S 13229 13231 13038 0 -1 4202560 22592 0 0 0 181 3 0 0 16 0 22 0 511051918 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 3 0 0 0
[pid=13231/tid=13248] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13248/stat : 13248 (java) S 13229 13231 13038 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511051918 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052377 0 4 0 16800975 18446604465309070656 0 0 -1 5 0 0 0
[pid=13231/tid=13249] ppid=13229 vsize=15698768 CPUtime=0 cores=1,3,5,7
/proc/13231/task/13249/stat : 13249 (java) S 13229 13231 13038 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 511051918 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 220828052992 0 4 0 16800975 18446604465309070656 0 0 -1 1 0 0 0
[pid=13231/tid=13250] ppid=13229 vsize=15698768 CPUtime=1192.15 cores=1,3,5,7
/proc/13231/task/13250/stat : 13250 (java) R 13229 13231 13038 0 -1 4202560 73746 0 0 0 119178 37 0 0 25 0 22 0 511051935 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 47035627852663 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13231/tid=13251] ppid=13229 vsize=15698768 CPUtime=1192.49 cores=1,3,5,7
/proc/13231/task/13251/stat : 13251 (java) R 13229 13231 13038 0 -1 4202560 78865 0 0 0 119210 39 0 0 25 0 22 0 511051935 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505633792 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13231/tid=13252] ppid=13229 vsize=15698768 CPUtime=1192.12 cores=1,3,5,7
/proc/13231/task/13252/stat : 13252 (java) R 13229 13231 13038 0 -1 4202560 73815 0 0 0 119172 40 0 0 25 0 22 0 511051935 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912506350062 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13231/tid=13253] ppid=13229 vsize=15698768 CPUtime=1191.78 cores=1,3,5,7
/proc/13231/task/13253/stat : 13253 (java) R 13229 13231 13038 0 -1 4202560 71981 0 0 0 119138 40 0 0 25 0 22 0 511051935 16075538432 112015 33554432000 1073741824 1073778376 140735656270304 18446744073709551615 46912505524195 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 15698768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1207.44
CPU time (s): 4800.46
CPU user time (s): 4797.16
CPU system time (s): 3.2975
CPU usage (%): 397.574
Max. virtual memory (cumulated for all children) (KiB): 15707088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.16
system time used= 3.2975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 603873
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 390312
involuntary context switches= 171812

runsolver used 2.02169 second user time and 4.6013 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-30 19:59:20
IDJOB=3311865
IDBENCH=84030
IDSOLVER=1698
FILE ID=node147/3311865-1304186360
RUNJOBID= node147-1304185151-13057
PBS_JOBID= 13172477
Free space on /tmp= 73080 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n28-01-S136611085.shuffled-as.sat03-1627.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311865-1304186360/watcher-3311865-1304186360 -o /tmp/evaluation-result-3311865-1304186360/solver-3311865-1304186360 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311865-1304186360.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 17624c574c7f9ee0eff4cc4a13e42e12
RANDOM SEED=1440371236

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30257396 kB
Buffers:        340024 kB
Cached:        1767672 kB
SwapCached:       3064 kB
Active:         416704 kB
Inactive:      1943772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30257396 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:            3424 kB
Writeback:           0 kB
AnonPages:      251296 kB
Mapped:          23184 kB
Slab:           269844 kB
PageTables:       4696 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   834808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73080 MiB
End job on node147 at 2011-04-30 20:19:30