Trace number 3313145

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.23 1207.14

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/rnd_100_28_u.cnf
MD5SUM7fb794f1c5d1c4d1723aeeb5efb40cdc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark56.3054
Satisfiable
(Un)Satisfiability was proved
Number of variables2856
Number of clauses10578
Sum of the clauses size26556
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25178
Number of clauses of size 35400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	04:41 INFO : Reading from input HOME/instance-3313145-1304183081.cnf
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Executor set job limit to 1000000
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
0.51/0.32	Starting Executor!
1.29/0.64	04:42 INFO : 2448 variables remaining out of 2856
1.29/0.64	04:42 INFO : 41760 literals remaining out of 37134

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313145-1304183081/watcher-3313145-1304183081 -o /tmp/evaluation-result-3313145-1304183081/solver-3313145-1304183081 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313145-1304183081.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.52 6.81 7.44 3/174 414
/proc/meminfo: memFree=30966304/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/414/stat : 414 (run) R 412 414 32139 0 -1 4194304 234 0 0 0 0 0 0 0 23 0 1 0 510724387 8908800 170 33554432000 4194304 4922060 140734104146080 18446744073709551615 4559414 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/414/statm: 2175 181 152 178 0 68 0

[startup+0.0805611 s]
/proc/loadavg: 4.52 6.81 7.44 3/174 414
/proc/meminfo: memFree=30966304/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15676176 CPUtime=0.06 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 4634 0 1 0 6 0 0 0 23 0 18 0 510724387 16052404224 4074 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3919044 4079 1915 9 0 3909763 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15676176

[startup+0.10057 s]
/proc/loadavg: 4.52 6.81 7.44 3/174 414
/proc/meminfo: memFree=30966304/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15677200 CPUtime=0.1 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 5527 0 1 0 9 1 0 0 23 0 18 0 510724387 16053452800 4930 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3919300 4930 2115 9 0 3910019 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15677200

[startup+0.300478 s]
/proc/loadavg: 4.52 6.81 7.44 3/174 414
/proc/meminfo: memFree=30966304/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15684368 CPUtime=0.51 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 13798 0 1 0 49 2 0 0 23 0 18 0 510724387 16060792832 12426 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3921092 12429 2205 9 0 3911811 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15684368

[startup+0.700408 s]
/proc/loadavg: 4.52 6.81 7.44 3/174 414
/proc/meminfo: memFree=30966304/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=1.55 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 26524 0 1 0 150 5 0 0 23 0 22 0 510724387 16077012992 21760 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 21760 2258 9 0 3915771 0
Current children cumulated CPU time (s) 1.55
Current children cumulated vsize (KiB) 15700208

[startup+1.50127 s]
/proc/loadavg: 4.52 6.81 7.44 10/220 473
/proc/meminfo: memFree=30616328/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=4.69 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 64684 0 1 0 457 12 0 0 23 0 22 0 510724387 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 54585 2283 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 244 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 1181 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 959 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 728 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 402 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 1814 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 1840 0 0 0 0 0 0 0 16 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 2158 0 0 0 1 0 0 0 16 0 22 0 510724389 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) R 412 414 32139 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 22 0 510724390 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 47822276692608 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.15 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10113 0 0 0 112 3 0 0 17 0 22 0 510724393 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=435] ppid=412 vsize=15700208 CPUtime=0.66 cores=0,2,4,6
/proc/414/task/435/stat : 435 (java) R 412 414 32139 0 -1 4202560 8059 0 0 0 66 0 0 0 18 0 22 0 510724393 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=436] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/436/stat : 436 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 510724393 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=437] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/437/stat : 437 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 510724393 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=456] ppid=412 vsize=15700208 CPUtime=0.74 cores=0,2,4,6
/proc/414/task/456/stat : 456 (java) R 412 414 32139 0 -1 4202560 6676 0 0 0 73 1 0 0 16 0 22 0 510724420 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 18446744073699065925 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=0.42 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 3562 0 0 0 42 0 0 0 16 0 22 0 510724420 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505806540 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=0.37 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 5592 0 0 0 37 0 0 0 16 0 22 0 510724420 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505834540 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=0.61 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 7454 0 0 0 61 0 0 0 16 0 22 0 510724420 16077012992 54585 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912506132646 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.69
Current children cumulated vsize (KiB) 15700208

[startup+3.10095 s]
/proc/loadavg: 4.52 6.81 7.44 6/220 473
/proc/meminfo: memFree=30411980/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=11.05 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 208042 0 1 0 1075 30 0 0 23 0 22 0 510724387 16077012992 197687 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 197701 2284 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 197717 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 4137 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 197735 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 3425 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 197747 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 3864 0 0 0 1 0 0 0 15 0 22 0 510724389 16077012992 197753 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 3185 0 0 0 1 0 0 0 15 0 22 0 510724389 16077012992 197758 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 3427 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 197762 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 3528 0 0 0 0 0 0 0 16 0 22 0 510724389 16077012992 197766 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 5434 0 0 0 1 0 0 0 16 0 22 0 510724389 16077012992 197771 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 4822 0 0 0 1 0 0 0 15 0 22 0 510724389 16077012992 197776 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 459 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 197781 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 197785 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) S 412 414 32139 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 510724390 16077012992 197791 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 197794 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.24 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10315 0 0 0 121 3 0 0 15 0 22 0 510724393 16077012992 197797 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=435] ppid=412 vsize=15700208 CPUtime=0.78 cores=0,2,4,6
/proc/414/task/435/stat : 435 (java) S 412 414 32139 0 -1 4202560 8065 0 0 0 78 0 0 0 15 0 22 0 510724393 16077012992 197800 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=436] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/436/stat : 436 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 510724393 16077012992 197801 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=437] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/437/stat : 437 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 510724393 16077012992 197805 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=456] ppid=412 vsize=15700208 CPUtime=2.2 cores=0,2,4,6
/proc/414/task/456/stat : 456 (java) R 412 414 32139 0 -1 4202560 39621 0 0 0 214 6 0 0 17 0 22 0 510724420 16077012992 197808 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 47822280817491 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=1.98 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 30524 0 0 0 194 4 0 0 17 0 22 0 510724420 16077012992 197809 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505838109 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=1.84 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 35320 0 0 0 181 3 0 0 18 0 22 0 510724420 16077012992 197812 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 47822280138907 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=2.18 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 38210 0 0 0 215 3 0 0 17 0 22 0 510724420 16077012992 197816 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912506020827 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.05
Current children cumulated vsize (KiB) 15700208

[startup+6.30138 s]
/proc/loadavg: 4.63 6.80 7.43 6/220 473
/proc/meminfo: memFree=27469412/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=23.83 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 441737 0 1 0 2321 62 0 0 23 0 22 0 510724387 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 431176 2291 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 4448 0 0 0 0 0 0 0 16 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 4323 0 0 0 1 0 0 0 16 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 4278 0 0 0 1 0 0 0 16 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 3393 0 0 0 1 0 0 0 15 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 4182 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 3915 0 0 0 0 0 0 0 15 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 6588 0 0 0 1 0 0 0 16 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=0.01 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 5281 0 0 0 1 0 0 0 15 0 22 0 510724389 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 1242 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) S 412 414 32139 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 510724390 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.29 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10485 0 0 0 126 3 0 0 16 0 22 0 510724393 16077012992 431176 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=1107.76 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 372515 0 0 0 110723 53 0 0 25 0 22 0 510724420 16077012992 144233 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505636448 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=1107.42 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 404476 0 0 0 110687 55 0 0 25 0 22 0 510724420 16077012992 144233 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505764915 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=1108.27 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 409887 0 0 0 110770 57 0 0 25 0 22 0 510724420 16077012992 144233 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505523205 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4462.86
Current children cumulated vsize (KiB) 15700208

[startup+1182.3 s]
/proc/loadavg: 5.12 5.14 5.85 6/218 505
/proc/meminfo: memFree=15173316/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=4701.53 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 2740755 0 1 0 469637 516 0 0 23 0 22 0 510724387 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 127558 2299 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=3.51 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 128159 0 0 0 328 23 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=3.57 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 125534 0 0 0 333 24 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=3.54 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 130702 0 0 0 332 22 0 0 16 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=3.51 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 131081 0 0 0 328 23 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=3.53 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 135929 0 0 0 329 24 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=3.45 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 126620 0 0 0 322 23 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=3.47 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 130713 0 0 0 324 23 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=3.51 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 130661 0 0 0 328 23 0 0 15 0 22 0 510724389 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=2.24 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 7276 0 0 0 138 86 0 0 15 0 22 0 510724390 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) S 412 414 32139 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 510724390 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.29 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10485 0 0 0 126 3 0 0 16 0 22 0 510724393 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=435] ppid=412 vsize=15700208 CPUtime=0.97 cores=0,2,4,6
/proc/414/task/435/stat : 435 (java) S 412 414 32139 0 -1 4202560 8114 0 0 0 97 0 0 0 15 0 22 0 510724393 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=436] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/436/stat : 436 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 510724393 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=437] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/437/stat : 437 (java) S 412 414 32139 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 510724393 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=456] ppid=412 vsize=15700208 CPUtime=1166.87 cores=0,2,4,6
/proc/414/task/456/stat : 456 (java) R 412 414 32139 0 -1 4202560 426051 0 0 0 116627 60 0 0 25 0 22 0 510724420 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912506373170 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=1167.05 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 385562 0 0 0 116651 54 0 0 25 0 22 0 510724420 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912506151135 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=1166.77 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 423925 0 0 0 116620 57 0 0 25 0 22 0 510724420 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505868813 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=1167.47 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 426048 0 0 0 116687 60 0 0 25 0 22 0 510724420 16077012992 127558 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505820038 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4701.53
Current children cumulated vsize (KiB) 15700208



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.1 s]
/proc/loadavg: 5.08 5.13 5.83 6/218 506
/proc/meminfo: memFree=15207636/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=4800.16 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 2794410 0 1 0 479489 527 0 0 23 0 22 0 510724387 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 118721 2299 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=3.59 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 130981 0 0 0 336 23 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=3.65 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 128347 0 0 0 341 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=3.62 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 133382 0 0 0 340 22 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=3.58 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 133151 0 0 0 334 24 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=3.6 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 138498 0 0 0 336 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=3.52 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 128971 0 0 0 328 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=3.55 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 133267 0 0 0 332 23 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=3.58 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 132415 0 0 0 335 23 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=2.29 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 7494 0 0 0 141 88 0 0 16 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) S 412 414 32139 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.29 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10485 0 0 0 126 3 0 0 16 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=435] ppid=412 vsize=15700208 CPUtime=0.97 cores=0,2,4,6
/proc/414/task/435/stat : 435 (java) S 412 414 32139 0 -1 4202560 8114 0 0 0 97 0 0 0 15 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=436] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/436/stat : 436 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=437] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/437/stat : 437 (java) S 412 414 32139 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=456] ppid=412 vsize=15700208 CPUtime=1191.4 cores=0,2,4,6
/proc/414/task/456/stat : 456 (java) R 412 414 32139 0 -1 4202560 435649 0 0 0 119079 61 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505855864 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=1191.44 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 393854 0 0 0 119088 56 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505856497 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=1191.31 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 431758 0 0 0 119072 59 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505819747 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=1191.99 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 434147 0 0 0 119138 61 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505757175 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 15700208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.1 s]
/proc/loadavg: 5.08 5.13 5.83 6/218 506
/proc/meminfo: memFree=15207636/32951124 swapFree=67106388/67111528
[pid=414] ppid=412 vsize=15700208 CPUtime=4800.16 cores=0,2,4,6
/proc/414/stat : 414 (java) S 412 414 32139 0 -1 4202496 2794410 0 1 0 479489 527 0 0 23 0 22 0 510724387 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/414/statm: 3925052 118721 2299 9 0 3915771 0
[pid=414/tid=416] ppid=412 vsize=15700208 CPUtime=0.62 cores=0,2,4,6
/proc/414/task/416/stat : 416 (java) S 412 414 32139 0 -1 4202560 12443 0 1 0 60 2 0 0 18 0 22 0 510724388 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=417] ppid=412 vsize=15700208 CPUtime=3.59 cores=0,2,4,6
/proc/414/task/417/stat : 417 (java) S 412 414 32139 0 -1 4202560 130981 0 0 0 336 23 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=418] ppid=412 vsize=15700208 CPUtime=3.65 cores=0,2,4,6
/proc/414/task/418/stat : 418 (java) S 412 414 32139 0 -1 4202560 128347 0 0 0 341 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=419] ppid=412 vsize=15700208 CPUtime=3.62 cores=0,2,4,6
/proc/414/task/419/stat : 419 (java) S 412 414 32139 0 -1 4202560 133382 0 0 0 340 22 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=420] ppid=412 vsize=15700208 CPUtime=3.58 cores=0,2,4,6
/proc/414/task/420/stat : 420 (java) S 412 414 32139 0 -1 4202560 133151 0 0 0 334 24 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=421] ppid=412 vsize=15700208 CPUtime=3.6 cores=0,2,4,6
/proc/414/task/421/stat : 421 (java) S 412 414 32139 0 -1 4202560 138498 0 0 0 336 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=422] ppid=412 vsize=15700208 CPUtime=3.52 cores=0,2,4,6
/proc/414/task/422/stat : 422 (java) S 412 414 32139 0 -1 4202560 128971 0 0 0 328 24 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=423] ppid=412 vsize=15700208 CPUtime=3.55 cores=0,2,4,6
/proc/414/task/423/stat : 423 (java) S 412 414 32139 0 -1 4202560 133267 0 0 0 332 23 0 0 16 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=424] ppid=412 vsize=15700208 CPUtime=3.58 cores=0,2,4,6
/proc/414/task/424/stat : 424 (java) S 412 414 32139 0 -1 4202560 132415 0 0 0 335 23 0 0 15 0 22 0 510724389 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=425] ppid=412 vsize=15700208 CPUtime=2.29 cores=0,2,4,6
/proc/414/task/425/stat : 425 (java) S 412 414 32139 0 -1 4202560 7494 0 0 0 141 88 0 0 16 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 0 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=426] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/426/stat : 426 (java) S 412 414 32139 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=427] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/427/stat : 427 (java) S 412 414 32139 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 510724390 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=433] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/433/stat : 433 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051478961 0 4 0 16800975 18446604453913412032 0 0 -1 4 0 0 0
[pid=414/tid=434] ppid=412 vsize=15700208 CPUtime=1.29 cores=0,2,4,6
/proc/414/task/434/stat : 434 (java) S 412 414 32139 0 -1 4202560 10485 0 0 0 126 3 0 0 16 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=435] ppid=412 vsize=15700208 CPUtime=0.97 cores=0,2,4,6
/proc/414/task/435/stat : 435 (java) S 412 414 32139 0 -1 4202560 8114 0 0 0 97 0 0 0 15 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 6 0 0 0
[pid=414/tid=436] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/436/stat : 436 (java) S 412 414 32139 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471257 0 4 0 16800975 18446604453913412032 0 0 -1 0 0 0 0
[pid=414/tid=437] ppid=412 vsize=15700208 CPUtime=0 cores=0,2,4,6
/proc/414/task/437/stat : 437 (java) S 412 414 32139 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 510724393 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 212051471872 0 4 0 16800975 18446604453913412032 0 0 -1 2 0 0 0
[pid=414/tid=456] ppid=412 vsize=15700208 CPUtime=1191.4 cores=0,2,4,6
/proc/414/task/456/stat : 456 (java) R 412 414 32139 0 -1 4202560 435649 0 0 0 119079 61 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505855864 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=414/tid=457] ppid=412 vsize=15700208 CPUtime=1191.44 cores=0,2,4,6
/proc/414/task/457/stat : 457 (java) R 412 414 32139 0 -1 4202560 393854 0 0 0 119088 56 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505856497 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=414/tid=458] ppid=412 vsize=15700208 CPUtime=1191.31 cores=0,2,4,6
/proc/414/task/458/stat : 458 (java) R 412 414 32139 0 -1 4202560 431758 0 0 0 119072 59 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505819747 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=414/tid=467] ppid=412 vsize=15700208 CPUtime=1191.99 cores=0,2,4,6
/proc/414/task/467/stat : 467 (java) R 412 414 32139 0 -1 4202560 434147 0 0 0 119138 61 0 0 25 0 22 0 510724420 16077012992 118721 33554432000 1073741824 1073778376 140734047508800 18446744073709551615 46912505757175 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 15700208

Child status: 143
Real time (s): 1207.14
CPU time (s): 4800.23
CPU user time (s): 4794.94
CPU system time (s): 5.29419
CPU usage (%): 397.653
Max. virtual memory (cumulated for all children) (KiB): 15700208

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.94
system time used= 5.2942
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2794438
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 220258
involuntary context switches= 122231

runsolver used 2.15067 second user time and 4.48432 second system time

The end

Launcher Data 

Begin job on node146 at 2011-04-30 19:04:41
IDJOB=3313145
IDBENCH=83192
IDSOLVER=1699
FILE ID=node146/3313145-1304183081
RUNJOBID= node146-1304183081-400
PBS_JOBID= 13172433
Free space on /tmp= 73348 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/rnd_100_28_u.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313145-1304183081/watcher-3313145-1304183081 -o /tmp/evaluation-result-3313145-1304183081/solver-3313145-1304183081 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313145-1304183081.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7fb794f1c5d1c4d1723aeeb5efb40cdc
RANDOM SEED=806139934

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30966584 kB
Buffers:        438528 kB
Cached:        1110148 kB
SwapCached:        732 kB
Active:         132412 kB
Inactive:      1478828 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30966584 kB
SwapTotal:    67111528 kB
SwapFree:     67106388 kB
Dirty:            2824 kB
Writeback:           0 kB
AnonPages:       61596 kB
Mapped:          14328 kB
Slab:           310432 kB
PageTables:       4728 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186840 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73344 MiB
End job on node146 at 2011-04-30 19:24:50