Trace number 3313016

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.25 1207.13

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/f600.shuffled.cnf
MD5SUMd42133fd7674f41611be43d1b8ca7db6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.011997
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2550
Sum of the clauses size7650
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32550
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	25:58 INFO : Reading from input HOME/instance-3313016-1304187957.cnf
0.27/0.24	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.53/0.37	25:58 INFO : 597 variables remaining out of 600
0.53/0.37	25:58 INFO : 10104 literals remaining out of 10200

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313016-1304187957/watcher-3313016-1304187957 -o /tmp/evaluation-result-3313016-1304187957/solver-3313016-1304187957 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313016-1304187957.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.46 7.96 7.78 2/194 16583
/proc/meminfo: memFree=20819304/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=27172 CPUtime=0 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 1424 0 0 0 0 0 0 0 25 0 2 0 530395493 27824128 894 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 6793 894 684 9 0 381 0
[pid=16583/tid=16584] ppid=16581 vsize=28436 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) R 16581 16583 16394 0 -1 4202560 74 0 0 0 0 0 0 0 25 0 2 0 530395493 29118464 901 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237273908827 0 0 4096 0 0 0 0 -1 1 0 0 0

[startup+0.042298 s]
/proc/loadavg: 7.46 7.96 7.78 2/194 16583
/proc/meminfo: memFree=20819304/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15604248 CPUtime=0.03 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 3846 0 1 0 3 0 0 0 25 0 13 0 530395493 15978749952 3285 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800971 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3901062 3285 1683 9 0 3891810 0
[pid=16583/tid=16584] ppid=16581 vsize=15604248 CPUtime=0.03 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) R 16581 16583 16394 0 -1 4202560 2454 0 1 0 3 0 0 0 25 0 13 0 530395493 15978749952 3285 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 47887065178087 0 4 0 16800971 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15604248

[startup+0.100287 s]
/proc/loadavg: 7.46 7.96 7.78 2/194 16583
/proc/meminfo: memFree=20819304/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15676252 CPUtime=0.1 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 5628 0 1 0 9 1 0 0 25 0 18 0 530395493 16052482048 5036 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3919063 5036 2117 9 0 3909782 0
[pid=16583/tid=16584] ppid=16581 vsize=15676252 CPUtime=0.09 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) R 16581 16583 16394 0 -1 4202560 3472 0 1 0 8 1 0 0 25 0 18 0 530395493 16052482048 5036 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290706379 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676252

[startup+0.300253 s]
/proc/loadavg: 7.46 7.96 7.78 2/194 16583
/proc/meminfo: memFree=20819304/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15687112 CPUtime=0.53 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 11463 0 1 0 51 2 0 0 25 0 22 0 530395493 16063602688 9604 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3921778 9604 2213 9 0 3912497 0
[pid=16583/tid=16584] ppid=16581 vsize=15687112 CPUtime=0.28 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) R 16581 16583 16394 0 -1 4202560 6222 0 1 0 27 1 0 0 25 0 22 0 530395493 16063602688 9604 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 47887066153850 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 15687112

[startup+0.700183 s]
/proc/loadavg: 7.46 7.96 7.78 2/194 16583
/proc/meminfo: memFree=20819304/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15711876 CPUtime=1.86 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 30307 0 1 0 181 5 0 0 25 0 22 0 530395493 16088961024 24314 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3927969 24318 2257 9 0 3918688 0
[pid=16583/tid=16584] ppid=16581 vsize=15711876 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16088961024 24328 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.86
Current children cumulated vsize (KiB) 15711876

[startup+1.50104 s]
/proc/loadavg: 7.46 7.96 7.78 14/220 16609
/proc/meminfo: memFree=20542948/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15711884 CPUtime=5.03 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 59984 0 1 0 495 8 0 0 25 0 22 0 530395493 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3927971 53283 2273 9 0 3918690 0
[pid=16583/tid=16584] ppid=16581 vsize=15711884 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 1001 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 82 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 833 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 521 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 23 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 749 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 1159 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 578 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16594] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16594/stat : 16594 (java) S 16581 16583 16394 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 530395495 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 0 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16595] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16595/stat : 16595 (java) S 16581 16583 16394 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530395495 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16596] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16596/stat : 16596 (java) S 16581 16583 16394 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 530395495 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16597] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16597/stat : 16597 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530395497 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290703281 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16598] ppid=16581 vsize=15711884 CPUtime=1.06 cores=1,3,5,7
/proc/16583/task/16598/stat : 16598 (java) S 16581 16583 16394 0 -1 4202560 11114 0 0 0 105 1 0 0 25 0 22 0 530395497 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16599] ppid=16581 vsize=15711884 CPUtime=0.72 cores=1,3,5,7
/proc/16583/task/16599/stat : 16599 (java) R 16581 16583 16394 0 -1 4202560 6768 0 0 0 71 1 0 0 23 0 22 0 530395497 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 47887066391263 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16583/tid=16600] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16600/stat : 16600 (java) S 16581 16583 16394 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 530395497 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16601] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16601/stat : 16601 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530395497 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16606] ppid=16581 vsize=15711884 CPUtime=0.61 cores=1,3,5,7
/proc/16583/task/16606/stat : 16606 (java) R 16581 16583 16394 0 -1 4202560 6049 0 0 0 61 0 0 0 25 0 22 0 530395518 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505721583 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16583/tid=16607] ppid=16581 vsize=15711884 CPUtime=0.6 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 4997 0 0 0 60 0 0 0 25 0 22 0 530395518 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505766444 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15711884 CPUtime=0.96 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 10568 0 0 0 96 0 0 0 25 0 22 0 530395518 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505695826 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15711884 CPUtime=0.61 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 7522 0 0 0 61 0 0 0 25 0 22 0 530395518 16088969216 53283 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505763138 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.03
Current children cumulated vsize (KiB) 15711884

[startup+3.10076 s]
/proc/loadavg: 7.46 7.96 7.78 9/220 16609
/proc/meminfo: memFree=20313300/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15711884 CPUtime=11.4 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 156323 0 1 0 1120 20 0 0 25 0 22 0 530395493 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3927971 149565 2277 9 0 3918690 0
[pid=16583/tid=16584] ppid=16581 vsize=15711884 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 2207 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15711884 CPUtime=0.01 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 2511 0 0 0 1 0 0 0 16 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 1201 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 1792 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 2000 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 2911 0 0 0 0 0 0 0 16 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 2116 0 0 0 0 0 0 0 15 0 22 0 530395494 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16594] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16594/stat : 16594 (java) S 16581 16583 16394 0 -1 4202560 440 0 0 0 0 0 0 0 15 0 22 0 530395495 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 0 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16595] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16595/stat : 16595 (java) S 16581 16583 16394 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530395495 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16596] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16596/stat : 16596 (java) S 16581 16583 16394 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 530395495 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16597] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16597/stat : 16597 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530395497 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290703281 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16598] ppid=16581 vsize=15711884 CPUtime=1.12 cores=1,3,5,7
/proc/16583/task/16598/stat : 16598 (java) S 16581 16583 16394 0 -1 4202560 11123 0 0 0 111 1 0 0 18 0 22 0 530395497 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16599] ppid=16581 vsize=15711884 CPUtime=0.85 cores=1,3,5,7
/proc/16583/task/16599/stat : 16599 (java) S 16581 16583 16394 0 -1 4202560 6794 0 0 0 84 1 0 0 16 0 22 0 530395497 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16600] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16600/stat : 16600 (java) S 16581 16583 16394 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 530395497 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16601] ppid=16581 vsize=15711884 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16601/stat : 16601 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530395497 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16606] ppid=16581 vsize=15711884 CPUtime=2.12 cores=1,3,5,7
/proc/16583/task/16606/stat : 16606 (java) R 16581 16583 16394 0 -1 4202560 26771 0 0 0 209 3 0 0 25 0 22 0 530395518 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505753109 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16583/tid=16607] ppid=16581 vsize=15711884 CPUtime=2.18 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 26271 0 0 0 215 3 0 0 25 0 22 0 530395518 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505849061 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15711884 CPUtime=2.5 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 31874 0 0 0 247 3 0 0 25 0 22 0 530395518 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505695843 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15711884 CPUtime=2.13 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 29611 0 0 0 211 2 0 0 25 0 22 0 530395518 16088969216 149565 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505873593 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.4
Current children cumulated vsize (KiB) 15711884

[startup+6.30119 s]
/proc/loadavg: 7.58 7.97 7.78 9/220 16609
/proc/meminfo: memFree=19544768/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15703376 CPUtime=24.17 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 282683 0 1 0 2382 35 0 0 25 0 22 0 530395493 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3925844 271047 2284 9 0 3916563 0
[pid=16583/tid=16584] ppid=16581 vsize=15703376 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 2485 0 0 0 0 0 0 0 15 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15703376 CPUtime=0.01 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 2511 0 0 0 1 0 0 0 16 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 2400 0 0 0 0 0 0 0 15 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 2089 0 0 0 0 0 0 0 16 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 1424 0 0 0 0 0 0 0 16 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 2301 0 0 0 0 0 0 0 16 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 3502 0 0 0 0 0 0 0 15 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15703376 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 2116 0 0 0 0 0 0 0 15 0 22 0 530395494 16080257024 271047 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=16583/tid=16607] ppid=16581 vsize=15762816 CPUtime=1107.46 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 395511 0 0 0 110687 59 0 0 25 0 22 0 530395518 16141123584 113183 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 47887069954650 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15762816 CPUtime=1108.13 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 401516 0 0 0 110756 57 0 0 25 0 22 0 530395518 16141123584 113183 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505721553 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15762816 CPUtime=1108.15 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 396137 0 0 0 110762 53 0 0 25 0 22 0 530395518 16141123584 113183 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505742150 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4463.01
Current children cumulated vsize (KiB) 15762816

[startup+1182.3 s]
/proc/loadavg: 8.11 7.97 7.84 9/220 16688
/proc/meminfo: memFree=8370096/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15762816 CPUtime=4701.55 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 2821924 0 1 0 469608 547 0 0 25 0 22 0 530395493 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3940704 107380 2298 9 0 3931423 0
[pid=16583/tid=16584] ppid=16581 vsize=15762816 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15762816 CPUtime=3.52 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 139936 0 0 0 326 26 0 0 15 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15762816 CPUtime=3.62 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 146110 0 0 0 335 27 0 0 16 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15762816 CPUtime=3.45 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 139330 0 0 0 318 27 0 0 15 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15762816 CPUtime=3.52 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 139742 0 0 0 325 27 0 0 16 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15762816 CPUtime=3.49 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 141405 0 0 0 322 27 0 0 16 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15762816 CPUtime=3.56 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 146685 0 0 0 330 26 0 0 16 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15762816 CPUtime=3.64 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 147667 0 0 0 339 25 0 0 16 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15762816 CPUtime=3.46 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 139696 0 0 0 321 25 0 0 15 0 22 0 530395494 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16594] ppid=16581 vsize=15762816 CPUtime=2.43 cores=1,3,5,7
/proc/16583/task/16594/stat : 16594 (java) S 16581 16583 16394 0 -1 4202560 7523 0 0 0 153 90 0 0 16 0 22 0 530395495 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 0 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16595] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16595/stat : 16595 (java) S 16581 16583 16394 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16596] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16596/stat : 16596 (java) S 16581 16583 16394 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16597] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16597/stat : 16597 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290703281 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16598] ppid=16581 vsize=15762816 CPUtime=1.21 cores=1,3,5,7
/proc/16583/task/16598/stat : 16598 (java) S 16581 16583 16394 0 -1 4202560 11141 0 0 0 120 1 0 0 15 0 22 0 530395497 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16599] ppid=16581 vsize=15762816 CPUtime=0.95 cores=1,3,5,7
/proc/16583/task/16599/stat : 16599 (java) S 16581 16583 16394 0 -1 4202560 6819 0 0 0 94 1 0 0 15 0 22 0 530395497 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16600] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16600/stat : 16600 (java) S 16581 16583 16394 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16601] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16601/stat : 16601 (java) S 16581 16583 16394 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 530395497 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16606] ppid=16581 vsize=15762816 CPUtime=1166.63 cores=1,3,5,7
/proc/16583/task/16606/stat : 16606 (java) R 16581 16583 16394 0 -1 4202560 408939 0 0 0 116605 58 0 0 25 0 22 0 530395518 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 47887069955121 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16583/tid=16607] ppid=16581 vsize=15762816 CPUtime=1166.73 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 410049 0 0 0 116611 62 0 0 25 0 22 0 530395518 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505523269 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15762816 CPUtime=1167.39 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 417322 0 0 0 116679 60 0 0 25 0 22 0 530395518 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505695736 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15762816 CPUtime=1167.44 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 411551 0 0 0 116688 56 0 0 25 0 22 0 530395518 16141123584 107380 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505523244 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4701.55
Current children cumulated vsize (KiB) 15762816



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.1 s]
/proc/loadavg: 8.07 7.97 7.84 10/220 16689
/proc/meminfo: memFree=8288388/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15762816 CPUtime=4800.19 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 2872872 0 1 0 479462 557 0 0 25 0 22 0 530395493 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3940704 97952 2298 9 0 3931423 0
[pid=16583/tid=16584] ppid=16581 vsize=15762816 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15762816 CPUtime=3.59 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 141330 0 0 0 332 27 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15762816 CPUtime=3.69 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 147817 0 0 0 341 28 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15762816 CPUtime=3.53 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 140405 0 0 0 325 28 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15762816 CPUtime=3.58 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 140492 0 0 0 331 27 0 0 16 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15762816 CPUtime=3.56 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 142717 0 0 0 329 27 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15762816 CPUtime=3.64 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 148855 0 0 0 337 27 0 0 16 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15762816 CPUtime=3.7 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 149389 0 0 0 345 25 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15762816 CPUtime=3.54 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 142207 0 0 0 329 25 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16594] ppid=16581 vsize=15762816 CPUtime=2.48 cores=1,3,5,7
/proc/16583/task/16594/stat : 16594 (java) S 16581 16583 16394 0 -1 4202560 7685 0 0 0 156 92 0 0 16 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 0 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16595] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16595/stat : 16595 (java) S 16581 16583 16394 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16596] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16596/stat : 16596 (java) S 16581 16583 16394 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16597] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16597/stat : 16597 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290703281 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16598] ppid=16581 vsize=15762816 CPUtime=1.21 cores=1,3,5,7
/proc/16583/task/16598/stat : 16598 (java) S 16581 16583 16394 0 -1 4202560 11141 0 0 0 120 1 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16599] ppid=16581 vsize=15762816 CPUtime=0.95 cores=1,3,5,7
/proc/16583/task/16599/stat : 16599 (java) S 16581 16583 16394 0 -1 4202560 6819 0 0 0 94 1 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16600] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16600/stat : 16600 (java) S 16581 16583 16394 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16601] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16601/stat : 16601 (java) S 16581 16583 16394 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16606] ppid=16581 vsize=15762816 CPUtime=1191.17 cores=1,3,5,7
/proc/16583/task/16606/stat : 16606 (java) R 16581 16583 16394 0 -1 4202560 418158 0 0 0 119058 59 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505743080 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16583/tid=16607] ppid=16581 vsize=15762816 CPUtime=1191.28 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 419433 0 0 0 119064 64 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912506067058 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15762816 CPUtime=1191.89 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 427254 0 0 0 119129 60 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 18446744073699065981 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15762816 CPUtime=1191.86 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 421159 0 0 0 119129 57 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505829450 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 15762816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.1 s]
/proc/loadavg: 8.07 7.97 7.84 10/220 16689
/proc/meminfo: memFree=8288388/32950904 swapFree=67082284/67111528
[pid=16583] ppid=16581 vsize=15762816 CPUtime=4800.19 cores=1,3,5,7
/proc/16583/stat : 16583 (java) S 16581 16583 16394 0 -1 4202496 2872872 0 1 0 479462 557 0 0 25 0 22 0 530395493 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/16583/statm: 3940704 97952 2298 9 0 3931423 0
[pid=16583/tid=16584] ppid=16581 vsize=15762816 CPUtime=0.36 cores=1,3,5,7
/proc/16583/task/16584/stat : 16584 (java) S 16581 16583 16394 0 -1 4202560 6559 0 1 0 35 1 0 0 25 0 22 0 530395493 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16586] ppid=16581 vsize=15762816 CPUtime=3.59 cores=1,3,5,7
/proc/16583/task/16586/stat : 16586 (java) S 16581 16583 16394 0 -1 4202560 141330 0 0 0 332 27 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16587] ppid=16581 vsize=15762816 CPUtime=3.69 cores=1,3,5,7
/proc/16583/task/16587/stat : 16587 (java) S 16581 16583 16394 0 -1 4202560 147817 0 0 0 341 28 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16588] ppid=16581 vsize=15762816 CPUtime=3.53 cores=1,3,5,7
/proc/16583/task/16588/stat : 16588 (java) S 16581 16583 16394 0 -1 4202560 140405 0 0 0 325 28 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16589] ppid=16581 vsize=15762816 CPUtime=3.58 cores=1,3,5,7
/proc/16583/task/16589/stat : 16589 (java) S 16581 16583 16394 0 -1 4202560 140492 0 0 0 331 27 0 0 16 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16590] ppid=16581 vsize=15762816 CPUtime=3.56 cores=1,3,5,7
/proc/16583/task/16590/stat : 16590 (java) S 16581 16583 16394 0 -1 4202560 142717 0 0 0 329 27 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16591] ppid=16581 vsize=15762816 CPUtime=3.64 cores=1,3,5,7
/proc/16583/task/16591/stat : 16591 (java) S 16581 16583 16394 0 -1 4202560 148855 0 0 0 337 27 0 0 16 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16592] ppid=16581 vsize=15762816 CPUtime=3.7 cores=1,3,5,7
/proc/16583/task/16592/stat : 16592 (java) S 16581 16583 16394 0 -1 4202560 149389 0 0 0 345 25 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16593] ppid=16581 vsize=15762816 CPUtime=3.54 cores=1,3,5,7
/proc/16583/task/16593/stat : 16593 (java) S 16581 16583 16394 0 -1 4202560 142207 0 0 0 329 25 0 0 15 0 22 0 530395494 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16594] ppid=16581 vsize=15762816 CPUtime=2.48 cores=1,3,5,7
/proc/16583/task/16594/stat : 16594 (java) S 16581 16583 16394 0 -1 4202560 7685 0 0 0 156 92 0 0 16 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 0 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16595] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16595/stat : 16595 (java) S 16581 16583 16394 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16596] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16596/stat : 16596 (java) S 16581 16583 16394 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 530395495 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 7 0 0 0
[pid=16583/tid=16597] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16597/stat : 16597 (java) S 16581 16583 16394 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290703281 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16598] ppid=16581 vsize=15762816 CPUtime=1.21 cores=1,3,5,7
/proc/16583/task/16598/stat : 16598 (java) S 16581 16583 16394 0 -1 4202560 11141 0 0 0 120 1 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 5 0 0 0
[pid=16583/tid=16599] ppid=16581 vsize=15762816 CPUtime=0.95 cores=1,3,5,7
/proc/16583/task/16599/stat : 16599 (java) S 16581 16583 16394 0 -1 4202560 6819 0 0 0 94 1 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 3 0 0 0
[pid=16583/tid=16600] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16600/stat : 16600 (java) S 16581 16583 16394 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290695577 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16601] ppid=16581 vsize=15762816 CPUtime=0 cores=1,3,5,7
/proc/16583/task/16601/stat : 16601 (java) S 16581 16583 16394 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 530395497 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 237290696192 0 4 0 16800975 18446604471125407040 0 0 -1 1 0 0 0
[pid=16583/tid=16606] ppid=16581 vsize=15762816 CPUtime=1191.17 cores=1,3,5,7
/proc/16583/task/16606/stat : 16606 (java) R 16581 16583 16394 0 -1 4202560 418158 0 0 0 119058 59 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505743080 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16583/tid=16607] ppid=16581 vsize=15762816 CPUtime=1191.28 cores=1,3,5,7
/proc/16583/task/16607/stat : 16607 (java) R 16581 16583 16394 0 -1 4202560 419433 0 0 0 119064 64 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912506067058 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16583/tid=16608] ppid=16581 vsize=15762816 CPUtime=1191.89 cores=1,3,5,7
/proc/16583/task/16608/stat : 16608 (java) R 16581 16583 16394 0 -1 4202560 427254 0 0 0 119129 60 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 18446744073699065981 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16583/tid=16609] ppid=16581 vsize=15762816 CPUtime=1191.86 cores=1,3,5,7
/proc/16583/task/16609/stat : 16609 (java) R 16581 16583 16394 0 -1 4202560 421159 0 0 0 119129 57 0 0 25 0 22 0 530395518 16141123584 97952 33554432000 1073741824 1073778376 140736476965664 18446744073709551615 46912505829450 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 15762816

Child status: 143
Real time (s): 1207.13
CPU time (s): 4800.25
CPU user time (s): 4794.65
CPU system time (s): 5.59715
CPU usage (%): 397.658
Max. virtual memory (cumulated for all children) (KiB): 15762816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.66
system time used= 5.59715
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2872897
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 225246
involuntary context switches= 135598

runsolver used 1.88871 second user time and 4.75628 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-30 20:25:57
IDJOB=3313016
IDBENCH=87732
IDSOLVER=1699
FILE ID=node121/3313016-1304187957
RUNJOBID= node121-1304186748-16413
PBS_JOBID= 13172492
Free space on /tmp= 73560 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT02/handmade/simon/satex-challenges/f600.shuffled.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313016-1304187957/watcher-3313016-1304187957 -o /tmp/evaluation-result-3313016-1304187957/solver-3313016-1304187957 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313016-1304187957.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d42133fd7674f41611be43d1b8ca7db6
RANDOM SEED=1842220846

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20819700 kB
Buffers:       2189284 kB
Cached:        9378788 kB
SwapCached:       2776 kB
Active:        8624500 kB
Inactive:      2996560 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20819700 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:            3176 kB
Writeback:           0 kB
AnonPages:       50672 kB
Mapped:          22264 kB
Slab:           446180 kB
PageTables:       4664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   779964 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73456 MiB
End job on node121 at 2011-04-30 20:46:07