Trace number 3312354

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.26 1202.9

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v2500-c10500-S1300417189-038-UNKNOWN.cnf
MD5SUM0ed8ade65938c7fcf06ab054c90e3de3
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.200968
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of clauses10500
Sum of the clauses size31500
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 310500
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	17:26 INFO : Reading from input HOME/instance-3312354-1304111846.cnf
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
1.30/0.68	17:27 INFO : 2489 variables remaining out of 2500
1.30/0.68	17:27 INFO : 41704 literals remaining out of 42000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312354-1304111846/watcher-3312354-1304111846 -o /tmp/evaluation-result-3312354-1304111846/solver-3312354-1304111846 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312354-1304111846.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.09 8.06 4/198 19774
/proc/meminfo: memFree=30509536/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=22976 CPUtime=0 cores=0,2,4,6
/proc/19774/stat : 19774 (java) R 19772 19774 19242 0 -1 4202496 1353 0 0 0 0 0 0 0 25 0 1 0 522784381 23527424 832 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248089155920 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19774/statm: 6001 837 637 9 0 381 0
[pid=19774/tid=19775] ppid=19772 vsize=24004 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) R 19772 19774 19242 0 -1 4202560 12 0 0 0 0 0 0 0 25 0 2 0 522784381 24580096 850 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248089698048 0 0 4096 0 0 0 0 -1 2 0 0 0

[startup+0.0707739 s]
/proc/loadavg: 8.10 8.09 8.06 4/198 19774
/proc/meminfo: memFree=30509536/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15675316 CPUtime=0.05 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 4425 0 1 0 5 0 0 0 25 0 18 0 522784381 16051523584 3864 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3918829 3864 1779 9 0 3909548 0
[pid=19774/tid=19775] ppid=19772 vsize=15675316 CPUtime=0.05 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) R 19772 19774 19242 0 -1 4202560 3006 0 1 0 5 0 0 0 19 0 18 0 522784381 16051523584 3864 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505219208 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15675316

[startup+0.100694 s]
/proc/loadavg: 8.10 8.09 8.06 4/198 19774
/proc/meminfo: memFree=30509536/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15676876 CPUtime=0.1 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 5573 0 1 0 9 1 0 0 25 0 18 0 522784381 16053121024 4980 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3919219 4980 2116 9 0 3909938 0
[pid=19774/tid=19775] ppid=19772 vsize=15676876 CPUtime=0.09 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) R 19772 19774 19242 0 -1 4202560 3435 0 1 0 8 1 0 0 18 0 18 0 522784381 16053121024 4980 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 47915949264376 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676876

[startup+0.300688 s]
/proc/loadavg: 8.10 8.09 8.06 4/198 19774
/proc/meminfo: memFree=30509536/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15682416 CPUtime=0.51 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 15792 0 1 0 49 2 0 0 25 0 18 0 522784381 16058793984 14024 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3920604 14029 2206 9 0 3911323 0
[pid=19774/tid=19775] ppid=19772 vsize=15682416 CPUtime=0.28 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) R 19772 19774 19242 0 -1 4202560 10714 0 1 0 27 1 0 0 18 0 18 0 522784381 16058793984 14032 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505641521 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15682416

[startup+0.700648 s]
/proc/loadavg: 8.10 8.09 8.06 4/198 19774
/proc/meminfo: memFree=30509536/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15703348 CPUtime=1.58 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 29852 0 1 0 154 4 0 0 25 0 22 0 522784381 16080228352 25635 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3925837 25635 2254 9 0 3916556 0
[pid=19774/tid=19775] ppid=19772 vsize=15703348 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16080228352 25635 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.58
Current children cumulated vsize (KiB) 15703348

[startup+1.50145 s]
/proc/loadavg: 8.10 8.09 8.06 12/220 19796
/proc/meminfo: memFree=30274824/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=4.49 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 68264 0 1 0 440 9 0 0 25 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 60707 2273 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 1619 0 0 0 0 0 0 0 16 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 1864 0 0 0 0 0 0 0 16 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 953 0 0 0 0 0 0 0 16 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 722 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 218 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 935 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 1064 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19785] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19785/stat : 19785 (java) S 19772 19774 19242 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 522784382 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 0 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19786] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19786/stat : 19786 (java) R 19772 19774 19242 0 -1 4202560 16 0 0 0 0 0 0 0 17 0 22 0 522784383 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19774/tid=19787] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19787/stat : 19787 (java) S 19772 19774 19242 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 22 0 522784383 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19788] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19788/stat : 19788 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101521841 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19789] ppid=19772 vsize=15715732 CPUtime=0.97 cores=0,2,4,6
/proc/19774/task/19789/stat : 19789 (java) R 19772 19774 19242 0 -1 4202560 16693 0 0 0 95 2 0 0 18 0 22 0 522784385 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 47915949216467 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19790] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19790/stat : 19790 (java) R 19772 19774 19242 0 -1 4202560 7011 0 0 0 67 0 0 0 25 0 22 0 522784385 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101524149 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19791] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19791/stat : 19791 (java) S 19772 19774 19242 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19792] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19792/stat : 19792 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522784385 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19793] ppid=19772 vsize=15715732 CPUtime=0.39 cores=0,2,4,6
/proc/19774/task/19793/stat : 19793 (java) R 19772 19774 19242 0 -1 4202560 359 0 0 0 39 0 0 0 16 0 22 0 522784412 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505182944 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=0.53 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 6542 0 0 0 53 0 0 0 16 0 22 0 522784412 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 18446744073699066094 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=0.63 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 9679 0 0 0 62 1 0 0 17 0 22 0 522784412 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505870677 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=0.52 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 5801 0 0 0 52 0 0 0 16 0 22 0 522784412 16092909568 60707 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505870579 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.49
Current children cumulated vsize (KiB) 15715732

[startup+3.10117 s]
/proc/loadavg: 8.42 8.16 8.08 11/220 19796
/proc/meminfo: memFree=29969412/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=10.88 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 164354 0 1 0 1065 23 0 0 25 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 156706 2279 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=0.01 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 6809 0 0 0 1 0 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 1864 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 2276 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=0.02 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 7114 0 0 0 1 1 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 722 0 0 0 0 0 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=0.02 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 8263 0 0 0 1 1 0 0 16 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=0.03 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 6972 0 0 0 2 1 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=0.03 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 8700 0 0 0 2 1 0 0 15 0 22 0 522784381 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19785] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19785/stat : 19785 (java) S 19772 19774 19242 0 -1 4202560 236 0 0 0 0 0 0 0 15 0 22 0 522784382 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 0 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19786] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19786/stat : 19786 (java) S 19772 19774 19242 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 22 0 522784383 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19787] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19787/stat : 19787 (java) S 19772 19774 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522784383 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19788] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19788/stat : 19788 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101521841 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19789] ppid=19772 vsize=15715732 CPUtime=1.26 cores=0,2,4,6
/proc/19774/task/19789/stat : 19789 (java) S 19772 19774 19242 0 -1 4202560 16773 0 0 0 124 2 0 0 15 0 22 0 522784385 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19790] ppid=19772 vsize=15715732 CPUtime=0.69 cores=0,2,4,6
/proc/19774/task/19790/stat : 19790 (java) R 19772 19774 19242 0 -1 4202560 7012 0 0 0 69 0 0 0 25 0 22 0 522784385 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 47915948105894 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19791] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19791/stat : 19791 (java) S 19772 19774 19242 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19792] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19792/stat : 19792 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522784385 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19793] ppid=19772 vsize=15715732 CPUtime=1.93 cores=0,2,4,6
/proc/19774/task/19793/stat : 19793 (java) R 19772 19774 19242 0 -1 4202560 16015 0 0 0 192 1 0 0 17 0 22 0 522784412 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505827045 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=1.97 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 21783 0 0 0 194 3 0 0 16 0 22 0 522784412 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505602600 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=2.02 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 25046 0 0 0 199 3 0 0 18 0 22 0 522784412 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505776345 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=2.09 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 20037 0 0 0 207 2 0 0 17 0 22 0 522784412 16092909568 156706 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505940175 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.88
Current children cumulated vsize (KiB) 15715732

[startup+6.3016 s]
/proc/loadavg: 8.42 8.16 8.08 9/220 19796
/proc/meminfo: memFree=28682188/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=23.65 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 335625 0 1 0 2318 47 0 0 25 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 327728 2279 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=0.03 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 12406 0 0 0 2 1 0 0 16 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=0.04 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 13497 0 0 0 2 2 0 0 16 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=0.04 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 10928 0 0 0 3 1 0 0 16 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=0.04 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 12045 0 0 0 2 2 0 0 15 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=0.04 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 10926 0 0 0 2 2 0 0 16 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=0.06 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 18972 0 0 0 4 2 0 0 15 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=0.05 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 12688 0 0 0 3 2 0 0 15 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=0.05 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 12885 0 0 0 3 2 0 0 15 0 22 0 522784381 16092909568 327728 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=1056 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 239053 0 0 0 105571 29 0 0 25 0 22 0 522784412 16092909568 968416 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505583984 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=1056.74 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 246343 0 0 0 105645 29 0 0 25 0 22 0 522784412 16092909568 968416 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505749019 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=1056.44 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 232611 0 0 0 105618 26 0 0 25 0 22 0 522784412 16092909568 968416 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912506289452 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4239.48
Current children cumulated vsize (KiB) 15715732

[startup+1122.3 s]
/proc/loadavg: 8.15 8.14 8.10 9/220 19826
/proc/meminfo: memFree=25811308/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=4478.91 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 2123003 0 1 0 447565 326 0 0 25 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 796871 2299 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=1.37 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 130227 0 0 0 116 21 0 0 16 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=1.31 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 132452 0 0 0 110 21 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=1.49 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 153059 0 0 0 126 23 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=1.27 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 119621 0 0 0 105 22 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=1.45 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 145430 0 0 0 121 24 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=1.48 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 166539 0 0 0 122 26 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=1.36 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 140294 0 0 0 113 23 0 0 15 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=1.51 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 132204 0 0 0 132 19 0 0 16 0 22 0 522784381 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19785] ppid=19772 vsize=15715732 CPUtime=0.51 cores=0,2,4,6
/proc/19774/task/19785/stat : 19785 (java) S 19772 19774 19242 0 -1 4202560 4501 0 0 0 29 22 0 0 15 0 22 0 522784382 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 0 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19786] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19786/stat : 19786 (java) S 19772 19774 19242 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 22 0 522784383 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19787] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19787/stat : 19787 (java) S 19772 19774 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522784383 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19788] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19788/stat : 19788 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101521841 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19789] ppid=19772 vsize=15715732 CPUtime=1.38 cores=0,2,4,6
/proc/19774/task/19789/stat : 19789 (java) S 19772 19774 19242 0 -1 4202560 16793 0 0 0 136 2 0 0 15 0 22 0 522784385 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19790] ppid=19772 vsize=15715732 CPUtime=1.01 cores=0,2,4,6
/proc/19774/task/19790/stat : 19790 (java) S 19772 19774 19242 0 -1 4202560 7063 0 0 0 101 0 0 0 16 0 22 0 522784385 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19791] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19791/stat : 19791 (java) S 19772 19774 19242 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19792] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19792/stat : 19792 (java) S 19772 19774 19242 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 522784385 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19793] ppid=19772 vsize=15715732 CPUtime=1115.46 cores=0,2,4,6
/proc/19774/task/19793/stat : 19793 (java) R 19772 19774 19242 0 -1 4202560 242002 0 0 0 111518 28 0 0 25 0 22 0 522784412 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505749044 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=1115.76 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 239058 0 0 0 111547 29 0 0 25 0 22 0 522784412 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505717452 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=1116.5 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 246349 0 0 0 111621 29 0 0 25 0 22 0 522784412 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505584002 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=1116.2 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 232613 0 0 0 111594 26 0 0 25 0 22 0 522784412 16092909568 796871 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912506264024 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4478.91
Current children cumulated vsize (KiB) 15715732

[startup+1182.3 s]
/proc/loadavg: 8.06 8.11 8.09 9/220 19827
/proc/meminfo: memFree=26873932/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=4718.32 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 2123062 0 1 0 471502 330 0 0 25 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 549490 2299 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=1.51 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 130229 0 0 0 129 22 0 0 16 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=1.43 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 132454 0 0 0 122 21 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=1.57 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 153060 0 0 0 134 23 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=1.37 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 119622 0 0 0 115 22 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=1.57 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 145432 0 0 0 133 24 0 0 16 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=1.63 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 166542 0 0 0 137 26 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=1.46 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 140296 0 0 0 123 23 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=1.62 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 132205 0 0 0 143 19 0 0 15 0 22 0 522784381 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19785] ppid=19772 vsize=15715732 CPUtime=0.56 cores=0,2,4,6
/proc/19774/task/19785/stat : 19785 (java) S 19772 19774 19242 0 -1 4202560 4504 0 0 0 30 26 0 0 16 0 22 0 522784382 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 0 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19786] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19786/stat : 19786 (java) S 19772 19774 19242 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 22 0 522784383 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19787] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19787/stat : 19787 (java) S 19772 19774 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522784383 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19788] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19788/stat : 19788 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101521841 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19789] ppid=19772 vsize=15715732 CPUtime=1.38 cores=0,2,4,6
/proc/19774/task/19789/stat : 19789 (java) S 19772 19774 19242 0 -1 4202560 16793 0 0 0 136 2 0 0 15 0 22 0 522784385 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19790] ppid=19772 vsize=15715732 CPUtime=1.01 cores=0,2,4,6
/proc/19774/task/19790/stat : 19790 (java) S 19772 19774 19242 0 -1 4202560 7063 0 0 0 101 0 0 0 16 0 22 0 522784385 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19791] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19791/stat : 19791 (java) S 19772 19774 19242 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19792] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19792/stat : 19792 (java) S 19772 19774 19242 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 522784385 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19793] ppid=19772 vsize=15715732 CPUtime=1174.84 cores=0,2,4,6
/proc/19774/task/19793/stat : 19793 (java) R 19772 19774 19242 0 -1 4202560 242016 0 0 0 117456 28 0 0 25 0 22 0 522784412 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505748984 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=1175.45 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 239062 0 0 0 117516 29 0 0 25 0 22 0 522784412 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505748349 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=1176.19 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 246359 0 0 0 117590 29 0 0 25 0 22 0 522784412 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505948458 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=1175.89 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 232625 0 0 0 117563 26 0 0 25 0 22 0 522784412 16092909568 549490 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912506314351 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4718.32
Current children cumulated vsize (KiB) 15715732



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.04 8.10 8.08 10/220 19828
/proc/meminfo: memFree=27167796/32950928 swapFree=67111428/67111528
[pid=19774] ppid=19772 vsize=15715732 CPUtime=4800.13 cores=0,2,4,6
/proc/19774/stat : 19774 (java) S 19772 19774 19242 0 -1 4202496 2123090 0 1 0 479681 332 0 0 25 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19774/statm: 3928933 497446 2299 9 0 3919652 0
[pid=19774/tid=19775] ppid=19772 vsize=15715732 CPUtime=0.67 cores=0,2,4,6
/proc/19774/task/19775/stat : 19775 (java) S 19772 19774 19242 0 -1 4202560 13343 0 1 0 65 2 0 0 20 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19777] ppid=19772 vsize=15715732 CPUtime=1.55 cores=0,2,4,6
/proc/19774/task/19777/stat : 19777 (java) S 19772 19774 19242 0 -1 4202560 130231 0 0 0 133 22 0 0 15 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19778] ppid=19772 vsize=15715732 CPUtime=1.48 cores=0,2,4,6
/proc/19774/task/19778/stat : 19778 (java) S 19772 19774 19242 0 -1 4202560 132454 0 0 0 127 21 0 0 16 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19779] ppid=19772 vsize=15715732 CPUtime=1.61 cores=0,2,4,6
/proc/19774/task/19779/stat : 19779 (java) S 19772 19774 19242 0 -1 4202560 153061 0 0 0 138 23 0 0 15 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19780] ppid=19772 vsize=15715732 CPUtime=1.43 cores=0,2,4,6
/proc/19774/task/19780/stat : 19780 (java) S 19772 19774 19242 0 -1 4202560 119624 0 0 0 121 22 0 0 15 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19781] ppid=19772 vsize=15715732 CPUtime=1.6 cores=0,2,4,6
/proc/19774/task/19781/stat : 19781 (java) S 19772 19774 19242 0 -1 4202560 145433 0 0 0 136 24 0 0 15 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19782] ppid=19772 vsize=15715732 CPUtime=1.67 cores=0,2,4,6
/proc/19774/task/19782/stat : 19782 (java) S 19772 19774 19242 0 -1 4202560 166543 0 0 0 141 26 0 0 16 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19783] ppid=19772 vsize=15715732 CPUtime=1.5 cores=0,2,4,6
/proc/19774/task/19783/stat : 19783 (java) S 19772 19774 19242 0 -1 4202560 140297 0 0 0 127 23 0 0 16 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19784] ppid=19772 vsize=15715732 CPUtime=1.66 cores=0,2,4,6
/proc/19774/task/19784/stat : 19784 (java) S 19772 19774 19242 0 -1 4202560 132206 0 0 0 147 19 0 0 16 0 22 0 522784381 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 6 0 0 0
[pid=19774/tid=19785] ppid=19772 vsize=15715732 CPUtime=0.58 cores=0,2,4,6
/proc/19774/task/19785/stat : 19785 (java) S 19772 19774 19242 0 -1 4202560 4506 0 0 0 31 27 0 0 15 0 22 0 522784382 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 0 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19786] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19786/stat : 19786 (java) S 19772 19774 19242 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 22 0 522784383 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19787] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19787/stat : 19787 (java) S 19772 19774 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522784383 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19788] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19788/stat : 19788 (java) S 19772 19774 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101521841 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19789] ppid=19772 vsize=15715732 CPUtime=1.38 cores=0,2,4,6
/proc/19774/task/19789/stat : 19789 (java) S 19772 19774 19242 0 -1 4202560 16793 0 0 0 136 2 0 0 15 0 22 0 522784385 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 2 0 0 0
[pid=19774/tid=19790] ppid=19772 vsize=15715732 CPUtime=1.01 cores=0,2,4,6
/proc/19774/task/19790/stat : 19790 (java) S 19772 19774 19242 0 -1 4202560 7063 0 0 0 101 0 0 0 16 0 22 0 522784385 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19791] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19791/stat : 19791 (java) S 19772 19774 19242 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 22 0 522784385 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514137 0 4 0 16800975 18446604453850651712 0 0 -1 0 0 0 0
[pid=19774/tid=19792] ppid=19772 vsize=15715732 CPUtime=0 cores=0,2,4,6
/proc/19774/task/19792/stat : 19792 (java) S 19772 19774 19242 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 522784385 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 248101514752 0 4 0 16800975 18446604453850651712 0 0 -1 4 0 0 0
[pid=19774/tid=19793] ppid=19772 vsize=15715732 CPUtime=1195.11 cores=0,2,4,6
/proc/19774/task/19793/stat : 19793 (java) R 19772 19774 19242 0 -1 4202560 242021 0 0 0 119483 28 0 0 25 0 22 0 522784412 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505749071 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19774/tid=19794] ppid=19772 vsize=15715732 CPUtime=1195.84 cores=0,2,4,6
/proc/19774/task/19794/stat : 19794 (java) R 19772 19774 19242 0 -1 4202560 239064 0 0 0 119555 29 0 0 25 0 22 0 522784412 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 18446744073699065949 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19774/tid=19795] ppid=19772 vsize=15715732 CPUtime=1196.59 cores=0,2,4,6
/proc/19774/task/19795/stat : 19795 (java) R 19772 19774 19242 0 -1 4202560 246365 0 0 0 119630 29 0 0 25 0 22 0 522784412 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505749005 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19774/tid=19796] ppid=19772 vsize=15715732 CPUtime=1196.29 cores=0,2,4,6
/proc/19774/task/19796/stat : 19796 (java) R 19772 19774 19242 0 -1 4202560 232627 0 0 0 119603 26 0 0 25 0 22 0 522784412 16092909568 497446 33554432000 1073741824 1073778376 140736713861408 18446744073709551615 46912505748956 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 15715732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1202.9
CPU time (s): 4800.26
CPU user time (s): 4796.85
CPU system time (s): 3.41148
CPU usage (%): 399.056
Max. virtual memory (cumulated for all children) (KiB): 15715732

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.85
system time used= 3.41148
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2123116
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39380
involuntary context switches= 68848

runsolver used 1.9557 second user time and 4.63129 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 23:17:26
IDJOB=3312354
IDBENCH=82539
IDSOLVER=1699
FILE ID=node123/3312354-1304111846
RUNJOBID= node123-1304110638-19587
PBS_JOBID= 13170665
Free space on /tmp= 72816 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v2500-c10500-S1300417189-038-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312354-1304111846/watcher-3312354-1304111846 -o /tmp/evaluation-result-3312354-1304111846/solver-3312354-1304111846 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312354-1304111846.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0ed8ade65938c7fcf06ab054c90e3de3
RANDOM SEED=1416977926

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30509816 kB
Buffers:        574780 kB
Cached:        1289716 kB
SwapCached:        100 kB
Active:         276296 kB
Inactive:      1802076 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30509816 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:            4344 kB
Writeback:           0 kB
AnonPages:      213368 kB
Mapped:          22452 kB
Slab:           298108 kB
PageTables:       4240 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   793164 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72812 MiB
End job on node123 at 2011-04-29 23:37:31