Trace number 3311201

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.75 1206.84

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S655589261-059-UNKNOWN.cnf
MD5SUM7ca36bcba61bdf9cc15c9739d715b3da
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.10/0.12	52:55 INFO : Reading from input HOME/instance-3311201-1304113974.cnf
0.61/0.45	Executor set job limit to 1000000
0.61/0.45	Executor set job limit to 1000000
0.61/0.45	Executor set job limit to 1000000
0.61/0.45	Executor set job limit to 1000000
0.61/0.45	Starting Executor!
0.61/0.45	Starting Executor!
0.61/0.45	Starting Executor!
0.61/0.45	Starting Executor!
1.81/0.93	52:55 INFO : 250 variables remaining out of 250
1.81/0.93	52:55 INFO : 170000 literals remaining out of 170000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311201-1304113974/watcher-3311201-1304113974 -o /tmp/evaluation-result-3311201-1304113974/solver-3311201-1304113974 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311201-1304113974.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.00 7.89 7.94 2/174 5612
/proc/meminfo: memFree=31065000/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/5612/stat : 5612 (java) R 5610 5612 4889 0 -1 4202496 981 0 0 0 0 0 0 0 24 0 1 0 255588707 23580672 467 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268655699733 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/5612/statm: 5757 481 369 9 0 124 0

[startup+0.054583 s]
/proc/loadavg: 7.00 7.89 7.94 2/174 5612
/proc/meminfo: memFree=31065000/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15675180 CPUtime=0.03 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 4056 0 1 0 3 0 0 0 24 0 18 0 255588707 16051384320 3494 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3918795 3494 1753 9 0 3909514 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15675180

[startup+0.100588 s]
/proc/loadavg: 7.00 7.89 7.94 2/174 5612
/proc/meminfo: memFree=31065000/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15676580 CPUtime=0.1 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 5582 0 1 0 9 1 0 0 24 0 18 0 255588707 16052817920 4990 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3919145 4990 2117 9 0 3909864 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676580

[startup+0.300571 s]
/proc/loadavg: 7.00 7.89 7.94 2/174 5612
/proc/meminfo: memFree=31065000/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15683008 CPUtime=0.51 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 15283 0 1 0 49 2 0 0 24 0 18 0 255588707 16059400192 13371 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3920752 13378 2207 9 0 3911471 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15683008

[startup+0.704471 s]
/proc/loadavg: 7.00 7.89 7.94 2/174 5612
/proc/meminfo: memFree=31065000/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15766888 CPUtime=1.22 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 46822 0 1 0 116 6 0 0 24 0 22 0 255588707 16145293312 42691 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3941722 42691 2248 9 0 3932441 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 15766888

[startup+1.5146 s]
/proc/loadavg: 7.00 7.89 7.94 4/220 5661
/proc/meminfo: memFree=30711616/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15770848 CPUtime=3.41 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 53333 0 1 0 334 7 0 0 24 0 22 0 255588707 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3942712 46963 2274 9 0 3933431 0
[pid=5612/tid=5614] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 22 0 255588707 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 3 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) S 5610 5612 4889 0 -1 4202560 23 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 323 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) S 5610 5612 4889 0 -1 4202560 45 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 18 0 0 0 0 0 0 0 21 0 22 0 255588708 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) S 5610 5612 4889 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 0 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5626] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5626/stat : 5626 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672485809 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15770848 CPUtime=0.76 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10570 0 0 0 74 2 0 0 15 0 22 0 255588712 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5628] ppid=5610 vsize=15770848 CPUtime=0.53 cores=0,2,4,6
/proc/5612/task/5628/stat : 5628 (java) S 5610 5612 4889 0 -1 4202560 5526 0 0 0 52 1 0 0 15 0 22 0 255588712 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5629] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5629/stat : 5629 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5630] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5630/stat : 5630 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 255588712 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15770848 CPUtime=0.25 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) R 5610 5612 4889 0 -1 4202560 40 0 0 0 25 0 0 0 16 0 22 0 255588752 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15770848 CPUtime=0.38 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) S 5610 5612 4889 0 -1 4202560 402 0 0 0 38 0 0 0 16 0 22 0 255588752 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15770848 CPUtime=0.32 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) S 5610 5612 4889 0 -1 4202560 359 0 0 0 32 0 0 0 16 0 22 0 255588752 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15770848 CPUtime=0.21 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) S 5610 5612 4889 0 -1 4202560 466 0 0 0 21 0 0 0 16 0 22 0 255588752 16149348352 46963 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.41
Current children cumulated vsize (KiB) 15770848

[startup+3.10099 s]
/proc/loadavg: 7.00 7.89 7.94 7/220 5661
/proc/meminfo: memFree=30648132/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15770848 CPUtime=9.74 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 107692 0 1 0 958 16 0 0 24 0 22 0 255588707 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3942712 101017 2274 9 0 3933431 0
[pid=5612/tid=5614] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 22 0 255588707 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15770848 CPUtime=0.01 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 5237 0 0 0 1 0 0 0 16 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) S 5610 5612 4889 0 -1 4202560 3564 0 0 0 0 0 0 0 15 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 2796 0 0 0 0 0 0 0 15 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 1807 0 0 0 0 0 0 0 15 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15770848 CPUtime=0.01 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) S 5610 5612 4889 0 -1 4202560 5314 0 0 0 1 0 0 0 16 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 1959 0 0 0 0 0 0 0 15 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) S 5610 5612 4889 0 -1 4202560 4555 0 0 0 0 0 0 0 16 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15770848 CPUtime=0.02 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 6715 0 0 0 1 1 0 0 16 0 22 0 255588708 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) S 5610 5612 4889 0 -1 4202560 235 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 0 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5626] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5626/stat : 5626 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672485809 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15770848 CPUtime=0.79 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10571 0 0 0 77 2 0 0 15 0 22 0 255588712 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5628] ppid=5610 vsize=15770848 CPUtime=0.61 cores=0,2,4,6
/proc/5612/task/5628/stat : 5628 (java) S 5610 5612 4889 0 -1 4202560 5734 0 0 0 60 1 0 0 15 0 22 0 255588712 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5629] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5629/stat : 5629 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5630] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5630/stat : 5630 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 255588712 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15770848 CPUtime=1.71 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) R 5610 5612 4889 0 -1 4202560 4884 0 0 0 171 0 0 0 17 0 22 0 255588752 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505796020 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15770848 CPUtime=1.89 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) R 5610 5612 4889 0 -1 4202560 6232 0 0 0 189 0 0 0 17 0 22 0 255588752 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912506029098 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15770848 CPUtime=1.87 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) R 5610 5612 4889 0 -1 4202560 6445 0 0 0 187 0 0 0 17 0 22 0 255588752 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505765279 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15770848 CPUtime=1.76 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) R 5610 5612 4889 0 -1 4202560 6098 0 0 0 176 0 0 0 17 0 22 0 255588752 16149348352 101017 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505803573 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.74
Current children cumulated vsize (KiB) 15770848

[startup+6.30142 s]
/proc/loadavg: 7.16 7.91 7.95 10/220 5661
/proc/meminfo: memFree=29287712/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15770848 CPUtime=22.5 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 250308 0 1 0 2215 35 0 0 24 0 22 0 255588707 16149348352 242649 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3942712 242658 2284 9 0 3933431 0
[pid=5612/tid=5614] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 22 0 255588707 16149348352 242662 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15770848 CPUtime=0.04 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 11948 0 0 0 2 2 0 0 16 0 22 0 255588708 16149348352 242666 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15770848 CPUtime=0.01 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) S 5610 5612 4889 0 -1 4202560 6093 0 0 0 0 1 0 0 15 0 22 0 255588708 16149348352 242674 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15770848 CPUtime=0.03 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 9950 0 0 0 2 1 0 0 15 0 22 0 255588708 16149348352 242676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15770848 CPUtime=0.02 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 8856 0 0 0 1 1 0 0 16 0 22 0 255588708 16149348352 242679 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15770848 CPUtime=0.04 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) S 5610 5612 4889 0 -1 4202560 13813 0 0 0 2 2 0 0 16 0 22 0 255588708 16149348352 242691 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 1959 0 0 0 0 0 0 0 15 0 22 0 255588708 16149348352 242692 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15770848 CPUtime=0.02 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) S 5610 5612 4889 0 -1 4202560 6725 0 0 0 1 1 0 0 15 0 22 0 255588708 16149348352 242693 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15770848 CPUtime=0.06 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 18606 0 0 0 3 3 0 0 16 0 22 0 255588708 16149348352 242694 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) S 5610 5612 4889 0 -1 4202560 510 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 242700 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 0 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16149348352 242702 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 242709 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5626] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5626/stat : 5626 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 242726 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672485809 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10600 0 0 0 89 2 0 0 16 0 22 0 255588712 16149348352 242728 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=5612/tid=5630] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5630/stat : 5630 (java) S 5610 5612 4889 0 -1 4202560 64 0 0 0 0 0 0 0 15 0 22 0 255588712 16149348352 109634 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15770848 CPUtime=1107.71 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) R 5610 5612 4889 0 -1 4202560 208294 0 0 0 110740 31 0 0 22 0 22 0 255588752 16149348352 109634 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 18446744073699065971 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15770848 CPUtime=1108.23 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) R 5610 5612 4889 0 -1 4202560 211790 0 0 0 110793 30 0 0 25 0 22 0 255588752 16149348352 109634 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505803709 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15770848 CPUtime=1108.46 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) R 5610 5612 4889 0 -1 4202560 217211 0 0 0 110811 35 0 0 25 0 22 0 255588752 16149348352 109634 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912506134915 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15770848 CPUtime=1108.26 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) R 5610 5612 4889 0 -1 4202560 219382 0 0 0 110792 34 0 0 25 0 22 0 255588752 16149348352 109634 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505739419 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4464.42
Current children cumulated vsize (KiB) 15770848

[startup+1182.3 s]
/proc/loadavg: 8.05 8.06 8.01 9/220 5705
/proc/meminfo: memFree=18295736/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15770848 CPUtime=4703.18 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 1711101 0 1 0 469941 377 0 0 24 0 22 0 255588707 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3942712 116676 2299 9 0 3933431 0
[pid=5612/tid=5614] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 22 0 255588707 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15770848 CPUtime=3.55 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 99588 0 0 0 333 22 0 0 15 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15770848 CPUtime=3.47 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) S 5610 5612 4889 0 -1 4202560 91760 0 0 0 327 20 0 0 15 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15770848 CPUtime=3.65 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 93090 0 0 0 344 21 0 0 15 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15770848 CPUtime=3.51 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 87213 0 0 0 332 19 0 0 15 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15770848 CPUtime=3.64 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) S 5610 5612 4889 0 -1 4202560 98137 0 0 0 342 22 0 0 16 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15770848 CPUtime=3.58 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 87146 0 0 0 340 18 0 0 16 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15770848 CPUtime=3.63 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) S 5610 5612 4889 0 -1 4202560 91009 0 0 0 342 21 0 0 16 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15770848 CPUtime=3.59 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 101191 0 0 0 335 24 0 0 15 0 22 0 255588708 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15770848 CPUtime=1.75 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) S 5610 5612 4889 0 -1 4202560 4504 0 0 0 118 57 0 0 16 0 22 0 255588709 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 0 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5626] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5626/stat : 5626 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672485809 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15770848 CPUtime=1.03 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10610 0 0 0 101 2 0 0 15 0 22 0 255588712 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5628] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5628/stat : 5628 (java) S 5610 5612 4889 0 -1 4202560 6734 0 0 0 90 1 0 0 15 0 22 0 255588712 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5629] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5629/stat : 5629 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5630] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5630/stat : 5630 (java) S 5610 5612 4889 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 255588712 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15770848 CPUtime=1167.07 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) R 5610 5612 4889 0 -1 4202560 220031 0 0 0 116674 33 0 0 25 0 22 0 255588752 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912506054697 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15770848 CPUtime=1167.6 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) R 5610 5612 4889 0 -1 4202560 224372 0 0 0 116727 33 0 0 25 0 22 0 255588752 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912506175424 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15770848 CPUtime=1167.75 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) R 5610 5612 4889 0 -1 4202560 229075 0 0 0 116738 37 0 0 25 0 22 0 255588752 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505578235 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15770848 CPUtime=1167.39 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) R 5610 5612 4889 0 -1 4202560 231028 0 0 0 116703 36 0 0 25 0 22 0 255588752 16149348352 116676 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 46912505803727 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4703.18
Current children cumulated vsize (KiB) 15770848



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.71 s]
/proc/loadavg: 8.10 8.07 8.01 5/197 5708
/proc/meminfo: memFree=30570532/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15770848 CPUtime=4800.32 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 1751540 0 1 0 479646 386 0 0 24 0 22 0 255588707 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3942712 123651 2299 9 0 3933431 0
[pid=5612/tid=5614] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 22 0 255588707 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15770848 CPUtime=3.62 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 101730 0 0 0 340 22 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15770848 CPUtime=3.54 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) R 5610 5612 4889 0 -1 4202560 93599 0 0 0 334 20 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672479174 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15770848 CPUtime=3.74 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 96418 0 0 0 352 22 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15770848 CPUtime=3.59 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 89270 0 0 0 339 20 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15770848 CPUtime=3.7 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) R 5610 5612 4889 0 -1 4202560 100013 0 0 0 348 22 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672479174 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15770848 CPUtime=3.66 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 89067 0 0 0 347 19 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15770848 CPUtime=3.71 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) R 5610 5612 4889 0 -1 4202560 93180 0 0 0 350 21 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15770848 CPUtime=3.67 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 103524 0 0 0 343 24 0 0 15 0 22 0 255588708 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15770848 CPUtime=1.8 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) S 5610 5612 4889 0 -1 4202560 4599 0 0 0 121 59 0 0 16 0 22 0 255588709 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 0 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5626] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5626/stat : 5626 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672485809 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15770848 CPUtime=1.03 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10610 0 0 0 101 2 0 0 15 0 22 0 255588712 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5628] ppid=5610 vsize=15770848 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5628/stat : 5628 (java) S 5610 5612 4889 0 -1 4202560 6734 0 0 0 90 1 0 0 15 0 22 0 255588712 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5629] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5629/stat : 5629 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5630] ppid=5610 vsize=15770848 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5630/stat : 5630 (java) S 5610 5612 4889 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 255588712 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478720 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15770848 CPUtime=1191.18 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) S 5610 5612 4889 0 -1 4202560 225473 0 0 0 119084 34 0 0 25 0 22 0 255588752 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15770848 CPUtime=1191.72 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) S 5610 5612 4889 0 -1 4202560 229905 0 0 0 119138 34 0 0 25 0 22 0 255588752 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15770848 CPUtime=1191.91 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) S 5610 5612 4889 0 -1 4202560 235000 0 0 0 119153 38 0 0 25 0 22 0 255588752 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15770848 CPUtime=1191.48 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) S 5610 5612 4889 0 -1 4202560 236803 0 0 0 119111 37 0 0 25 0 22 0 255588752 16149348352 123651 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 15770848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.81 s]
/proc/loadavg: 8.10 8.07 8.01 5/197 5708
/proc/meminfo: memFree=30570532/32951124 swapFree=67111524/67111528
[pid=5612] ppid=5610 vsize=15772904 CPUtime=4800.72 cores=0,2,4,6
/proc/5612/stat : 5612 (java) S 5610 5612 4889 0 -1 4202496 1751587 0 1 0 479686 386 0 0 18 0 24 0 255588707 16151453696 123698 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5612/statm: 3943226 123704 2299 9 0 3933945 0
[pid=5612/tid=5614] ppid=5610 vsize=15772904 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5614/stat : 5614 (java) S 5610 5612 4889 0 -1 4202560 34153 0 1 0 88 3 0 0 20 0 24 0 255588707 16151453696 123704 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5615] ppid=5610 vsize=15772904 CPUtime=3.62 cores=0,2,4,6
/proc/5612/task/5615/stat : 5615 (java) S 5610 5612 4889 0 -1 4202560 101730 0 0 0 340 22 0 0 15 0 24 0 255588708 16151453696 123704 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5616] ppid=5610 vsize=15772904 CPUtime=3.55 cores=0,2,4,6
/proc/5612/task/5616/stat : 5616 (java) S 5610 5612 4889 0 -1 4202560 93610 0 0 0 335 20 0 0 16 0 24 0 255588708 16151453696 123704 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5617] ppid=5610 vsize=15772904 CPUtime=3.74 cores=0,2,4,6
/proc/5612/task/5617/stat : 5617 (java) S 5610 5612 4889 0 -1 4202560 96418 0 0 0 352 22 0 0 15 0 24 0 255588708 16151453696 123704 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5618] ppid=5610 vsize=15772904 CPUtime=3.59 cores=0,2,4,6
/proc/5612/task/5618/stat : 5618 (java) S 5610 5612 4889 0 -1 4202560 89270 0 0 0 339 20 0 0 15 0 24 0 255588708 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5619] ppid=5610 vsize=15772904 CPUtime=3.7 cores=0,2,4,6
/proc/5612/task/5619/stat : 5619 (java) S 5610 5612 4889 0 -1 4202560 100018 0 0 0 348 22 0 0 16 0 22 0 255588708 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5620] ppid=5610 vsize=15772904 CPUtime=3.66 cores=0,2,4,6
/proc/5612/task/5620/stat : 5620 (java) S 5610 5612 4889 0 -1 4202560 89075 0 0 0 347 19 0 0 15 0 22 0 255588708 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5621] ppid=5610 vsize=15772904 CPUtime=3.71 cores=0,2,4,6
/proc/5612/task/5621/stat : 5621 (java) S 5610 5612 4889 0 -1 4202560 93180 0 0 0 350 21 0 0 15 0 22 0 255588708 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5622] ppid=5610 vsize=15772904 CPUtime=3.67 cores=0,2,4,6
/proc/5612/task/5622/stat : 5622 (java) S 5610 5612 4889 0 -1 4202560 103528 0 0 0 343 24 0 0 15 0 22 0 255588708 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5623] ppid=5610 vsize=15772904 CPUtime=1.8 cores=0,2,4,6
/proc/5612/task/5623/stat : 5623 (java) R 5610 5612 4889 0 -1 4202560 4599 0 0 0 121 59 0 0 15 0 22 0 255588709 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268660705463 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=5612/tid=5624] ppid=5610 vsize=15772904 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5624/stat : 5624 (java) S 5610 5612 4889 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 22 0 255588709 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5625] ppid=5610 vsize=15772904 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5625/stat : 5625 (java) S 5610 5612 4889 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 255588709 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5627] ppid=5610 vsize=15772904 CPUtime=1.03 cores=0,2,4,6
/proc/5612/task/5627/stat : 5627 (java) S 5610 5612 4889 0 -1 4202560 10610 0 0 0 101 2 0 0 15 0 22 0 255588712 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5628] ppid=5610 vsize=15772904 CPUtime=0.91 cores=0,2,4,6
/proc/5612/task/5628/stat : 5628 (java) S 5610 5612 4889 0 -1 4202560 6734 0 0 0 90 1 0 0 15 0 22 0 255588712 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 6 0 0 0
[pid=5612/tid=5629] ppid=5610 vsize=15772904 CPUtime=0 cores=0,2,4,6
/proc/5612/task/5629/stat : 5629 (java) S 5610 5612 4889 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 255588712 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5654] ppid=5610 vsize=15772904 CPUtime=1191.28 cores=0,2,4,6
/proc/5612/task/5654/stat : 5654 (java) S 5610 5612 4889 0 -1 4202560 225473 0 0 0 119094 34 0 0 25 0 22 0 255588752 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 2 0 0 0
[pid=5612/tid=5655] ppid=5610 vsize=15772904 CPUtime=1191.81 cores=0,2,4,6
/proc/5612/task/5655/stat : 5655 (java) S 5610 5612 4889 0 -1 4202560 229905 0 0 0 119147 34 0 0 25 0 22 0 255588752 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 4 0 0 0
[pid=5612/tid=5656] ppid=5610 vsize=15772904 CPUtime=1192 cores=0,2,4,6
/proc/5612/task/5656/stat : 5656 (java) S 5610 5612 4889 0 -1 4202560 235000 0 0 0 119162 38 0 0 25 0 22 0 255588752 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 268672478105 0 4 0 16800975 18446604445180619840 0 0 -1 0 0 0 0
[pid=5612/tid=5657] ppid=5610 vsize=15772904 CPUtime=1191.58 cores=0,2,4,6
/proc/5612/task/5657/stat : 5657 (java) R 5610 5612 4889 0 -1 4202560 236803 0 0 0 119121 37 0 0 25 0 22 0 255588752 16151453696 123705 33554432000 1073741824 1073778376 140735234400672 18446744073709551615 18446744073699065964 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.72
Current children cumulated vsize (KiB) 15772904

Child status: 143
Real time (s): 1206.84
CPU time (s): 4800.75
CPU user time (s): 4796.86
CPU system time (s): 3.89041
CPU usage (%): 397.796
Max. virtual memory (cumulated for all children) (KiB): 15773456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.86
system time used= 3.89041
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1751595
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 200329
involuntary context switches= 129348

runsolver used 2.08968 second user time and 4.55231 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-29 23:52:54
IDJOB=3311201
IDBENCH=82586
IDSOLVER=1698
FILE ID=node107/3311201-1304113974
RUNJOBID= node107-1304113974-5598
PBS_JOBID= 13170667
Free space on /tmp= 71800 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S655589261-059-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311201-1304113974/watcher-3311201-1304113974 -o /tmp/evaluation-result-3311201-1304113974/solver-3311201-1304113974 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311201-1304113974.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7ca36bcba61bdf9cc15c9739d715b3da
RANDOM SEED=1778037504

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31065156 kB
Buffers:        345808 kB
Cached:        1126100 kB
SwapCached:          4 kB
Active:          90748 kB
Inactive:      1447672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31065156 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            2888 kB
Writeback:           0 kB
AnonPages:       66032 kB
Mapped:          14488 kB
Slab:           284672 kB
PageTables:       4320 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71800 MiB
End job on node107 at 2011-04-30 00:13:03