Trace number 3311914

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.18 1206.84

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/rnd_150_42_s.cnf
MD5SUM4177e06821060b0db9493e3e34514fae
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark8.28674
Satisfiable
(Un)Satisfiability was proved
Number of variables6384
Number of clauses23817
Sum of the clauses size59934
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 211517
Number of clauses of size 312300
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	12:47 INFO : Reading from input HOME/instance-3311914-1304183567.cnf
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
2.35/1.04	12:48 INFO : 5264 variables remaining out of 6384
2.35/1.04	12:48 INFO : 93288 literals remaining out of 83751

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311914-1304183567/watcher-3311914-1304183567 -o /tmp/evaluation-result-3311914-1304183567/solver-3311914-1304183567 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311914-1304183567.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.91 7.96 5/198 13692
/proc/meminfo: memFree=29613460/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/13692/stat : 13692 (java) R 13690 13692 13254 0 -1 4202496 927 0 0 0 0 0 0 0 25 0 1 0 608587365 23580672 415 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260900431637 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13692/statm: 5757 425 329 9 0 124 0

[startup+0.009593 s]
/proc/loadavg: 7.48 7.91 7.96 5/198 13692
/proc/meminfo: memFree=29613460/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=30536 CPUtime=0 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 1498 0 0 0 0 0 0 0 25 0 2 0 608587365 31268864 960 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16784584 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 7634 960 740 9 0 385 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 30536

[startup+0.100577 s]
/proc/loadavg: 7.48 7.91 7.96 5/198 13692
/proc/meminfo: memFree=29613460/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15742736 CPUtime=0.1 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 5563 0 1 0 9 1 0 0 25 0 18 0 608587365 16120561664 4980 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3935684 4981 2116 9 0 3926403 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15742736

[startup+0.300543 s]
/proc/loadavg: 7.48 7.91 7.96 5/198 13692
/proc/meminfo: memFree=29613460/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15745808 CPUtime=0.51 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 15237 0 1 0 49 2 0 0 25 0 18 0 608587365 16123707392 13762 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3936452 13767 2206 9 0 3927171 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15745808

[startup+0.700469 s]
/proc/loadavg: 7.48 7.91 7.96 5/198 13692
/proc/meminfo: memFree=29613460/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15761940 CPUtime=1.44 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 35704 0 1 0 139 5 0 0 25 0 22 0 608587365 16140226560 31706 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3940485 31706 2244 9 0 3931204 0
Current children cumulated CPU time (s) 1.44
Current children cumulated vsize (KiB) 15761940

[startup+1.50132 s]
/proc/loadavg: 7.48 7.91 7.96 8/220 13714
/proc/meminfo: memFree=29484024/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15770400 CPUtime=4.13 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 60746 0 1 0 405 8 0 0 25 0 22 0 608587365 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942600 48588 2274 9 0 3933319 0
[pid=13692/tid=13694] ppid=13690 vsize=15770400 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 3 0 0 0 0 0 0 0 17 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 397 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 3 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) R 13690 13692 13254 0 -1 4202560 500 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917220021 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 3 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 363 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 374 0 0 0 0 0 0 0 18 0 22 0 608587366 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 12 0 0 0 0 0 0 0 15 0 22 0 608587367 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15770400 CPUtime=0.98 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) R 13690 13692 13254 0 -1 4202560 5901 0 0 0 98 0 0 0 25 0 22 0 608587370 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 47412073701198 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13708] ppid=13690 vsize=15770400 CPUtime=1.2 cores=1,3,5,7
/proc/13692/task/13708/stat : 13708 (java) R 13690 13692 13254 0 -1 4202560 17986 0 0 0 118 2 0 0 25 0 22 0 608587370 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 47412069830752 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13692/tid=13709] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13709/stat : 13709 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13710] ppid=13690 vsize=15770400 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13710/stat : 13710 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608587370 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13711] ppid=13690 vsize=15770400 CPUtime=0.39 cores=1,3,5,7
/proc/13692/task/13711/stat : 13711 (java) R 13690 13692 13254 0 -1 4202560 5084 0 0 0 39 0 0 0 19 0 22 0 608587402 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505164128 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13712] ppid=13690 vsize=15770400 CPUtime=0.13 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 1973 0 0 0 13 0 0 0 16 0 22 0 608587402 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505811238 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15770400 CPUtime=0.24 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 2127 0 0 0 24 0 0 0 17 0 22 0 608587402 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505199175 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15770400 CPUtime=0.09 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 2044 0 0 0 9 0 0 0 16 0 22 0 608587402 16148889600 48588 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 47412075010913 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4.13
Current children cumulated vsize (KiB) 15770400

[startup+3.10103 s]
/proc/loadavg: 7.48 7.91 7.96 11/220 13714
/proc/meminfo: memFree=29409508/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15771424 CPUtime=10.51 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 112597 0 1 0 1037 14 0 0 25 0 22 0 608587365 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942856 100340 2274 9 0 3933575 0
[pid=13692/tid=13694] ppid=13690 vsize=15771424 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 4515 0 0 0 1 0 0 0 16 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 4709 0 0 0 0 0 0 0 16 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 4152 0 0 0 0 0 0 0 16 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 2661 0 0 0 0 0 0 0 15 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) S 13690 13692 13254 0 -1 4202560 2775 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 4076 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 364 0 0 0 0 0 0 0 15 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 6047 0 0 0 1 0 0 0 16 0 22 0 608587366 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 228 0 0 0 0 0 0 0 15 0 22 0 608587367 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15771424 CPUtime=1.21 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) R 13690 13692 13254 0 -1 4202560 6264 0 0 0 121 0 0 0 25 0 22 0 608587370 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 47412073208795 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13708] ppid=13690 vsize=15771424 CPUtime=1.22 cores=1,3,5,7
/proc/13692/task/13708/stat : 13708 (java) R 13690 13692 13254 0 -1 4202560 17987 0 0 0 120 2 0 0 25 0 22 0 608587370 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917220021 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13692/tid=13709] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13709/stat : 13709 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13710] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13710/stat : 13710 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608587370 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13711] ppid=13690 vsize=15771424 CPUtime=1.73 cores=1,3,5,7
/proc/13692/task/13711/stat : 13711 (java) R 13690 13692 13254 0 -1 4202560 11317 0 0 0 172 1 0 0 21 0 22 0 608587402 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505523210 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13712] ppid=13690 vsize=15771424 CPUtime=1.68 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 7627 0 0 0 168 0 0 0 17 0 22 0 608587402 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505843485 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15771424 CPUtime=1.79 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 8263 0 0 0 179 0 0 0 19 0 22 0 608587402 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505823268 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15771424 CPUtime=1.65 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 7638 0 0 0 165 0 0 0 18 0 22 0 608587402 16149938176 100340 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505822996 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.51
Current children cumulated vsize (KiB) 15771424

[startup+6.30144 s]
/proc/loadavg: 7.68 7.94 7.97 10/220 13714
/proc/meminfo: memFree=28549128/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15771424 CPUtime=23.28 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 304783 0 1 0 2287 41 0 0 25 0 22 0 608587365 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942856 291684 2284 9 0 3933575 0
[pid=13692/tid=13694] ppid=13690 vsize=15771424 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 5672 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15771424 CPUtime=0.02 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 10252 0 0 0 1 1 0 0 16 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15771424 CPUtime=0.02 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 6891 0 0 0 1 1 0 0 16 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 5649 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) S 13690 13692 13254 0 -1 4202560 5397 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15771424 CPUtime=0.02 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 6607 0 0 0 1 1 0 0 16 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 2789 0 0 0 0 0 0 0 16 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15771424 CPUtime=0.01 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 7095 0 0 0 1 0 0 0 15 0 22 0 608587366 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 780 0 0 0 0 0 0 0 15 0 22 0 608587367 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15771424 CPUtime=1.66 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) S 13690 13692 13254 0 -1 4202560 6615 0 0 0 165 1 0 0 16 0 22 0 608587370 16149938176 291684 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=13692/tid=13712] ppid=13690 vsize=15771424 CPUtime=1048.02 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 290036 0 0 0 104760 42 0 0 25 0 22 0 608587402 16149938176 152773 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912506445457 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15771424 CPUtime=1047.86 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 395709 0 0 0 104734 52 0 0 25 0 22 0 608587402 16149938176 152773 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505801806 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15771424 CPUtime=1048.27 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 366563 0 0 0 104778 49 0 0 25 0 22 0 608587402 16149938176 152773 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912506073929 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4225.27
Current children cumulated vsize (KiB) 15771424

[startup+1122.3 s]
/proc/loadavg: 8.15 8.11 8.03 9/220 13844
/proc/meminfo: memFree=29128668/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15771424 CPUtime=4463.94 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 2458408 0 1 0 445934 460 0 0 25 0 22 0 608587365 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942856 131446 2297 9 0 3933575 0
[pid=13692/tid=13694] ppid=13690 vsize=15771424 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15771424 CPUtime=3.54 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 122970 0 0 0 333 21 0 0 16 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15771424 CPUtime=3.5 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 120844 0 0 0 326 24 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15771424 CPUtime=3.46 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 118221 0 0 0 323 23 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15771424 CPUtime=3.5 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 126414 0 0 0 326 24 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15771424 CPUtime=3.43 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) S 13690 13692 13254 0 -1 4202560 112777 0 0 0 321 22 0 0 16 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15771424 CPUtime=3.41 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 123032 0 0 0 316 25 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15771424 CPUtime=3.37 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 111808 0 0 0 316 21 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15771424 CPUtime=3.45 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 121988 0 0 0 322 23 0 0 15 0 22 0 608587366 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15771424 CPUtime=2.06 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 6439 0 0 0 143 63 0 0 15 0 22 0 608587367 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15771424 CPUtime=1.85 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) S 13690 13692 13254 0 -1 4202560 6646 0 0 0 184 1 0 0 15 0 22 0 608587370 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13708] ppid=13690 vsize=15771424 CPUtime=1.53 cores=1,3,5,7
/proc/13692/task/13708/stat : 13708 (java) S 13690 13692 13254 0 -1 4202560 18015 0 0 0 151 2 0 0 16 0 22 0 608587370 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13709] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13709/stat : 13709 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13710] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13710/stat : 13710 (java) S 13690 13692 13254 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 608587370 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13711] ppid=13690 vsize=15771424 CPUtime=1107.67 cores=1,3,5,7
/proc/13692/task/13711/stat : 13711 (java) R 13690 13692 13254 0 -1 4202560 339613 0 0 0 110718 49 0 0 25 0 22 0 608587402 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505965475 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13712] ppid=13690 vsize=15771424 CPUtime=1107.35 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 304860 0 0 0 110691 44 0 0 25 0 22 0 608587402 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912506075144 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15771424 CPUtime=1107.14 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 414989 0 0 0 110659 55 0 0 25 0 22 0 608587402 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505823122 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15771424 CPUtime=1107.5 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 385756 0 0 0 110698 52 0 0 25 0 22 0 608587402 16149938176 131446 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 47412074334135 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4463.94
Current children cumulated vsize (KiB) 15771424

[startup+1182.3 s]
/proc/loadavg: 8.11 8.11 8.03 9/220 13846
/proc/meminfo: memFree=29062268/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15771424 CPUtime=4702.66 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 2584168 0 1 0 469780 486 0 0 25 0 22 0 608587365 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942856 144456 2297 9 0 3933575 0
[pid=13692/tid=13694] ppid=13690 vsize=15771424 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15771424 CPUtime=3.74 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 128196 0 0 0 352 22 0 0 15 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15771424 CPUtime=3.66 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 125424 0 0 0 341 25 0 0 16 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15771424 CPUtime=3.61 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 122523 0 0 0 338 23 0 0 15 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15771424 CPUtime=3.67 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 130788 0 0 0 342 25 0 0 15 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15771424 CPUtime=3.59 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) S 13690 13692 13254 0 -1 4202560 117912 0 0 0 336 23 0 0 15 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15771424 CPUtime=3.6 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 128221 0 0 0 334 26 0 0 16 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15771424 CPUtime=3.57 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 116980 0 0 0 334 23 0 0 16 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15771424 CPUtime=3.64 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 127365 0 0 0 340 24 0 0 15 0 22 0 608587366 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15771424 CPUtime=2.17 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 6803 0 0 0 150 67 0 0 15 0 22 0 608587367 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15771424 CPUtime=1.85 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) S 13690 13692 13254 0 -1 4202560 6646 0 0 0 184 1 0 0 15 0 22 0 608587370 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13708] ppid=13690 vsize=15771424 CPUtime=1.53 cores=1,3,5,7
/proc/13692/task/13708/stat : 13708 (java) S 13690 13692 13254 0 -1 4202560 18015 0 0 0 151 2 0 0 16 0 22 0 608587370 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13709] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13709/stat : 13709 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13710] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13710/stat : 13710 (java) S 13690 13692 13254 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 608587370 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13711] ppid=13690 vsize=15771424 CPUtime=1167.06 cores=1,3,5,7
/proc/13692/task/13711/stat : 13711 (java) R 13690 13692 13254 0 -1 4202560 361729 0 0 0 116653 53 0 0 25 0 22 0 608587402 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505523231 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13712] ppid=13690 vsize=15771424 CPUtime=1166.62 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 324311 0 0 0 116615 47 0 0 25 0 22 0 608587402 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505823099 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15771424 CPUtime=1166.38 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 436647 0 0 0 116580 58 0 0 25 0 22 0 608587402 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505823122 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15771424 CPUtime=1166.77 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 408570 0 0 0 116621 56 0 0 25 0 22 0 608587402 16149938176 144456 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505601085 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4702.66
Current children cumulated vsize (KiB) 15771424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.8 s]
/proc/loadavg: 8.07 8.10 8.03 9/220 13846
/proc/meminfo: memFree=29119768/32950928 swapFree=67054472/67111528
[pid=13692] ppid=13690 vsize=15771424 CPUtime=4800.12 cores=1,3,5,7
/proc/13692/stat : 13692 (java) S 13690 13692 13254 0 -1 4202496 2606870 0 1 0 479521 491 0 0 25 0 22 0 608587365 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/13692/statm: 3942856 120153 2297 9 0 3933575 0
[pid=13692/tid=13694] ppid=13690 vsize=15771424 CPUtime=1.02 cores=1,3,5,7
/proc/13692/task/13694/stat : 13694 (java) S 13690 13692 13254 0 -1 4202560 22588 0 1 0 100 2 0 0 25 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13695] ppid=13690 vsize=15771424 CPUtime=3.79 cores=1,3,5,7
/proc/13692/task/13695/stat : 13695 (java) S 13690 13692 13254 0 -1 4202560 128875 0 0 0 357 22 0 0 15 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13696] ppid=13690 vsize=15771424 CPUtime=3.74 cores=1,3,5,7
/proc/13692/task/13696/stat : 13696 (java) S 13690 13692 13254 0 -1 4202560 126743 0 0 0 349 25 0 0 15 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13697] ppid=13690 vsize=15771424 CPUtime=3.7 cores=1,3,5,7
/proc/13692/task/13697/stat : 13697 (java) S 13690 13692 13254 0 -1 4202560 123408 0 0 0 346 24 0 0 16 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13698] ppid=13690 vsize=15771424 CPUtime=3.75 cores=1,3,5,7
/proc/13692/task/13698/stat : 13698 (java) S 13690 13692 13254 0 -1 4202560 131959 0 0 0 350 25 0 0 15 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13699] ppid=13690 vsize=15771424 CPUtime=3.67 cores=1,3,5,7
/proc/13692/task/13699/stat : 13699 (java) S 13690 13692 13254 0 -1 4202560 119101 0 0 0 344 23 0 0 16 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13700] ppid=13690 vsize=15771424 CPUtime=3.67 cores=1,3,5,7
/proc/13692/task/13700/stat : 13700 (java) S 13690 13692 13254 0 -1 4202560 129596 0 0 0 341 26 0 0 15 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 7 0 0 0
[pid=13692/tid=13701] ppid=13690 vsize=15771424 CPUtime=3.64 cores=1,3,5,7
/proc/13692/task/13701/stat : 13701 (java) S 13690 13692 13254 0 -1 4202560 117842 0 0 0 341 23 0 0 15 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13702] ppid=13690 vsize=15771424 CPUtime=3.71 cores=1,3,5,7
/proc/13692/task/13702/stat : 13702 (java) S 13690 13692 13254 0 -1 4202560 128548 0 0 0 347 24 0 0 16 0 22 0 608587366 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13703] ppid=13690 vsize=15771424 CPUtime=2.22 cores=1,3,5,7
/proc/13692/task/13703/stat : 13703 (java) S 13690 13692 13254 0 -1 4202560 6916 0 0 0 153 69 0 0 15 0 22 0 608587367 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 0 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13704] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13704/stat : 13704 (java) S 13690 13692 13254 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13705] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13705/stat : 13705 (java) S 13690 13692 13254 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608587368 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13706] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13706/stat : 13706 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917217713 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13707] ppid=13690 vsize=15771424 CPUtime=1.85 cores=1,3,5,7
/proc/13692/task/13707/stat : 13707 (java) S 13690 13692 13254 0 -1 4202560 6646 0 0 0 184 1 0 0 15 0 22 0 608587370 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13708] ppid=13690 vsize=15771424 CPUtime=1.53 cores=1,3,5,7
/proc/13692/task/13708/stat : 13708 (java) S 13690 13692 13254 0 -1 4202560 18015 0 0 0 151 2 0 0 16 0 22 0 608587370 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 1 0 0 0
[pid=13692/tid=13709] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13709/stat : 13709 (java) S 13690 13692 13254 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608587370 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210009 0 4 0 16800975 18446604464579104896 0 0 -1 3 0 0 0
[pid=13692/tid=13710] ppid=13690 vsize=15771424 CPUtime=0 cores=1,3,5,7
/proc/13692/task/13710/stat : 13710 (java) S 13690 13692 13254 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 608587370 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 260917210624 0 4 0 16800975 18446604464579104896 0 0 -1 5 0 0 0
[pid=13692/tid=13711] ppid=13690 vsize=15771424 CPUtime=1191.27 cores=1,3,5,7
/proc/13692/task/13711/stat : 13711 (java) R 13690 13692 13254 0 -1 4202560 364695 0 0 0 119074 53 0 0 25 0 22 0 608587402 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505801681 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=13692/tid=13712] ppid=13690 vsize=15771424 CPUtime=1190.84 cores=1,3,5,7
/proc/13692/task/13712/stat : 13712 (java) R 13690 13692 13254 0 -1 4202560 326947 0 0 0 119036 48 0 0 25 0 22 0 608587402 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505864180 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=13692/tid=13713] ppid=13690 vsize=15771424 CPUtime=1190.63 cores=1,3,5,7
/proc/13692/task/13713/stat : 13713 (java) R 13690 13692 13254 0 -1 4202560 440688 0 0 0 119005 58 0 0 25 0 22 0 608587402 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912505584162 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=13692/tid=13714] ppid=13690 vsize=15771424 CPUtime=1190.92 cores=1,3,5,7
/proc/13692/task/13714/stat : 13714 (java) R 13690 13692 13254 0 -1 4202560 412851 0 0 0 119035 57 0 0 18 0 22 0 608587402 16149938176 120153 33554432000 1073741824 1073778376 140735926774704 18446744073709551615 46912506111881 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 15771424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1206.84
CPU time (s): 4800.18
CPU user time (s): 4795.24
CPU system time (s): 4.93425
CPU usage (%): 397.748
Max. virtual memory (cumulated for all children) (KiB): 15772360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.24
system time used= 4.93425
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2606897
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 190550
involuntary context switches= 122088

runsolver used 2.11168 second user time and 4.51931 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-30 19:12:47
IDJOB=3311914
IDBENCH=83188
IDSOLVER=1698
FILE ID=node116/3311914-1304183567
RUNJOBID= node116-1304181041-13273
PBS_JOBID= 13172460
Free space on /tmp= 73284 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/rnd_150_42_s.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311914-1304183567/watcher-3311914-1304183567 -o /tmp/evaluation-result-3311914-1304183567/solver-3311914-1304183567 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311914-1304183567.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4177e06821060b0db9493e3e34514fae
RANDOM SEED=255575173

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29613616 kB
Buffers:       1025324 kB
Cached:        1485476 kB
SwapCached:       9656 kB
Active:         639516 kB
Inactive:      2356696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29613616 kB
SwapTotal:    67111528 kB
SwapFree:     67054472 kB
Dirty:            2016 kB
Writeback:           0 kB
AnonPages:      484020 kB
Mapped:          21568 kB
Slab:           275640 kB
PageTables:       5720 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   731032 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73284 MiB
End job on node116 at 2011-04-30 19:32:56