Trace number 3311844

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.24 1207.54

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v945c61409g3.cnf
MD5SUM226123ce9245dfa4b876682016123861
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark12.0692
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.01/0.79	01:04 INFO : Reading from input HOME/instance-3311844-1304082063.cnf
0.63/1.15	Executor set job limit to 1000000
0.63/1.15	Executor set job limit to 1000000
0.63/1.15	Executor set job limit to 1000000
0.63/1.15	Executor set job limit to 1000000
0.63/1.15	Starting Executor!
0.63/1.15	Starting Executor!
0.63/1.15	Starting Executor!
0.63/1.15	Starting Executor!
2.45/1.92	01:05 INFO : 945 variables remaining out of 945
2.45/1.92	01:05 INFO : 351900 literals remaining out of 185082

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311844-1304082063/watcher-3311844-1304082063 -o /tmp/evaluation-result-3311844-1304082063/solver-3311844-1304082063 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311844-1304082063.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.56 8.00 8.00 4/199 3686
/proc/meminfo: memFree=23474520/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=24056 CPUtime=0 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 1390 0 0 0 0 0 0 0 21 0 2 0 598437011 24633344 869 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 6535 871 667 9 0 381 0
[pid=3686/tid=3687] ppid=3684 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 56 0 0 0 0 0 0 0 22 0 2 0 598437011 26714112 885 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260900470407 0 2147483391 4096 0 18446744071699207358 0 0 -1 5 0 0 0

[startup+0.0670159 s]
/proc/loadavg: 7.56 8.00 8.00 4/199 3686
/proc/meminfo: memFree=23474520/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 1574 0 0 0 0 0 0 0 21 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 8947 1018 785 9 0 386 0
[pid=3686/tid=3687] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 216 0 0 0 0 0 0 0 23 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260905414214 0 0 0 16784584 14196168464464347135 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 35788

[startup+0.100982 s]
/proc/loadavg: 7.56 8.00 8.00 4/199 3686
/proc/meminfo: memFree=23474520/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 1574 0 0 0 0 0 0 0 21 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 8947 1018 785 9 0 386 0
[pid=3686/tid=3687] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 216 0 0 0 0 0 0 0 23 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260905414214 0 0 0 16784584 14196168464464347135 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 35788

[startup+0.300862 s]
/proc/loadavg: 7.56 8.00 8.00 4/199 3686
/proc/meminfo: memFree=23474520/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 1574 0 0 0 0 0 0 0 21 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 8947 1018 785 9 0 386 0
[pid=3686/tid=3687] ppid=3684 vsize=35788 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 216 0 0 0 0 0 0 0 23 0 2 0 598437011 36646912 1018 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260905414214 0 0 0 16784584 14196168464464347135 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 35788

[startup+0.70079 s]
/proc/loadavg: 7.56 8.00 8.00 4/199 3686
/proc/meminfo: memFree=23474520/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15602060 CPUtime=0.01 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 3306 0 1 0 1 0 0 0 21 0 11 0 598437011 15976509440 2747 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3900515 2750 1598 9 0 3891263 0
[pid=3686/tid=3687] ppid=3684 vsize=15602060 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) R 3684 3686 3309 0 -1 4202560 1941 0 1 0 0 0 0 0 19 0 11 0 598437011 15976509440 2750 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 47542738671128 0 4 0 16784584 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15602060

[startup+1.50065 s]
/proc/loadavg: 7.12 7.90 7.97 4/217 3704
/proc/meminfo: memFree=23389560/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15703608 CPUtime=1.39 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 48216 0 1 0 133 6 0 0 21 0 22 0 598437011 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3925902 44329 2249 9 0 3916621 0
[pid=3686/tid=3687] ppid=3684 vsize=15703608 CPUtime=0.78 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) R 3684 3686 3309 0 -1 4202560 35634 0 1 0 73 5 0 0 25 0 22 0 598437011 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 47542735627093 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 373 0 0 0 0 0 0 0 16 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 26 0 0 0 0 0 0 0 16 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437080 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 598437081 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 22 0 598437081 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3701] ppid=3684 vsize=15703608 CPUtime=0.22 cores=1,3,5,7
/proc/3686/task/3701/stat : 3701 (java) S 3684 3686 3309 0 -1 4202560 2393 0 0 0 22 0 0 0 18 0 22 0 598437084 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3702] ppid=3684 vsize=15703608 CPUtime=0.36 cores=1,3,5,7
/proc/3686/task/3702/stat : 3702 (java) R 3684 3686 3309 0 -1 4202560 8347 0 0 0 36 0 0 0 19 0 22 0 598437084 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 47542736458770 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=3686/tid=3703] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3703/stat : 3703 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 598437084 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3704] ppid=3684 vsize=15703608 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3704/stat : 3704 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 598437084 16080494592 44329 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 15703608

[startup+3.10135 s]
/proc/loadavg: 7.12 7.90 7.97 9/221 3708
/proc/meminfo: memFree=23058372/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15708884 CPUtime=6.44 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 91657 0 1 0 632 12 0 0 21 0 22 0 598437011 16085897216 84966 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3927221 84967 2274 9 0 3917940 0
[pid=3686/tid=3687] ppid=3684 vsize=15708884 CPUtime=1.21 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 35688 0 1 0 116 5 0 0 25 0 22 0 598437011 16085897216 84968 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15708884 CPUtime=0.01 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 4021 0 0 0 1 0 0 0 16 0 22 0 598437080 16085897216 84969 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 1667 0 0 0 0 0 0 0 15 0 22 0 598437080 16085897216 84970 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 3042 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 84971 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 1525 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 84972 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 1864 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 84973 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 1567 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 84975 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 1463 0 0 0 0 0 0 0 15 0 22 0 598437080 16085897216 84976 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15708884 CPUtime=0.01 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 2816 0 0 0 1 0 0 0 15 0 22 0 598437080 16085897216 84977 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 84978 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 84980 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 84981 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16085897216 84981 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3701] ppid=3684 vsize=15708884 CPUtime=0.81 cores=1,3,5,7
/proc/3686/task/3701/stat : 3701 (java) S 3684 3686 3309 0 -1 4202560 6031 0 0 0 81 0 0 0 15 0 22 0 598437084 16085897216 84982 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3702] ppid=3684 vsize=15708884 CPUtime=0.85 cores=1,3,5,7
/proc/3686/task/3702/stat : 3702 (java) R 3684 3686 3309 0 -1 4202560 10253 0 0 0 85 0 0 0 17 0 22 0 598437084 16085897216 84984 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3703] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3703/stat : 3703 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 598437084 16085897216 84985 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3704] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3704/stat : 3704 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 598437084 16085897216 84986 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3705] ppid=3684 vsize=15708884 CPUtime=0.99 cores=1,3,5,7
/proc/3686/task/3705/stat : 3705 (java) R 3684 3686 3309 0 -1 4202560 5379 0 0 0 99 0 0 0 19 0 22 0 598437126 16085897216 84990 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505981822 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=3686/tid=3706] ppid=3684 vsize=15708884 CPUtime=0.81 cores=1,3,5,7
/proc/3686/task/3706/stat : 3706 (java) R 3684 3686 3309 0 -1 4202560 5297 0 0 0 81 0 0 0 16 0 22 0 598437126 16085897216 84993 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505577832 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3707] ppid=3684 vsize=15708884 CPUtime=0.86 cores=1,3,5,7
/proc/3686/task/3707/stat : 3707 (java) R 3684 3686 3309 0 -1 4202560 4456 0 0 0 86 0 0 0 16 0 22 0 598437126 16085897216 84996 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505954787 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=3686/tid=3708] ppid=3684 vsize=15708884 CPUtime=0.74 cores=1,3,5,7
/proc/3686/task/3708/stat : 3708 (java) R 3684 3686 3309 0 -1 4202560 5157 0 0 0 74 0 0 0 16 0 22 0 598437126 16085897216 84999 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505971862 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.44
Current children cumulated vsize (KiB) 15708884

[startup+6.30077 s]
/proc/loadavg: 7.19 7.91 7.97 9/221 3708
/proc/meminfo: memFree=21697772/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15708884 CPUtime=19.2 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 291873 0 1 0 1882 38 0 0 21 0 22 0 598437011 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3927221 284234 2284 9 0 3917940 0
[pid=3686/tid=3687] ppid=3684 vsize=15708884 CPUtime=1.21 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 35688 0 1 0 116 5 0 0 25 0 22 0 598437011 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15708884 CPUtime=0.02 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 8891 0 0 0 1 1 0 0 16 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 3373 0 0 0 0 0 0 0 15 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15708884 CPUtime=0.01 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 7324 0 0 0 1 0 0 0 15 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15708884 CPUtime=0.01 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 6456 0 0 0 1 0 0 0 16 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 3498 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 3931 0 0 0 0 0 0 0 16 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 3956 0 0 0 0 0 0 0 15 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15708884 CPUtime=0.01 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 4595 0 0 0 1 0 0 0 15 0 22 0 598437080 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 770 0 0 0 0 0 0 0 16 0 22 0 598437081 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16085897216 284234 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=3686/tid=3706] ppid=3684 vsize=15708884 CPUtime=1107.09 cores=1,3,5,7
/proc/3686/task/3706/stat : 3706 (java) R 3684 3686 3309 0 -1 4202560 355173 0 0 0 110662 47 0 0 25 0 22 0 598437126 16085897216 141943 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912506384149 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=3686/tid=3707] ppid=3684 vsize=15708884 CPUtime=1106.97 cores=1,3,5,7
/proc/3686/task/3707/stat : 3707 (java) R 3684 3686 3309 0 -1 4202560 358519 0 0 0 110651 46 0 0 25 0 22 0 598437126 16085897216 141943 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505952989 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=3686/tid=3708] ppid=3684 vsize=15708884 CPUtime=1106.19 cores=1,3,5,7
/proc/3686/task/3708/stat : 3708 (java) R 3684 3686 3309 0 -1 4202560 350838 0 0 0 110570 49 0 0 25 0 22 0 598437126 16085897216 141943 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912506129157 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4461.07
Current children cumulated vsize (KiB) 15708884

[startup+1182.3 s]
/proc/loadavg: 8.08 8.08 8.01 9/220 3748
/proc/meminfo: memFree=22398320/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15708884 CPUtime=4699.92 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 2983996 0 1 0 469443 549 0 0 21 0 22 0 598437011 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3927221 159473 2298 9 0 3917940 0
[pid=3686/tid=3687] ppid=3684 vsize=15708884 CPUtime=1.21 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 35688 0 1 0 116 5 0 0 25 0 22 0 598437011 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15708884 CPUtime=3.91 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 179824 0 0 0 358 33 0 0 15 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15708884 CPUtime=3.76 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 176758 0 0 0 343 33 0 0 16 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15708884 CPUtime=3.73 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 172462 0 0 0 341 32 0 0 15 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15708884 CPUtime=3.78 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 175813 0 0 0 344 34 0 0 15 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15708884 CPUtime=3.77 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 176379 0 0 0 346 31 0 0 15 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15708884 CPUtime=3.77 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 176877 0 0 0 345 32 0 0 16 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15708884 CPUtime=3.77 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 179843 0 0 0 345 32 0 0 15 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15708884 CPUtime=3.86 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 169841 0 0 0 354 32 0 0 16 0 22 0 598437080 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15708884 CPUtime=2.14 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 7743 0 0 0 146 68 0 0 15 0 22 0 598437081 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3701] ppid=3684 vsize=15708884 CPUtime=1.15 cores=1,3,5,7
/proc/3686/task/3701/stat : 3701 (java) S 3684 3686 3309 0 -1 4202560 6960 0 0 0 115 0 0 0 16 0 22 0 598437084 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3702] ppid=3684 vsize=15708884 CPUtime=1.02 cores=1,3,5,7
/proc/3686/task/3702/stat : 3702 (java) S 3684 3686 3309 0 -1 4202560 10270 0 0 0 101 1 0 0 15 0 22 0 598437084 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3703] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3703/stat : 3703 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 598437084 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3704] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3704/stat : 3704 (java) S 3684 3686 3309 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 598437084 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3705] ppid=3684 vsize=15708884 CPUtime=1165.81 cores=1,3,5,7
/proc/3686/task/3705/stat : 3705 (java) R 3684 3686 3309 0 -1 4202560 376954 0 0 0 116526 55 0 0 25 0 22 0 598437126 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505998368 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3706] ppid=3684 vsize=15708884 CPUtime=1166.47 cores=1,3,5,7
/proc/3686/task/3706/stat : 3706 (java) R 3684 3686 3309 0 -1 4202560 378377 0 0 0 116596 51 0 0 25 0 22 0 598437126 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912506193996 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=3686/tid=3707] ppid=3684 vsize=15708884 CPUtime=1166.15 cores=1,3,5,7
/proc/3686/task/3707/stat : 3707 (java) R 3684 3686 3309 0 -1 4202560 383228 0 0 0 116566 49 0 0 25 0 22 0 598437126 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505953221 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=3686/tid=3708] ppid=3684 vsize=15708884 CPUtime=1165.45 cores=1,3,5,7
/proc/3686/task/3708/stat : 3708 (java) R 3684 3686 3309 0 -1 4202560 375529 0 0 0 116492 53 0 0 25 0 22 0 598437126 16085897216 159473 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505915888 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4699.92
Current children cumulated vsize (KiB) 15708884



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.5 s]
/proc/loadavg: 8.14 8.09 8.02 5/197 3752
/proc/meminfo: memFree=23147928/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15708884 CPUtime=4800.18 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 3010763 0 1 0 479462 556 0 0 21 0 22 0 598437011 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3927221 119565 2298 9 0 3917940 0
[pid=3686/tid=3687] ppid=3684 vsize=15708884 CPUtime=1.21 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 35688 0 1 0 116 5 0 0 25 0 22 0 598437011 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15708884 CPUtime=3.98 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 181058 0 0 0 365 33 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15708884 CPUtime=3.84 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 178633 0 0 0 351 33 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15708884 CPUtime=3.81 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 174520 0 0 0 349 32 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15708884 CPUtime=3.86 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 178439 0 0 0 351 35 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 179159 0 0 0 353 32 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 178452 0 0 0 352 33 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 182068 0 0 0 352 33 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15708884 CPUtime=3.95 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 171919 0 0 0 363 32 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15708884 CPUtime=2.2 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 7819 0 0 0 150 70 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3701] ppid=3684 vsize=15708884 CPUtime=1.15 cores=1,3,5,7
/proc/3686/task/3701/stat : 3701 (java) S 3684 3686 3309 0 -1 4202560 6960 0 0 0 115 0 0 0 16 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3702] ppid=3684 vsize=15708884 CPUtime=1.02 cores=1,3,5,7
/proc/3686/task/3702/stat : 3702 (java) S 3684 3686 3309 0 -1 4202560 10270 0 0 0 101 1 0 0 15 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3703] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3703/stat : 3703 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3704] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3704/stat : 3704 (java) S 3684 3686 3309 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3705] ppid=3684 vsize=15708884 CPUtime=1190.75 cores=1,3,5,7
/proc/3686/task/3705/stat : 3705 (java) R 3684 3686 3309 0 -1 4202560 379479 0 0 0 119019 56 0 0 25 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912506384149 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3706] ppid=3684 vsize=15708884 CPUtime=1191.27 cores=1,3,5,7
/proc/3686/task/3706/stat : 3706 (java) R 3684 3686 3309 0 -1 4202560 380379 0 0 0 119076 51 0 0 19 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505916002 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=3686/tid=3707] ppid=3684 vsize=15708884 CPUtime=1191.09 cores=1,3,5,7
/proc/3686/task/3707/stat : 3707 (java) R 3684 3686 3309 0 -1 4202560 386348 0 0 0 119059 50 0 0 25 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505915687 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=3686/tid=3708] ppid=3684 vsize=15708884 CPUtime=1190.37 cores=1,3,5,7
/proc/3686/task/3708/stat : 3708 (java) R 3684 3686 3309 0 -1 4202560 378120 0 0 0 118983 54 0 0 24 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505915843 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 15708884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.5 s]
/proc/loadavg: 8.14 8.09 8.02 5/197 3752
/proc/meminfo: memFree=23147928/32950928 swapFree=67071984/67111528
[pid=3686] ppid=3684 vsize=15708884 CPUtime=4800.18 cores=1,3,5,7
/proc/3686/stat : 3686 (java) S 3684 3686 3309 0 -1 4202496 3010763 0 1 0 479462 556 0 0 21 0 22 0 598437011 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917196773 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3686/statm: 3927221 119565 2298 9 0 3917940 0
[pid=3686/tid=3687] ppid=3684 vsize=15708884 CPUtime=1.21 cores=1,3,5,7
/proc/3686/task/3687/stat : 3687 (java) S 3684 3686 3309 0 -1 4202560 35688 0 1 0 116 5 0 0 25 0 22 0 598437011 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3689] ppid=3684 vsize=15708884 CPUtime=3.98 cores=1,3,5,7
/proc/3686/task/3689/stat : 3689 (java) S 3684 3686 3309 0 -1 4202560 181058 0 0 0 365 33 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3690] ppid=3684 vsize=15708884 CPUtime=3.84 cores=1,3,5,7
/proc/3686/task/3690/stat : 3690 (java) S 3684 3686 3309 0 -1 4202560 178633 0 0 0 351 33 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3691] ppid=3684 vsize=15708884 CPUtime=3.81 cores=1,3,5,7
/proc/3686/task/3691/stat : 3691 (java) S 3684 3686 3309 0 -1 4202560 174520 0 0 0 349 32 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3692] ppid=3684 vsize=15708884 CPUtime=3.86 cores=1,3,5,7
/proc/3686/task/3692/stat : 3692 (java) S 3684 3686 3309 0 -1 4202560 178439 0 0 0 351 35 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3693] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3693/stat : 3693 (java) S 3684 3686 3309 0 -1 4202560 179159 0 0 0 353 32 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3694] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3694/stat : 3694 (java) S 3684 3686 3309 0 -1 4202560 178452 0 0 0 352 33 0 0 16 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3695] ppid=3684 vsize=15708884 CPUtime=3.85 cores=1,3,5,7
/proc/3686/task/3695/stat : 3695 (java) S 3684 3686 3309 0 -1 4202560 182068 0 0 0 352 33 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3696] ppid=3684 vsize=15708884 CPUtime=3.95 cores=1,3,5,7
/proc/3686/task/3696/stat : 3696 (java) S 3684 3686 3309 0 -1 4202560 171919 0 0 0 363 32 0 0 15 0 22 0 598437080 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3697] ppid=3684 vsize=15708884 CPUtime=2.2 cores=1,3,5,7
/proc/3686/task/3697/stat : 3697 (java) S 3684 3686 3309 0 -1 4202560 7819 0 0 0 150 70 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 0 0 16800975 18446604469102898176 0 0 -1 3 0 0 0
[pid=3686/tid=3698] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3698/stat : 3698 (java) S 3684 3686 3309 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3699] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3699/stat : 3699 (java) S 3684 3686 3309 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 598437081 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3700] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3700/stat : 3700 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917217713 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3701] ppid=3684 vsize=15708884 CPUtime=1.15 cores=1,3,5,7
/proc/3686/task/3701/stat : 3701 (java) S 3684 3686 3309 0 -1 4202560 6960 0 0 0 115 0 0 0 16 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3702] ppid=3684 vsize=15708884 CPUtime=1.02 cores=1,3,5,7
/proc/3686/task/3702/stat : 3702 (java) S 3684 3686 3309 0 -1 4202560 10270 0 0 0 101 1 0 0 15 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 1 0 0 0
[pid=3686/tid=3703] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3703/stat : 3703 (java) S 3684 3686 3309 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210009 0 4 0 16800975 18446604469102898176 0 0 -1 5 0 0 0
[pid=3686/tid=3704] ppid=3684 vsize=15708884 CPUtime=0 cores=1,3,5,7
/proc/3686/task/3704/stat : 3704 (java) S 3684 3686 3309 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 598437084 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 260917210624 0 4 0 16800975 18446604469102898176 0 0 -1 7 0 0 0
[pid=3686/tid=3705] ppid=3684 vsize=15708884 CPUtime=1190.75 cores=1,3,5,7
/proc/3686/task/3705/stat : 3705 (java) R 3684 3686 3309 0 -1 4202560 379479 0 0 0 119019 56 0 0 25 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912506384149 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3686/tid=3706] ppid=3684 vsize=15708884 CPUtime=1191.27 cores=1,3,5,7
/proc/3686/task/3706/stat : 3706 (java) R 3684 3686 3309 0 -1 4202560 380379 0 0 0 119076 51 0 0 19 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505916002 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=3686/tid=3707] ppid=3684 vsize=15708884 CPUtime=1191.09 cores=1,3,5,7
/proc/3686/task/3707/stat : 3707 (java) R 3684 3686 3309 0 -1 4202560 386348 0 0 0 119059 50 0 0 25 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505915687 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=3686/tid=3708] ppid=3684 vsize=15708884 CPUtime=1190.37 cores=1,3,5,7
/proc/3686/task/3708/stat : 3708 (java) R 3684 3686 3309 0 -1 4202560 378120 0 0 0 118983 54 0 0 24 0 22 0 598437126 16085897216 119565 33554432000 1073741824 1073778376 140734549995328 18446744073709551615 46912505915843 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 15708884

Child status: 143
Real time (s): 1207.54
CPU time (s): 4800.24
CPU user time (s): 4794.65
CPU system time (s): 5.58815
CPU usage (%): 397.524
Max. virtual memory (cumulated for all children) (KiB): 15708884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.65
system time used= 5.58815
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3010789
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 172109
involuntary context switches= 106670

runsolver used 2.04769 second user time and 4.5933 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-29 15:01:03
IDJOB=3311844
IDBENCH=71301
IDSOLVER=1698
FILE ID=node116/3311844-1304082063
RUNJOBID= node116-1304082062-3646
PBS_JOBID= 13170521
Free space on /tmp= 72512 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v945c61409g3.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311844-1304082063/watcher-3311844-1304082063 -o /tmp/evaluation-result-3311844-1304082063/solver-3311844-1304082063 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311844-1304082063.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 226123ce9245dfa4b876682016123861
RANDOM SEED=1236517112

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23474792 kB
Buffers:       1903236 kB
Cached:        6954892 kB
SwapCached:       9732 kB
Active:        4547832 kB
Inactive:      4500056 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23474792 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:            4960 kB
Writeback:           0 kB
AnonPages:      183308 kB
Mapped:          22224 kB
Slab:           365688 kB
PageTables:       5068 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   792776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72508 MiB
End job on node116 at 2011-04-29 15:21:13