Trace number 3312919

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.23 1206.95

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
MD5SUMc86ce640ddb0138bf41ccc37bc6fcf28
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.84587
Satisfiable
(Un)Satisfiability was proved
Number of variables1295
Number of clauses148400
Sum of the clauses size298025
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2148365
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data 

0.10/0.12	44:34 INFO : Reading from input HOME/instance-3312919-1304189074.cnf
0.81/0.68	Executor set job limit to 1000000
0.81/0.68	Executor set job limit to 1000000
0.81/0.68	Executor set job limit to 1000000
0.81/0.68	Executor set job limit to 1000000
0.81/0.68	Starting Executor!
0.81/0.68	Starting Executor!
0.81/0.68	Starting Executor!
0.81/0.69	Starting Executor!
2.86/1.75	44:36 INFO : 1295 variables remaining out of 1295
2.86/1.75	44:36 INFO : 891520 literals remaining out of 446425

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312919-1304189074/watcher-3312919-1304189074 -o /tmp/evaluation-result-3312919-1304189074/solver-3312919-1304189074 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312919-1304189074.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.29 6.94 6.65 5/198 17005
/proc/meminfo: memFree=17333376/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/17005/stat : 17005 (java) R 17003 17005 16197 0 -1 4202496 980 0 0 0 0 0 0 0 23 0 1 0 530507841 23580672 467 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230804203264 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/17005/statm: 5757 479 367 9 0 124 0

[startup+0.0726971 s]
/proc/loadavg: 7.29 6.94 6.65 5/198 17005
/proc/meminfo: memFree=17333376/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15609780 CPUtime=0.06 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 4398 0 1 0 5 1 0 0 23 0 18 0 530507841 15984414720 3838 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3902445 3839 1779 9 0 3893164 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15609780

[startup+0.100688 s]
/proc/loadavg: 7.29 6.94 6.65 5/198 17005
/proc/meminfo: memFree=17333376/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15676892 CPUtime=0.1 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 5538 0 1 0 9 1 0 0 23 0 18 0 530507841 16053137408 4953 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3919223 4953 2116 9 0 3909942 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676892

[startup+0.300617 s]
/proc/loadavg: 7.29 6.94 6.65 5/198 17005
/proc/meminfo: memFree=17333376/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15679984 CPUtime=0.52 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 13857 0 1 0 49 3 0 0 23 0 18 0 530507841 16056303616 12404 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3919996 12408 2206 9 0 3910715 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15679984

[startup+0.700579 s]
/proc/loadavg: 7.29 6.94 6.65 5/198 17005
/proc/meminfo: memFree=17333376/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15683948 CPUtime=0.93 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 41838 0 1 0 87 6 0 0 23 0 22 0 530507841 16060362752 40344 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3920987 40344 2226 9 0 3911706 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 15683948

[startup+1.5014 s]
/proc/loadavg: 7.29 6.94 6.65 7/220 17027
/proc/meminfo: memFree=17165488/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15685032 CPUtime=2.5 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 51146 0 1 0 243 7 0 0 23 0 22 0 530507841 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3921258 44846 2261 9 0 3911977 0
[pid=17005/tid=17007] ppid=17003 vsize=15685032 CPUtime=1.48 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) R 17003 17005 16197 0 -1 4202560 35646 0 1 0 143 5 0 0 21 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505654070 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 648 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 58 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 326 0 0 0 0 0 0 0 20 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 530507842 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 22 0 530507843 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 530507844 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 530507844 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15685032 CPUtime=0.39 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) R 17003 17005 16197 0 -1 4202560 2664 0 0 0 39 0 0 0 17 0 22 0 530507846 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 47569328938592 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=15685032 CPUtime=0.6 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) R 17003 17005 16197 0 -1 4202560 10282 0 0 0 59 1 0 0 20 0 22 0 530507846 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 47569332049177 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530507846 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17024] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17024/stat : 17024 (java) S 17003 17005 16197 0 -1 4202560 15 0 0 0 0 0 0 0 15 0 22 0 530507910 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17025] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) S 17003 17005 16197 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 530507910 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) S 17003 17005 16197 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 530507910 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15685032 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) S 17003 17005 16197 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 530507910 16061472768 44846 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 15685032

[startup+3.10902 s]
/proc/loadavg: 7.29 6.94 6.65 6/220 17027
/proc/meminfo: memFree=17138332/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15685440 CPUtime=7.15 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 91729 0 1 0 703 12 0 0 23 0 22 0 530507841 16061890560 84731 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3921360 84734 2273 9 0 3912079 0
[pid=17005/tid=17007] ppid=17003 vsize=15685440 CPUtime=1.73 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) S 17003 17005 16197 0 -1 4202560 35692 0 1 0 168 5 0 0 22 0 22 0 530507842 16061890560 84735 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 3641 0 0 0 0 0 0 0 15 0 22 0 530507842 16061890560 84736 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 2297 0 0 0 0 0 0 0 15 0 22 0 530507842 16061890560 84738 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 3058 0 0 0 0 0 0 0 15 0 22 0 530507842 16061890560 84740 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 1135 0 0 0 0 0 0 0 16 0 22 0 530507842 16061890560 84741 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15685440 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 6336 0 0 0 2 0 0 0 16 0 22 0 530507842 16061890560 84743 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15685440 CPUtime=0.01 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 3428 0 0 0 1 0 0 0 15 0 22 0 530507842 16061890560 84745 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 1339 0 0 0 0 0 0 0 15 0 22 0 530507842 16061890560 84746 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15685440 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 6446 0 0 0 1 1 0 0 15 0 22 0 530507842 16061890560 84748 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 108 0 0 0 0 0 0 0 15 0 22 0 530507843 16061890560 84749 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530507844 16061890560 84751 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530507844 16061890560 84752 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16061890560 84753 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15685440 CPUtime=0.77 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) S 17003 17005 16197 0 -1 4202560 2761 0 0 0 77 0 0 0 15 0 22 0 530507846 16061890560 84756 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=15685440 CPUtime=0.89 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) S 17003 17005 16197 0 -1 4202560 10332 0 0 0 88 1 0 0 15 0 22 0 530507846 16061890560 84757 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16061890560 84758 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530507846 16061890560 84759 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17024] ppid=17003 vsize=15685440 CPUtime=1.07 cores=1,3,5,7
/proc/17005/task/17024/stat : 17024 (java) R 17003 17005 16197 0 -1 4202560 4663 0 0 0 107 0 0 0 16 0 22 0 530507910 16061890560 84760 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506074930 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17005/tid=17025] ppid=17003 vsize=15685440 CPUtime=0.71 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) R 17003 17005 16197 0 -1 4202560 3710 0 0 0 71 0 0 0 16 0 22 0 530507910 16061890560 84761 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505837328 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15685440 CPUtime=0.67 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) R 17003 17005 16197 0 -1 4202560 2015 0 0 0 67 0 0 0 16 0 22 0 530507910 16061890560 84763 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505818142 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15685440 CPUtime=1.12 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) R 17003 17005 16197 0 -1 4202560 3413 0 0 0 112 0 0 0 16 0 22 0 530507910 16061890560 84764 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506187197 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 7.15
Current children cumulated vsize (KiB) 15685440

[startup+6.30152 s]
/proc/loadavg: 7.35 6.95 6.66 10/220 17027
/proc/meminfo: memFree=16540512/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15685440 CPUtime=19.88 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 255639 0 1 0 1953 35 0 0 23 0 22 0 530507841 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3921360 247933 2283 9 0 3912079 0
[pid=17005/tid=17007] ppid=17003 vsize=15685440 CPUtime=1.73 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) S 17003 17005 16197 0 -1 4202560 35692 0 1 0 168 5 0 0 22 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 3641 0 0 0 0 0 0 0 15 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15685440 CPUtime=0.03 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 11796 0 0 0 2 1 0 0 16 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15685440 CPUtime=0.04 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 14181 0 0 0 2 2 0 0 15 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15685440 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 5251 0 0 0 1 1 0 0 15 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15685440 CPUtime=0.04 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 12516 0 0 0 3 1 0 0 16 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15685440 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 8583 0 0 0 2 0 0 0 16 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15685440 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 7697 0 0 0 1 1 0 0 15 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15685440 CPUtime=0.04 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 14826 0 0 0 3 1 0 0 16 0 22 0 530507842 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 627 0 0 0 0 0 0 0 15 0 22 0 530507843 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530507844 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530507844 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15685440 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15685440 CPUtime=0.82 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) S 17003 17005 16197 0 -1 4202560 2771 0 0 0 82 0 0 0 15 0 22 0 530507846 16061890560 247933 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=17005/tid=17025] ppid=17003 vsize=15688868 CPUtime=1106.47 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) R 17003 17005 16197 0 -1 4202560 454920 0 0 0 110588 59 0 0 25 0 22 0 530507910 16065400832 233366 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506041354 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15688868 CPUtime=1107.63 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) R 17003 17005 16197 0 -1 4202560 441412 0 0 0 110705 58 0 0 25 0 22 0 530507910 16065400832 233366 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505835741 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15688868 CPUtime=1106.1 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) R 17003 17005 16197 0 -1 4202560 434140 0 0 0 110551 59 0 0 25 0 22 0 530507910 16065400832 233366 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506112740 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4463.68
Current children cumulated vsize (KiB) 15688868

[startup+1182.3 s]
/proc/loadavg: 8.21 8.09 7.66 10/221 17122
/proc/meminfo: memFree=29062080/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15688868 CPUtime=4702.25 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 3260559 0 1 0 469645 580 0 0 23 0 22 0 530507841 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3922217 222147 2296 9 0 3912936 0
[pid=17005/tid=17007] ppid=17003 vsize=15688868 CPUtime=1.73 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) S 17003 17005 16197 0 -1 4202560 35692 0 1 0 168 5 0 0 22 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15688868 CPUtime=3.86 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 161349 0 0 0 356 30 0 0 15 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15688868 CPUtime=3.97 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 179389 0 0 0 365 32 0 0 15 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15688868 CPUtime=3.95 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 178650 0 0 0 363 32 0 0 16 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15688868 CPUtime=3.94 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 163597 0 0 0 364 30 0 0 15 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15688868 CPUtime=3.74 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 159443 0 0 0 348 26 0 0 15 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15688868 CPUtime=3.97 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 171863 0 0 0 366 31 0 0 16 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15688868 CPUtime=4 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 167599 0 0 0 367 33 0 0 16 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15688868 CPUtime=3.76 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 164373 0 0 0 345 31 0 0 15 0 22 0 530507842 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15688868 CPUtime=2.56 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 8221 0 0 0 185 71 0 0 15 0 22 0 530507843 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15688868 CPUtime=1.12 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) S 17003 17005 16197 0 -1 4202560 3696 0 0 0 112 0 0 0 15 0 22 0 530507846 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=15688868 CPUtime=0.99 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) S 17003 17005 16197 0 -1 4202560 10339 0 0 0 98 1 0 0 15 0 22 0 530507846 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) S 17003 17005 16197 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 530507846 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17024] ppid=17003 vsize=15688868 CPUtime=1166.57 cores=1,3,5,7
/proc/17005/task/17024/stat : 17024 (java) R 17003 17005 16197 0 -1 4202560 458227 0 0 0 116593 64 0 0 25 0 22 0 530507910 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506041203 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17025] ppid=17003 vsize=15688868 CPUtime=1165.86 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) R 17003 17005 16197 0 -1 4202560 476284 0 0 0 116524 62 0 0 25 0 22 0 530507910 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506040904 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15688868 CPUtime=1166.61 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) R 17003 17005 16197 0 -1 4202560 464528 0 0 0 116600 61 0 0 25 0 22 0 530507910 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505835741 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15688868 CPUtime=1165.45 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) R 17003 17005 16197 0 -1 4202560 455860 0 0 0 116483 62 0 0 25 0 22 0 530507910 16065400832 222147 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505979158 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4702.25
Current children cumulated vsize (KiB) 15688868



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.9 s]
/proc/loadavg: 8.27 8.11 7.68 9/220 17122
/proc/meminfo: memFree=29164912/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15688868 CPUtime=4800.16 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 3315091 0 1 0 479425 591 0 0 23 0 22 0 530507841 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3922217 204548 2296 9 0 3912936 0
[pid=17005/tid=17007] ppid=17003 vsize=15688868 CPUtime=1.73 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) S 17003 17005 16197 0 -1 4202560 35692 0 1 0 168 5 0 0 22 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15688868 CPUtime=3.93 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 163743 0 0 0 363 30 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15688868 CPUtime=4.05 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 182878 0 0 0 373 32 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15688868 CPUtime=4.03 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 182356 0 0 0 370 33 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15688868 CPUtime=4.03 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 167579 0 0 0 372 31 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15688868 CPUtime=3.83 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 163366 0 0 0 355 28 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15688868 CPUtime=4.05 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 174380 0 0 0 373 32 0 0 16 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15688868 CPUtime=4.09 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 171228 0 0 0 375 34 0 0 16 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15688868 CPUtime=3.83 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 165522 0 0 0 352 31 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15688868 CPUtime=2.61 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 8398 0 0 0 189 72 0 0 16 0 22 0 530507843 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15688868 CPUtime=1.12 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) S 17003 17005 16197 0 -1 4202560 3696 0 0 0 112 0 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=15688868 CPUtime=0.99 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) S 17003 17005 16197 0 -1 4202560 10339 0 0 0 98 1 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) S 17003 17005 16197 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17024] ppid=17003 vsize=15688868 CPUtime=1190.92 cores=1,3,5,7
/proc/17005/task/17024/stat : 17024 (java) R 17003 17005 16197 0 -1 4202560 465122 0 0 0 119027 65 0 0 19 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506148562 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=17005/tid=17025] ppid=17003 vsize=15688868 CPUtime=1190.21 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) R 17003 17005 16197 0 -1 4202560 484335 0 0 0 118958 63 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505979309 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15688868 CPUtime=1190.78 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) R 17003 17005 16197 0 -1 4202560 470496 0 0 0 119016 62 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506112575 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15688868 CPUtime=1189.79 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) R 17003 17005 16197 0 -1 4202560 464512 0 0 0 118916 63 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506013440 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 15688868

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.9 s]
/proc/loadavg: 8.27 8.11 7.68 9/220 17122
/proc/meminfo: memFree=29164912/32951124 swapFree=67111448/67111528
[pid=17005] ppid=17003 vsize=15688868 CPUtime=4800.16 cores=1,3,5,7
/proc/17005/stat : 17005 (java) S 17003 17005 16197 0 -1 4202496 3315091 0 1 0 479425 591 0 0 23 0 22 0 530507841 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17005/statm: 3922217 204548 2296 9 0 3912936 0
[pid=17005/tid=17007] ppid=17003 vsize=15688868 CPUtime=1.73 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) S 17003 17005 16197 0 -1 4202560 35692 0 1 0 168 5 0 0 22 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=15688868 CPUtime=3.93 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) S 17003 17005 16197 0 -1 4202560 163743 0 0 0 363 30 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=15688868 CPUtime=4.05 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) S 17003 17005 16197 0 -1 4202560 182878 0 0 0 373 32 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=15688868 CPUtime=4.03 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) S 17003 17005 16197 0 -1 4202560 182356 0 0 0 370 33 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=15688868 CPUtime=4.03 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) S 17003 17005 16197 0 -1 4202560 167579 0 0 0 372 31 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=15688868 CPUtime=3.83 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) S 17003 17005 16197 0 -1 4202560 163366 0 0 0 355 28 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 7 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=15688868 CPUtime=4.05 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) S 17003 17005 16197 0 -1 4202560 174380 0 0 0 373 32 0 0 16 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=15688868 CPUtime=4.09 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) S 17003 17005 16197 0 -1 4202560 171228 0 0 0 375 34 0 0 16 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=15688868 CPUtime=3.83 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) S 17003 17005 16197 0 -1 4202560 165522 0 0 0 352 31 0 0 15 0 22 0 530507842 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=15688868 CPUtime=2.61 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) S 17003 17005 16197 0 -1 4202560 8398 0 0 0 189 72 0 0 16 0 22 0 530507843 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 0 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) S 17003 17005 16197 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) S 17003 17005 16197 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530507844 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820989361 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=15688868 CPUtime=1.12 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) S 17003 17005 16197 0 -1 4202560 3696 0 0 0 112 0 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=15688868 CPUtime=0.99 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) S 17003 17005 16197 0 -1 4202560 10339 0 0 0 98 1 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 1 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) S 17003 17005 16197 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820981657 0 4 0 16800975 18446604471106840512 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=15688868 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) S 17003 17005 16197 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 530507846 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 230820982272 0 4 0 16800975 18446604471106840512 0 0 -1 3 0 0 0
[pid=17005/tid=17024] ppid=17003 vsize=15688868 CPUtime=1190.92 cores=1,3,5,7
/proc/17005/task/17024/stat : 17024 (java) R 17003 17005 16197 0 -1 4202560 465122 0 0 0 119027 65 0 0 19 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506148562 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=17005/tid=17025] ppid=17003 vsize=15688868 CPUtime=1190.21 cores=1,3,5,7
/proc/17005/task/17025/stat : 17025 (java) R 17003 17005 16197 0 -1 4202560 484335 0 0 0 118958 63 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912505979309 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17005/tid=17026] ppid=17003 vsize=15688868 CPUtime=1190.78 cores=1,3,5,7
/proc/17005/task/17026/stat : 17026 (java) R 17003 17005 16197 0 -1 4202560 470496 0 0 0 119016 62 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506112575 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17005/tid=17027] ppid=17003 vsize=15688868 CPUtime=1189.79 cores=1,3,5,7
/proc/17005/task/17027/stat : 17027 (java) R 17003 17005 16197 0 -1 4202560 464512 0 0 0 118916 63 0 0 25 0 22 0 530507910 16065400832 204548 33554432000 1073741824 1073778376 140735150280928 18446744073709551615 46912506013440 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 15688868

Child status: 143
Real time (s): 1206.95
CPU time (s): 4800.23
CPU user time (s): 4794.28
CPU system time (s): 5.9471
CPU usage (%): 397.715
Max. virtual memory (cumulated for all children) (KiB): 15689160

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.28
system time used= 5.9471
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3315118
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 119133
involuntary context switches= 89276

runsolver used 2.06569 second user time and 4.5913 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-30 20:44:34
IDJOB=3312919
IDBENCH=88218
IDSOLVER=1699
FILE ID=node104/3312919-1304189074
RUNJOBID= node104-1304187865-16686
PBS_JOBID= 13172466
Free space on /tmp= 72428 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312919-1304189074/watcher-3312919-1304189074 -o /tmp/evaluation-result-3312919-1304189074/solver-3312919-1304189074 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312919-1304189074.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c86ce640ddb0138bf41ccc37bc6fcf28
RANDOM SEED=1634376091

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17333524 kB
Buffers:        431836 kB
Cached:        1278252 kB
SwapCached:         80 kB
Active:       13760732 kB
Inactive:      1421308 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17333524 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            3228 kB
Writeback:           0 kB
AnonPages:    13471912 kB
Mapped:          23476 kB
Slab:           345668 kB
PageTables:      30636 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 15250712 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72536 MiB
End job on node104 at 2011-04-30 21:04:43