Trace number 3312643

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.32 1207.33

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1980280938-088.UNKNOWN.cnf
MD5SUM4fa782cc700b96dfddf41b0ed3b14006
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.10/0.12	29:21 INFO : Reading from input HOME/instance-3312643-1304126961.cnf
0.52/0.34	Executor set job limit to 1000000
0.52/0.34	Executor set job limit to 1000000
0.52/0.34	Executor set job limit to 1000000
0.52/0.34	Executor set job limit to 1000000
0.52/0.34	Starting Executor!
0.52/0.34	Starting Executor!
0.52/0.34	Starting Executor!
0.52/0.34	Starting Executor!
0.93/0.57	29:21 INFO : 80 variables remaining out of 80
0.93/0.57	29:21 INFO : 56960 literals remaining out of 56960

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312643-1304126961/watcher-3312643-1304126961 -o /tmp/evaluation-result-3312643-1304126961/solver-3312643-1304126961 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312643-1304126961.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.06 8.01 5/198 23024
/proc/meminfo: memFree=17306868/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/23024/stat : 23024 (java) R 23022 23024 22629 0 -1 4202496 1165 0 0 0 0 0 0 0 25 0 1 0 524298681 23580672 652 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216629552896 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23024/statm: 5757 665 492 9 0 124 0

[startup+0.0728281 s]
/proc/loadavg: 8.13 8.06 8.01 5/198 23024
/proc/meminfo: memFree=17306868/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15609780 CPUtime=0.05 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 4401 0 1 0 5 0 0 0 25 0 18 0 524298681 15984414720 3841 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3902445 3841 1779 9 0 3893164 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609780

[startup+0.103102 s]
/proc/loadavg: 8.13 8.06 8.01 5/198 23024
/proc/meminfo: memFree=17306868/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15676880 CPUtime=0.1 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 5550 0 1 0 9 1 0 0 25 0 18 0 524298681 16053125120 4981 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3919220 4981 2117 9 0 3909939 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676880

[startup+0.30106 s]
/proc/loadavg: 8.13 8.06 8.01 5/198 23024
/proc/meminfo: memFree=17306868/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15680736 CPUtime=0.52 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 14328 0 1 0 49 3 0 0 25 0 18 0 524298681 16057073664 12706 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3920184 12710 2208 9 0 3910903 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15680736

[startup+0.751966 s]
/proc/loadavg: 8.13 8.06 8.01 5/198 23024
/proc/meminfo: memFree=17306868/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15706156 CPUtime=1.74 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 33329 0 1 0 169 5 0 0 25 0 22 0 524298681 16083103744 27720 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3926539 27720 2259 9 0 3917258 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 15706156

[startup+1.50081 s]
/proc/loadavg: 8.13 8.06 8.01 10/220 23046
/proc/meminfo: memFree=17163720/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=4.67 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 61756 0 1 0 458 9 0 0 25 0 22 0 524298681 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 52450 2274 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 730 0 0 0 0 0 0 0 15 0 22 0 524298682 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 1801 0 0 0 0 0 0 0 16 0 22 0 524298682 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 414 0 0 0 0 0 0 0 15 0 22 0 524298682 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 457 0 0 0 0 0 0 0 17 0 22 0 524298682 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 783 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 1078 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 12 0 0 0 0 0 0 0 15 0 22 0 524298684 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) R 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 22 0 524298684 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=0.67 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) R 23022 23024 22629 0 -1 4202560 5118 0 0 0 67 0 0 0 18 0 22 0 524298686 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 47823034910132 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23040] ppid=23022 vsize=15703536 CPUtime=0.8 cores=0,2,4,6
/proc/23024/task/23040/stat : 23040 (java) R 23022 23024 22629 0 -1 4202560 14592 0 0 0 78 2 0 0 17 0 22 0 524298686 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 47823040176823 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23041] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23041/stat : 23041 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23042] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23042/stat : 23042 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524298686 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23043] ppid=23022 vsize=15703536 CPUtime=0.64 cores=0,2,4,6
/proc/23024/task/23043/stat : 23043 (java) R 23022 23024 22629 0 -1 4202560 2449 0 0 0 64 0 0 0 16 0 22 0 524298715 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 47823035745162 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=0.63 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 6894 0 0 0 63 0 0 0 16 0 22 0 524298715 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 47823038811769 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=0.66 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 7082 0 0 0 65 1 0 0 17 0 22 0 524298715 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505212358 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=0.64 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 3937 0 0 0 64 0 0 0 17 0 22 0 524298715 16080420864 52450 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505719459 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.67
Current children cumulated vsize (KiB) 15703536

[startup+3.10153 s]
/proc/loadavg: 8.13 8.06 8.01 10/220 23046
/proc/meminfo: memFree=17102588/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=11.05 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 95051 0 1 0 1092 13 0 0 25 0 22 0 524298681 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 85729 2289 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 1856 0 0 0 0 0 0 0 16 0 22 0 524298682 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=0.01 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 2965 0 0 0 1 0 0 0 15 0 22 0 524298682 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 1386 0 0 0 0 0 0 0 16 0 22 0 524298682 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 779 0 0 0 0 0 0 0 15 0 22 0 524298682 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 1534 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 718 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 1431 0 0 0 0 0 0 0 16 0 22 0 524298683 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 1855 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 202 0 0 0 0 0 0 0 15 0 22 0 524298684 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) S 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524298684 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=0.99 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) S 23022 23024 22629 0 -1 4202560 5173 0 0 0 99 0 0 0 15 0 22 0 524298686 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23040] ppid=23022 vsize=15703536 CPUtime=1.06 cores=0,2,4,6
/proc/23024/task/23040/stat : 23040 (java) S 23022 23024 22629 0 -1 4202560 14635 0 0 0 104 2 0 0 17 0 22 0 524298686 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23041] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23041/stat : 23041 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23042] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23042/stat : 23042 (java) R 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 524298686 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23024/tid=23043] ppid=23022 vsize=15703536 CPUtime=2.22 cores=0,2,4,6
/proc/23024/task/23043/stat : 23043 (java) R 23022 23024 22629 0 -1 4202560 8798 0 0 0 222 0 0 0 17 0 22 0 524298715 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505818288 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=1.89 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 13895 0 0 0 189 0 0 0 17 0 22 0 524298715 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505817816 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=2.13 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 13377 0 0 0 212 1 0 0 18 0 22 0 524298715 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505873957 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=2.05 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 10039 0 0 0 205 0 0 0 19 0 22 0 524298715 16080420864 85729 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505910872 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.05
Current children cumulated vsize (KiB) 15703536

[startup+6.30097 s]
/proc/loadavg: 8.28 8.09 8.02 10/220 23047
/proc/meminfo: memFree=16965576/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=23.8 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 98425 0 1 0 2366 14 0 0 25 0 22 0 524298681 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 86643 2289 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 2162 0 0 0 0 0 0 0 15 0 22 0 524298682 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=0.01 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 3261 0 0 0 1 0 0 0 16 0 22 0 524298682 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 1642 0 0 0 0 0 0 0 16 0 22 0 524298682 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 1395 0 0 0 0 0 0 0 15 0 22 0 524298682 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 1970 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 1222 0 0 0 0 0 0 0 16 0 22 0 524298683 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 1915 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 2191 0 0 0 0 0 0 0 15 0 22 0 524298683 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 202 0 0 0 0 0 0 0 15 0 22 0 524298684 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) S 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524298684 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=1.09 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) S 23022 23024 22629 0 -1 4202560 5190 0 0 0 109 0 0 0 15 0 22 0 524298686 16080420864 86643 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=1108.1 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 165607 0 0 0 110780 30 0 0 25 0 22 0 524298715 16080420864 78131 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505874442 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=1108.02 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 166942 0 0 0 110770 32 0 0 25 0 22 0 524298715 16080420864 78131 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505818313 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=1107.87 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 161614 0 0 0 110759 28 0 0 25 0 22 0 524298715 16080420864 78131 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505699072 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4462.34
Current children cumulated vsize (KiB) 15703536

[startup+1182.3 s]
/proc/loadavg: 4.07 5.78 7.07 5/193 23098
/proc/meminfo: memFree=17598156/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=4700.88 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 1298425 0 1 0 469754 334 0 0 25 0 22 0 524298681 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 75730 2299 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=3.28 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 68403 0 0 0 312 16 0 0 15 0 22 0 524298682 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=3.3 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 71488 0 0 0 315 15 0 0 15 0 22 0 524298682 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=3.26 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 68045 0 0 0 311 15 0 0 15 0 22 0 524298682 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=3.31 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 67441 0 0 0 316 15 0 0 15 0 22 0 524298682 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=3.29 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 69899 0 0 0 313 16 0 0 16 0 22 0 524298683 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=3.38 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 70452 0 0 0 319 19 0 0 16 0 22 0 524298683 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=3.32 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 71701 0 0 0 316 16 0 0 15 0 22 0 524298683 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=3.24 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 69593 0 0 0 309 15 0 0 16 0 22 0 524298683 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=2.02 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 3461 0 0 0 138 64 0 0 15 0 22 0 524298684 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) S 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524298684 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=1.15 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) S 23022 23024 22629 0 -1 4202560 5204 0 0 0 115 0 0 0 16 0 22 0 524298686 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23040] ppid=23022 vsize=15703536 CPUtime=1.1 cores=0,2,4,6
/proc/23024/task/23040/stat : 23040 (java) S 23022 23024 22629 0 -1 4202560 14640 0 0 0 108 2 0 0 16 0 22 0 524298686 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23041] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23041/stat : 23041 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23042] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23042/stat : 23042 (java) S 23022 23024 22629 0 -1 4202560 62 0 0 0 0 0 0 0 15 0 22 0 524298686 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23043] ppid=23022 vsize=15703536 CPUtime=1167.58 cores=0,2,4,6
/proc/23024/task/23043/stat : 23043 (java) R 23022 23024 22629 0 -1 4202560 173977 0 0 0 116723 35 0 0 25 0 22 0 524298715 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 18446744073699066094 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=1167.4 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 176757 0 0 0 116707 33 0 0 25 0 22 0 524298715 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505808952 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=1167.35 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 178469 0 0 0 116701 34 0 0 25 0 22 0 524298715 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505738690 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=1167.21 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 172426 0 0 0 116691 30 0 0 25 0 22 0 524298715 16080420864 75730 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505816899 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4700.88
Current children cumulated vsize (KiB) 15703536



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 4.04 5.61 6.97 5/193 23099
/proc/meminfo: memFree=17619360/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=4800.27 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 1323535 0 1 0 479685 342 0 0 25 0 22 0 524298681 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 72111 2299 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=3.34 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 70204 0 0 0 318 16 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=3.37 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 72960 0 0 0 321 16 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=3.32 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 69892 0 0 0 317 15 0 0 16 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=3.37 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 69298 0 0 0 322 15 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=3.36 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 72362 0 0 0 320 16 0 0 16 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=3.44 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 71683 0 0 0 325 19 0 0 16 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=3.38 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 73699 0 0 0 322 16 0 0 15 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=3.3 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 70555 0 0 0 315 15 0 0 15 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=2.05 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 3521 0 0 0 140 65 0 0 15 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) S 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=1.15 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) S 23022 23024 22629 0 -1 4202560 5204 0 0 0 115 0 0 0 16 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23040] ppid=23022 vsize=15703536 CPUtime=1.1 cores=0,2,4,6
/proc/23024/task/23040/stat : 23040 (java) S 23022 23024 22629 0 -1 4202560 14640 0 0 0 108 2 0 0 16 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23041] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23041/stat : 23041 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23042] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23042/stat : 23042 (java) S 23022 23024 22629 0 -1 4202560 62 0 0 0 0 0 0 0 15 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23043] ppid=23022 vsize=15703536 CPUtime=1192.28 cores=0,2,4,6
/proc/23024/task/23043/stat : 23043 (java) R 23022 23024 22629 0 -1 4202560 176949 0 0 0 119192 36 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505818397 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=1192.13 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 179478 0 0 0 119180 33 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505699040 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=1192.04 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 181352 0 0 0 119169 35 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505751964 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=1191.9 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 175269 0 0 0 119160 30 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505943880 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 15703536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.3 s]
/proc/loadavg: 4.04 5.61 6.97 5/193 23099
/proc/meminfo: memFree=17619360/32951124 swapFree=67111528/67111528
[pid=23024] ppid=23022 vsize=15703536 CPUtime=4800.27 cores=0,2,4,6
/proc/23024/stat : 23024 (java) S 23022 23024 22629 0 -1 4202496 1323535 0 1 0 479685 342 0 0 25 0 22 0 524298681 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23024/statm: 3925884 72111 2299 9 0 3916603 0
[pid=23024/tid=23026] ppid=23022 vsize=15703536 CPUtime=0.54 cores=0,2,4,6
/proc/23024/task/23026/stat : 23026 (java) S 23022 23024 22629 0 -1 4202560 15023 0 1 0 52 2 0 0 18 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23027] ppid=23022 vsize=15703536 CPUtime=3.34 cores=0,2,4,6
/proc/23024/task/23027/stat : 23027 (java) S 23022 23024 22629 0 -1 4202560 70204 0 0 0 318 16 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23028] ppid=23022 vsize=15703536 CPUtime=3.37 cores=0,2,4,6
/proc/23024/task/23028/stat : 23028 (java) S 23022 23024 22629 0 -1 4202560 72960 0 0 0 321 16 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23029] ppid=23022 vsize=15703536 CPUtime=3.32 cores=0,2,4,6
/proc/23024/task/23029/stat : 23029 (java) S 23022 23024 22629 0 -1 4202560 69892 0 0 0 317 15 0 0 16 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23030] ppid=23022 vsize=15703536 CPUtime=3.37 cores=0,2,4,6
/proc/23024/task/23030/stat : 23030 (java) S 23022 23024 22629 0 -1 4202560 69298 0 0 0 322 15 0 0 15 0 22 0 524298682 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23031] ppid=23022 vsize=15703536 CPUtime=3.36 cores=0,2,4,6
/proc/23024/task/23031/stat : 23031 (java) S 23022 23024 22629 0 -1 4202560 72362 0 0 0 320 16 0 0 16 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23032] ppid=23022 vsize=15703536 CPUtime=3.44 cores=0,2,4,6
/proc/23024/task/23032/stat : 23032 (java) S 23022 23024 22629 0 -1 4202560 71683 0 0 0 325 19 0 0 16 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23033] ppid=23022 vsize=15703536 CPUtime=3.38 cores=0,2,4,6
/proc/23024/task/23033/stat : 23033 (java) S 23022 23024 22629 0 -1 4202560 73699 0 0 0 322 16 0 0 15 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 4 0 0 0
[pid=23024/tid=23034] ppid=23022 vsize=15703536 CPUtime=3.3 cores=0,2,4,6
/proc/23024/task/23034/stat : 23034 (java) S 23022 23024 22629 0 -1 4202560 70555 0 0 0 315 15 0 0 15 0 22 0 524298683 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23035] ppid=23022 vsize=15703536 CPUtime=2.05 cores=0,2,4,6
/proc/23024/task/23035/stat : 23035 (java) S 23022 23024 22629 0 -1 4202560 3521 0 0 0 140 65 0 0 15 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 0 0 16800975 18446604453498227712 0 0 -1 2 0 0 0
[pid=23024/tid=23036] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23036/stat : 23036 (java) S 23022 23024 22629 0 -1 4202560 17 0 0 0 0 0 0 0 17 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23037] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23037/stat : 23037 (java) S 23022 23024 22629 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 524298684 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23038] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23038/stat : 23038 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646338993 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23039] ppid=23022 vsize=15703536 CPUtime=1.15 cores=0,2,4,6
/proc/23024/task/23039/stat : 23039 (java) S 23022 23024 22629 0 -1 4202560 5204 0 0 0 115 0 0 0 16 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 0 0 0 0
[pid=23024/tid=23040] ppid=23022 vsize=15703536 CPUtime=1.1 cores=0,2,4,6
/proc/23024/task/23040/stat : 23040 (java) S 23022 23024 22629 0 -1 4202560 14640 0 0 0 108 2 0 0 16 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23041] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23041/stat : 23041 (java) S 23022 23024 22629 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331289 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23042] ppid=23022 vsize=15703536 CPUtime=0 cores=0,2,4,6
/proc/23024/task/23042/stat : 23042 (java) S 23022 23024 22629 0 -1 4202560 62 0 0 0 0 0 0 0 15 0 22 0 524298686 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 216646331904 0 4 0 16800975 18446604453498227712 0 0 -1 6 0 0 0
[pid=23024/tid=23043] ppid=23022 vsize=15703536 CPUtime=1192.28 cores=0,2,4,6
/proc/23024/task/23043/stat : 23043 (java) R 23022 23024 22629 0 -1 4202560 176949 0 0 0 119192 36 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505818397 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23024/tid=23044] ppid=23022 vsize=15703536 CPUtime=1192.13 cores=0,2,4,6
/proc/23024/task/23044/stat : 23044 (java) R 23022 23024 22629 0 -1 4202560 179478 0 0 0 119180 33 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505699040 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23024/tid=23045] ppid=23022 vsize=15703536 CPUtime=1192.04 cores=0,2,4,6
/proc/23024/task/23045/stat : 23045 (java) R 23022 23024 22629 0 -1 4202560 181352 0 0 0 119169 35 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505751964 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23024/tid=23046] ppid=23022 vsize=15703536 CPUtime=1191.9 cores=0,2,4,6
/proc/23024/task/23046/stat : 23046 (java) R 23022 23024 22629 0 -1 4202560 175269 0 0 0 119160 30 0 0 25 0 22 0 524298715 16080420864 72111 33554432000 1073741824 1073778376 140736058193936 18446744073709551615 46912505943880 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 15703536

Child status: 143
Real time (s): 1207.33
CPU time (s): 4800.32
CPU user time (s): 4796.89
CPU system time (s): 3.43648
CPU usage (%): 397.598
Max. virtual memory (cumulated for all children) (KiB): 15706184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.88
system time used= 3.43648
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1323560
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 295593
involuntary context switches= 152914

runsolver used 2.06469 second user time and 4.56431 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-30 03:29:21
IDJOB=3312643
IDBENCH=82828
IDSOLVER=1699
FILE ID=node103/3312643-1304126961
RUNJOBID= node103-1304124271-22647
PBS_JOBID= 13170757
Free space on /tmp= 71516 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1980280938-088.UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312643-1304126961/watcher-3312643-1304126961 -o /tmp/evaluation-result-3312643-1304126961/solver-3312643-1304126961 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312643-1304126961.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4fa782cc700b96dfddf41b0ed3b14006
RANDOM SEED=1245707357

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17307140 kB
Buffers:       2149876 kB
Cached:       12252920 kB
SwapCached:          0 kB
Active:        6187856 kB
Inactive:      8870912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17307140 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1980 kB
Writeback:           0 kB
AnonPages:      655072 kB
Mapped:          23204 kB
Slab:           520344 kB
PageTables:       5964 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   881736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71516 MiB
End job on node103 at 2011-04-30 03:49:30