Trace number 3313459

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 2932.9 1302.58

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-7-ipc5-h15-unsat.cnf
MD5SUM0683489092a5eb0c881dd17c2c45d08e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables105623
Number of clauses374254
Sum of the clauses size911890
Maximum clause length43
Minimum clause length1
Number of clauses of size 1128
Number of clauses of size 2269133
Number of clauses of size 399944
Number of clauses of size 4407
Number of clauses of size 5309
Number of clauses of size over 54333

Solver Data 

0.10/0.11	46:30 INFO : Reading from input HOME/instance-3313459-1304073990.cnf
1.65/1.45	Executor set job limit to 1000000
1.65/1.45	Executor set job limit to 1000000
1.65/1.45	Executor set job limit to 1000000
1.65/1.45	Executor set job limit to 1000000
1.65/1.45	Starting Executor!
1.65/1.45	Starting Executor!
1.65/1.45	Starting Executor!
1.65/1.45	Starting Executor!
20.30/18.54	46:49 INFO : 104742 variables remaining out of 106701
20.30/18.54	46:49 INFO : 13237253 literals remaining out of 1286144

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313459-1304073990/watcher-3313459-1304073990 -o /tmp/evaluation-result-3313459-1304073990/solver-3313459-1304073990 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313459-1304073990.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.83 7.81 7.85 2/194 4059
/proc/meminfo: memFree=19965304/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=30528 CPUtime=0 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 1490 0 0 0 0 0 0 0 22 0 2 0 518998751 31260672 953 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 7632 953 733 9 0 383 0
[pid=4059/tid=4060] ppid=4057 vsize=30540 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 135 0 0 0 0 0 0 0 24 0 2 0 518998751 31272960 955 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237278879547 0 0 0 16784584 0 0 0 -1 2 0 0 0

[startup+0.022777 s]
/proc/loadavg: 6.83 7.81 7.85 2/194 4059
/proc/meminfo: memFree=19965304/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15602060 CPUtime=0.01 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 3379 0 1 0 1 0 0 0 22 0 11 0 518998751 15976509440 2821 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16784584 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3900515 2823 1619 9 0 3891263 0
[pid=4059/tid=4060] ppid=4057 vsize=15602060 CPUtime=0.01 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 2014 0 1 0 1 0 0 0 25 0 11 0 518998751 15976509440 2823 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616656545811 0 4 0 16784584 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15602060

[startup+0.100812 s]
/proc/loadavg: 6.83 7.81 7.85 2/194 4059
/proc/meminfo: memFree=19965304/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15677088 CPUtime=0.1 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 5645 0 1 0 10 0 0 0 22 0 18 0 518998751 16053338112 5085 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3919272 5085 2124 9 0 3909991 0
[pid=4059/tid=4060] ppid=4057 vsize=15677088 CPUtime=0.08 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 3518 0 1 0 8 0 0 0 25 0 18 0 518998751 16053338112 5085 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616657770763 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15677088

[startup+0.304731 s]
/proc/loadavg: 6.83 7.81 7.85 2/194 4059
/proc/meminfo: memFree=19965304/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15684256 CPUtime=0.53 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 16756 0 1 0 51 2 0 0 22 0 18 0 518998751 16060678144 15452 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3921064 15458 2207 9 0 3911783 0
[pid=4059/tid=4060] ppid=4057 vsize=15684256 CPUtime=0.29 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 11922 0 1 0 28 1 0 0 18 0 18 0 518998751 16060678144 15461 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 46912505641975 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 15684256

[startup+0.700659 s]
/proc/loadavg: 6.83 7.81 7.85 2/194 4059
/proc/meminfo: memFree=19965304/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15684256 CPUtime=0.93 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 41715 0 1 0 89 4 0 0 22 0 18 0 518998751 16060678144 40408 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3921064 40408 2223 9 0 3911783 0
[pid=4059/tid=4060] ppid=4057 vsize=15684256 CPUtime=0.68 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 35547 0 1 0 65 3 0 0 18 0 18 0 518998751 16060678144 40408 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290706379 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 15684256

[startup+1.50152 s]
/proc/loadavg: 6.83 7.81 7.85 8/216 4081
/proc/meminfo: memFree=19657692/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15688368 CPUtime=1.8 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 52280 0 1 0 174 6 0 0 22 0 22 0 518998751 16064888832 50954 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3922092 50964 2244 9 0 3912811 0
[pid=4059/tid=4060] ppid=4057 vsize=15688368 CPUtime=1.47 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 42880 0 1 0 142 5 0 0 20 0 22 0 518998751 16064888832 50969 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 46912505668097 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=4059/tid=4062] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4062/stat : 4062 (java) S 4057 4059 1762 0 -1 4202560 967 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 50975 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4063] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4063/stat : 4063 (java) S 4057 4059 1762 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 50981 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4064] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4064/stat : 4064 (java) S 4057 4059 1762 0 -1 4202560 28 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 50988 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4065] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4065/stat : 4065 (java) S 4057 4059 1762 0 -1 4202560 617 0 0 0 0 0 0 0 16 0 22 0 518998752 16064888832 50994 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4066] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4066/stat : 4066 (java) S 4057 4059 1762 0 -1 4202560 2127 0 0 0 0 0 0 0 16 0 22 0 518998752 16064888832 51001 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4067] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4067/stat : 4067 (java) S 4057 4059 1762 0 -1 4202560 540 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 51008 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4068] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4068/stat : 4068 (java) S 4057 4059 1762 0 -1 4202560 60 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 51013 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4069] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4069/stat : 4069 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 518998752 16064888832 51019 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4070] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4070/stat : 4070 (java) S 4057 4059 1762 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 22 0 518998753 16064888832 51026 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 0 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4071] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4071/stat : 4071 (java) S 4057 4059 1762 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 518998753 16064888832 51032 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4072] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 518998753 16064888832 51043 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16064888832 51048 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4074] ppid=4057 vsize=15688368 CPUtime=0.14 cores=0,2,4,6
/proc/4059/task/4074/stat : 4074 (java) R 4057 4059 1762 0 -1 4202560 1234 0 0 0 14 0 0 0 18 0 22 0 518998755 16064888832 51054 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616654995920 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=4059/tid=4075] ppid=4057 vsize=15688368 CPUtime=0.14 cores=0,2,4,6
/proc/4059/task/4075/stat : 4075 (java) R 4057 4059 1762 0 -1 4202560 2275 0 0 0 14 0 0 0 16 0 22 0 518998755 16064888832 51060 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616654244815 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16064888832 51067 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4077] ppid=4057 vsize=15688368 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4077/stat : 4077 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 518998755 16064888832 51074 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.8
Current children cumulated vsize (KiB) 15688368

[startup+3.10123 s]
/proc/loadavg: 6.83 7.81 7.85 9/220 4085
/proc/meminfo: memFree=19278988/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15695596 CPUtime=4.15 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 91432 0 1 0 405 10 0 0 22 0 22 0 518998751 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3923899 87551 2261 9 0 3914618 0
[pid=4059/tid=4060] ppid=4057 vsize=15695596 CPUtime=3.02 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 60859 0 1 0 296 6 0 0 25 0 22 0 518998751 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 46912505999422 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=4059/tid=4062] ppid=4057 vsize=15695596 CPUtime=0.03 cores=0,2,4,6
/proc/4059/task/4062/stat : 4062 (java) S 4057 4059 1762 0 -1 4202560 4266 0 0 0 3 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4063] ppid=4057 vsize=15695596 CPUtime=0.01 cores=0,2,4,6
/proc/4059/task/4063/stat : 4063 (java) S 4057 4059 1762 0 -1 4202560 637 0 0 0 1 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4064] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4064/stat : 4064 (java) S 4057 4059 1762 0 -1 4202560 57 0 0 0 0 0 0 0 15 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4065] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4065/stat : 4065 (java) S 4057 4059 1762 0 -1 4202560 617 0 0 0 0 0 0 0 15 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4066] ppid=4057 vsize=15695596 CPUtime=0.04 cores=0,2,4,6
/proc/4059/task/4066/stat : 4066 (java) S 4057 4059 1762 0 -1 4202560 5149 0 0 0 4 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4067] ppid=4057 vsize=15695596 CPUtime=0.01 cores=0,2,4,6
/proc/4059/task/4067/stat : 4067 (java) S 4057 4059 1762 0 -1 4202560 1887 0 0 0 1 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4068] ppid=4057 vsize=15695596 CPUtime=0.03 cores=0,2,4,6
/proc/4059/task/4068/stat : 4068 (java) S 4057 4059 1762 0 -1 4202560 3952 0 0 0 3 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4069] ppid=4057 vsize=15695596 CPUtime=0.02 cores=0,2,4,6
/proc/4059/task/4069/stat : 4069 (java) S 4057 4059 1762 0 -1 4202560 2705 0 0 0 2 0 0 0 16 0 22 0 518998752 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4070] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4070/stat : 4070 (java) S 4057 4059 1762 0 -1 4202560 223 0 0 0 0 0 0 0 15 0 22 0 518998753 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 0 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4071] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4071/stat : 4071 (java) S 4057 4059 1762 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 518998753 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4072] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 518998753 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4074] ppid=4057 vsize=15695596 CPUtime=0.4 cores=0,2,4,6
/proc/4059/task/4074/stat : 4074 (java) S 4057 4059 1762 0 -1 4202560 4425 0 0 0 40 0 0 0 15 0 22 0 518998755 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4075] ppid=4057 vsize=15695596 CPUtime=0.5 cores=0,2,4,6
/proc/4059/task/4075/stat : 4075 (java) S 4057 4059 1762 0 -1 4202560 5201 0 0 0 50 0 0 0 16 0 22 0 518998755 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4077] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4077/stat : 4077 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 518998755 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4082] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4082/stat : 4082 (java) S 4057 4059 1762 0 -1 4202560 27 0 0 0 0 0 0 0 15 0 22 0 518998896 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4083] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4083/stat : 4083 (java) S 4057 4059 1762 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 22 0 518998896 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4084] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4084/stat : 4084 (java) S 4057 4059 1762 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 518998896 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4085] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4085/stat : 4085 (java) S 4057 4059 1762 0 -1 4202560 15 0 0 0 0 0 0 0 15 0 22 0 518998896 16072290304 87551 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.15
Current children cumulated vsize (KiB) 15695596

[startup+6.30066 s]
/proc/loadavg: 6.85 7.79 7.84 6/220 4085
/proc/meminfo: memFree=18529528/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15695596 CPUtime=7.51 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 91490 0 1 0 741 10 0 0 22 0 22 0 518998751 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3923899 87597 2274 9 0 3914618 0
[pid=4059/tid=4060] ppid=4057 vsize=15695596 CPUtime=6.22 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) R 4057 4059 1762 0 -1 4202560 60866 0 1 0 616 6 0 0 25 0 22 0 518998751 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 46912506068842 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=4059/tid=4062] ppid=4057 vsize=15695596 CPUtime=0.03 cores=0,2,4,6
/proc/4059/task/4062/stat : 4062 (java) S 4057 4059 1762 0 -1 4202560 4266 0 0 0 3 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4063] ppid=4057 vsize=15695596 CPUtime=0.01 cores=0,2,4,6
/proc/4059/task/4063/stat : 4063 (java) S 4057 4059 1762 0 -1 4202560 637 0 0 0 1 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4064] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4064/stat : 4064 (java) S 4057 4059 1762 0 -1 4202560 57 0 0 0 0 0 0 0 15 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4065] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4065/stat : 4065 (java) S 4057 4059 1762 0 -1 4202560 617 0 0 0 0 0 0 0 15 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4066] ppid=4057 vsize=15695596 CPUtime=0.04 cores=0,2,4,6
/proc/4059/task/4066/stat : 4066 (java) S 4057 4059 1762 0 -1 4202560 5149 0 0 0 4 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4067] ppid=4057 vsize=15695596 CPUtime=0.01 cores=0,2,4,6
/proc/4059/task/4067/stat : 4067 (java) S 4057 4059 1762 0 -1 4202560 1887 0 0 0 1 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4068] ppid=4057 vsize=15695596 CPUtime=0.03 cores=0,2,4,6
/proc/4059/task/4068/stat : 4068 (java) S 4057 4059 1762 0 -1 4202560 3952 0 0 0 3 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4069] ppid=4057 vsize=15695596 CPUtime=0.02 cores=0,2,4,6
/proc/4059/task/4069/stat : 4069 (java) S 4057 4059 1762 0 -1 4202560 2705 0 0 0 2 0 0 0 16 0 22 0 518998752 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4070] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4070/stat : 4070 (java) S 4057 4059 1762 0 -1 4202560 224 0 0 0 0 0 0 0 15 0 22 0 518998753 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 0 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4071] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4071/stat : 4071 (java) S 4057 4059 1762 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 518998753 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4072] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 518998753 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 87597 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=4059/tid=4072] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4074] ppid=4057 vsize=15695596 CPUtime=1.06 cores=0,2,4,6
/proc/4059/task/4074/stat : 4074 (java) S 4057 4059 1762 0 -1 4202560 4898 0 0 0 105 1 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4075] ppid=4057 vsize=15695596 CPUtime=1.01 cores=0,2,4,6
/proc/4059/task/4075/stat : 4075 (java) S 4057 4059 1762 0 -1 4202560 5264 0 0 0 101 0 0 0 16 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4077] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4077/stat : 4077 (java) S 4057 4059 1762 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4082] ppid=4057 vsize=15695596 CPUtime=556.86 cores=0,2,4,6
/proc/4059/task/4082/stat : 4082 (java) S 4057 4059 1762 0 -1 4202560 25237 0 0 0 55682 4 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4083] ppid=4057 vsize=15695596 CPUtime=501.44 cores=0,2,4,6
/proc/4059/task/4083/stat : 4083 (java) S 4057 4059 1762 0 -1 4202560 443 0 0 0 50144 0 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4084] ppid=4057 vsize=15695596 CPUtime=528.98 cores=0,2,4,6
/proc/4059/task/4084/stat : 4084 (java) S 4057 4059 1762 0 -1 4202560 10084 0 0 0 52897 1 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4085] ppid=4057 vsize=15695596 CPUtime=558.11 cores=0,2,4,6
/proc/4059/task/4085/stat : 4085 (java) S 4057 4059 1762 0 -1 4202560 31026 0 0 0 55806 5 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2812.54
Current children cumulated vsize (KiB) 15695596

[startup+1242.3 s]
/proc/loadavg: 3.05 4.86 6.26 2/193 4150
/proc/meminfo: memFree=4615084/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15695596 CPUtime=2872.6 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 3929861 0 1 0 286551 709 0 0 22 0 22 0 518998751 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3923899 3836704 2293 9 0 3914618 0
[pid=4059/tid=4060] ppid=4057 vsize=15695596 CPUtime=18.44 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) S 4057 4059 1762 0 -1 4202560 64720 0 1 0 1837 7 0 0 25 0 22 0 518998751 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4062] ppid=4057 vsize=15695596 CPUtime=7.84 cores=0,2,4,6
/proc/4059/task/4062/stat : 4062 (java) S 4057 4059 1762 0 -1 4202560 565472 0 0 0 685 99 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4063] ppid=4057 vsize=15695596 CPUtime=7.95 cores=0,2,4,6
/proc/4059/task/4063/stat : 4063 (java) S 4057 4059 1762 0 -1 4202560 470020 0 0 0 708 87 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4064] ppid=4057 vsize=15695596 CPUtime=7.14 cores=0,2,4,6
/proc/4059/task/4064/stat : 4064 (java) S 4057 4059 1762 0 -1 4202560 380298 0 0 0 648 66 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4065] ppid=4057 vsize=15695596 CPUtime=6.91 cores=0,2,4,6
/proc/4059/task/4065/stat : 4065 (java) S 4057 4059 1762 0 -1 4202560 421364 0 0 0 615 76 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4066] ppid=4057 vsize=15695596 CPUtime=6.78 cores=0,2,4,6
/proc/4059/task/4066/stat : 4066 (java) S 4057 4059 1762 0 -1 4202560 385026 0 0 0 610 68 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4067] ppid=4057 vsize=15695596 CPUtime=6.86 cores=0,2,4,6
/proc/4059/task/4067/stat : 4067 (java) S 4057 4059 1762 0 -1 4202560 530488 0 0 0 589 97 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4068] ppid=4057 vsize=15695596 CPUtime=7.86 cores=0,2,4,6
/proc/4059/task/4068/stat : 4068 (java) S 4057 4059 1762 0 -1 4202560 536487 0 0 0 690 96 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4069] ppid=4057 vsize=15695596 CPUtime=6.54 cores=0,2,4,6
/proc/4059/task/4069/stat : 4069 (java) S 4057 4059 1762 0 -1 4202560 358546 0 0 0 587 67 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4070] ppid=4057 vsize=15695596 CPUtime=648.57 cores=0,2,4,6
/proc/4059/task/4070/stat : 4070 (java) R 4057 4059 1762 0 -1 4202560 138826 0 0 0 64833 24 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616653449027 0 0 0 16800975 0 0 0 -1 0 0 0 0
[pid=4059/tid=4071] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4071/stat : 4071 (java) S 4057 4059 1762 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4072] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4074] ppid=4057 vsize=15695596 CPUtime=1.06 cores=0,2,4,6
/proc/4059/task/4074/stat : 4074 (java) S 4057 4059 1762 0 -1 4202560 4898 0 0 0 105 1 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4075] ppid=4057 vsize=15695596 CPUtime=1.01 cores=0,2,4,6
/proc/4059/task/4075/stat : 4075 (java) S 4057 4059 1762 0 -1 4202560 5264 0 0 0 101 0 0 0 16 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4077] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4077/stat : 4077 (java) S 4057 4059 1762 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4082] ppid=4057 vsize=15695596 CPUtime=556.88 cores=0,2,4,6
/proc/4059/task/4082/stat : 4082 (java) S 4057 4059 1762 0 -1 4202560 25291 0 0 0 55684 4 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4083] ppid=4057 vsize=15695596 CPUtime=501.46 cores=0,2,4,6
/proc/4059/task/4083/stat : 4083 (java) S 4057 4059 1762 0 -1 4202560 495 0 0 0 50145 1 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4084] ppid=4057 vsize=15695596 CPUtime=529 cores=0,2,4,6
/proc/4059/task/4084/stat : 4084 (java) S 4057 4059 1762 0 -1 4202560 10129 0 0 0 52898 2 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4085] ppid=4057 vsize=15695596 CPUtime=558.13 cores=0,2,4,6
/proc/4059/task/4085/stat : 4085 (java) S 4057 4059 1762 0 -1 4202560 31080 0 0 0 55807 6 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2872.6
Current children cumulated vsize (KiB) 15695596



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.86 4.23 5.96 3/193 4151
/proc/meminfo: memFree=4614760/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=15695596 CPUtime=2930.32 cores=0,2,4,6
/proc/4059/stat : 4059 (java) S 4057 4059 1762 0 -1 4202496 3930084 0 1 0 292320 712 0 0 22 0 22 0 518998751 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4059/statm: 3923899 3836704 2293 9 0 3914618 0
[pid=4059/tid=4060] ppid=4057 vsize=15695596 CPUtime=18.44 cores=0,2,4,6
/proc/4059/task/4060/stat : 4060 (java) S 4057 4059 1762 0 -1 4202560 64720 0 1 0 1837 7 0 0 25 0 22 0 518998751 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4062] ppid=4057 vsize=15695596 CPUtime=7.84 cores=0,2,4,6
/proc/4059/task/4062/stat : 4062 (java) S 4057 4059 1762 0 -1 4202560 565472 0 0 0 685 99 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4063] ppid=4057 vsize=15695596 CPUtime=7.95 cores=0,2,4,6
/proc/4059/task/4063/stat : 4063 (java) S 4057 4059 1762 0 -1 4202560 470020 0 0 0 708 87 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4064] ppid=4057 vsize=15695596 CPUtime=7.14 cores=0,2,4,6
/proc/4059/task/4064/stat : 4064 (java) S 4057 4059 1762 0 -1 4202560 380298 0 0 0 648 66 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4065] ppid=4057 vsize=15695596 CPUtime=6.91 cores=0,2,4,6
/proc/4059/task/4065/stat : 4065 (java) S 4057 4059 1762 0 -1 4202560 421364 0 0 0 615 76 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4066] ppid=4057 vsize=15695596 CPUtime=6.78 cores=0,2,4,6
/proc/4059/task/4066/stat : 4066 (java) S 4057 4059 1762 0 -1 4202560 385026 0 0 0 610 68 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4067] ppid=4057 vsize=15695596 CPUtime=6.86 cores=0,2,4,6
/proc/4059/task/4067/stat : 4067 (java) S 4057 4059 1762 0 -1 4202560 530488 0 0 0 589 97 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4068] ppid=4057 vsize=15695596 CPUtime=7.86 cores=0,2,4,6
/proc/4059/task/4068/stat : 4068 (java) S 4057 4059 1762 0 -1 4202560 536487 0 0 0 690 96 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4069] ppid=4057 vsize=15695596 CPUtime=6.54 cores=0,2,4,6
/proc/4059/task/4069/stat : 4069 (java) S 4057 4059 1762 0 -1 4202560 358546 0 0 0 587 67 0 0 16 0 22 0 518998752 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4070] ppid=4057 vsize=15695596 CPUtime=706.22 cores=0,2,4,6
/proc/4059/task/4070/stat : 4070 (java) R 4057 4059 1762 0 -1 4202560 138830 0 0 0 70595 27 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 47616653075033 0 0 0 16800975 0 0 0 -1 2 0 0 0
[pid=4059/tid=4071] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4071/stat : 4071 (java) S 4057 4059 1762 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4072] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4072/stat : 4072 (java) S 4057 4059 1762 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 518998753 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4073] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4073/stat : 4073 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290703281 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4074] ppid=4057 vsize=15695596 CPUtime=1.06 cores=0,2,4,6
/proc/4059/task/4074/stat : 4074 (java) S 4057 4059 1762 0 -1 4202560 4898 0 0 0 105 1 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4075] ppid=4057 vsize=15695596 CPUtime=1.01 cores=0,2,4,6
/proc/4059/task/4075/stat : 4075 (java) S 4057 4059 1762 0 -1 4202560 5264 0 0 0 101 0 0 0 16 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) S 4057 4059 1762 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 6 0 0 0
[pid=4059/tid=4077] ppid=4057 vsize=15695596 CPUtime=0 cores=0,2,4,6
/proc/4059/task/4077/stat : 4077 (java) S 4057 4059 1762 0 -1 4202560 77 0 0 0 0 0 0 0 15 0 22 0 518998755 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290696192 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4082] ppid=4057 vsize=15695596 CPUtime=556.9 cores=0,2,4,6
/proc/4059/task/4082/stat : 4082 (java) S 4057 4059 1762 0 -1 4202560 25347 0 0 0 55686 4 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
[pid=4059/tid=4083] ppid=4057 vsize=15695596 CPUtime=501.48 cores=0,2,4,6
/proc/4059/task/4083/stat : 4083 (java) S 4057 4059 1762 0 -1 4202560 534 0 0 0 50147 1 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 4 0 0 0
[pid=4059/tid=4084] ppid=4057 vsize=15695596 CPUtime=529.02 cores=0,2,4,6
/proc/4059/task/4084/stat : 4084 (java) S 4057 4059 1762 0 -1 4202560 10173 0 0 0 52900 2 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 2 0 0 0
[pid=4059/tid=4085] ppid=4057 vsize=15695596 CPUtime=558.15 cores=0,2,4,6
/proc/4059/task/4085/stat : 4085 (java) S 4057 4059 1762 0 -1 4202560 31156 0 0 0 55809 6 0 0 15 0 22 0 518998896 16072290304 3836704 33554432000 1073741824 1073778376 140735805743296 18446744073709551615 237290695577 0 4 0 16800975 18446604453937961088 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2930.32
Current children cumulated vsize (KiB) 15695596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -4059

[startup+1302.3 s]
/proc/loadavg: 1.86 4.23 5.96 2/194 4152
/proc/meminfo: memFree=4614256/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=0 CPUtime=2932.62 cores=0,2,4,6
/proc/4059/stat : 4059 (java) Z 4057 4059 1762 0 -1 4203548 3930097 0 1 0 292521 741 0 0 18 0 2 0 518998751 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/4059/statm: 0 0 0 0 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=0 CPUtime=0.28 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) R 4057 4059 1762 0 -1 4203588 1 0 0 0 0 28 0 0 18 0 2 0 518998755 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2932.62
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.4 s]
/proc/loadavg: 1.86 4.23 5.96 2/194 4152
/proc/meminfo: memFree=4614256/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=0 CPUtime=2932.72 cores=0,2,4,6
/proc/4059/stat : 4059 (java) Z 4057 4059 1762 0 -1 4203548 3930097 0 1 0 292521 751 0 0 18 0 2 0 518998751 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/4059/statm: 0 0 0 0 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=0 CPUtime=0.38 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) R 4057 4059 1762 0 -1 4203588 1 0 0 0 0 38 0 0 18 0 2 0 518998755 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2932.72
Current children cumulated vsize (KiB) 0

[startup+1302.5 s]
/proc/loadavg: 1.86 4.23 5.96 2/194 4152
/proc/meminfo: memFree=4614256/32950904 swapFree=67082284/67111528
[pid=4059] ppid=4057 vsize=0 CPUtime=2932.82 cores=0,2,4,6
/proc/4059/stat : 4059 (java) Z 4057 4059 1762 0 -1 4203548 3930097 0 1 0 292521 761 0 0 18 0 2 0 518998751 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/4059/statm: 0 0 0 0 0 0 0
[pid=4059/tid=4076] ppid=4057 vsize=0 CPUtime=0.48 cores=0,2,4,6
/proc/4059/task/4076/stat : 4076 (java) R 4057 4059 1762 0 -1 4203588 1 0 0 0 0 48 0 0 18 0 2 0 518998755 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2932.82
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.58
CPU time (s): 2932.9
CPU user time (s): 2925.22
CPU system time (s): 7.68783
CPU usage (%): 225.162
Max. virtual memory (cumulated for all children) (KiB): 15695596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2925.22
system time used= 7.68783
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3930097
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 51847
involuntary context switches= 60921

runsolver used 2.14567 second user time and 4.99724 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 12:46:30
IDJOB=3313459
IDBENCH=20406
IDSOLVER=1699
FILE ID=node121/3313459-1304073990
RUNJOBID= node121-1304073990-4022
PBS_JOBID= 13170425
Free space on /tmp= 72648 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-7-ipc5-h15-unsat.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313459-1304073990/watcher-3313459-1304073990 -o /tmp/evaluation-result-3313459-1304073990/solver-3313459-1304073990 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313459-1304073990.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0683489092a5eb0c881dd17c2c45d08e
RANDOM SEED=805672431

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19965460 kB
Buffers:       2181360 kB
Cached:       10229968 kB
SwapCached:       2776 kB
Active:        9134176 kB
Inactive:      3330352 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19965460 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           10156 kB
Writeback:          28 kB
AnonPages:       50328 kB
Mapped:          21728 kB
Slab:           456168 kB
PageTables:       4724 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   780708 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72648 MiB
End job on node121 at 2011-04-29 13:08:13