Trace number 3710444

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT4J PB specific settings 2.3.2 snapshot? (TO) 1800.07 1784.74

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Large/
normalized-minisat100_16_6_7_mh.opb
MD5SUM54f73c3b575712a1f6dc41b8a7ab2de4
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark12324240
Best CPU time to get the best result obtained on this benchmark1800.93
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables2000400
Total number of constraints4920807
Number of constraints which are clauses3910700
Number of constraints which are cardinality constraints (but not clauses)107
Number of constraints which are nor clauses,nor cardinality constraints1010000
Minimum length of a constraint2
Maximum length of a constraint14950
Number of terms in the objective function 1019800
Biggest coefficient in the objective function 168196608
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 361598548166
Number of bits of the sum of numbers in the objective function 39
Biggest number in a constraint 168196608
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 361598548166
Number of bits of the biggest sum of numbers39
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.08	c SAT4J: a SATisfiability library for Java (c) 2004-2012 Artois University and CNRS
0.00/0.08	c This is free software under the dual EPL/GNU LGPL licenses.
0.00/0.08	c See www.sat4j.org for details.
0.00/0.08	c This software uses some libraries from the Jakarta Commons project. See jakarta.apache.org for details.
0.06/0.09	c version 2.3.2.v20120418
0.06/0.09	c java.runtime.name	Java(TM) SE Runtime Environment
0.06/0.09	c java.vm.name		Java HotSpot(TM) 64-Bit Server VM
0.06/0.09	c java.vm.version	19.1-b02
0.06/0.09	c java.vm.vendor	Sun Microsystems Inc.
0.06/0.09	c sun.arch.data.model	64
0.06/0.09	c java.version		1.6.0_24
0.06/0.09	c os.name		Linux
0.06/0.09	c os.version		2.6.32-71.29.1.el6.x86_64
0.06/0.09	c os.arch		amd64
0.06/0.09	c Free memory 		501472288
0.06/0.09	c Max memory 		7480803328
0.06/0.09	c Total memory 		504102912
0.06/0.09	c Number of processors 	8
0.09/0.12	c read org.sat4j.minisat.orders.VarOrderHeap
0.09/0.12	c configuring ORDERS
0.09/0.12	c --- Begin Solver configuration ---
0.09/0.12	c org.sat4j.pb.constraints.CompetResolutionPBLongMixedWLClauseCardConstrDataStructure@742808b3
0.09/0.12	c Learn all clauses as in MiniSAT
0.09/0.12	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.09/0.12	c VSIDS like heuristics from MiniSAT using a heap phase appearing in latest learned clause
0.09/0.12	c Expensive reason simplification
0.09/0.12	c Armin Biere (Picosat) restarts strategy
0.09/0.12	c Glucose learned constraints deletion strategy
0.09/0.12	c timeout=2147483s
0.09/0.12	c DB Simplification allowed=true
0.09/0.12	c Heuristics kept accross calls (keep the solver "hot")
0.09/0.12	c --- End Solver configuration ---
0.09/0.12	c solving HOME/instance-3710444-1338242868.opb
0.09/0.12	c reading problem ... 
43.73/31.63	c ... done. Wall clock time 31.502s.
43.73/31.63	c declared #vars     2000400
43.73/31.63	c #constraints  4940611
43.73/31.63	c constraints type 
43.73/31.63	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 985151
43.73/31.63	c org.sat4j.minisat.constraints.cnf.UnitClauses => 3
43.73/31.63	c org.sat4j.minisat.constraints.card.MinWatchCard => 107
43.73/31.63	c ignored satisfied constraints => 3
43.73/31.63	c org.sat4j.minisat.constraints.cnf.OriginalBinaryClause => 2970100
43.73/31.63	c org.sat4j.pb.constraints.pb.MaxWatchPbLong => 985250
43.73/31.63	c 4940614 constraints processed.
1069.22/1056.00	c cleaning 2499 clauses out of 5000 with flag 5000/5000
1800.07/1784.71	c starts		: 30
1800.07/1784.71	c conflicts		: 8454
1800.07/1784.71	c decisions		: 417639
1800.07/1784.71	c propagations		: 256878785
1800.07/1784.71	c inspects		: 6197446370
1800.07/1784.71	c shortcuts		: 0
1800.07/1784.71	c learnt literals	: 0
1800.07/1784.71	c learnt binary clauses	: 1
1800.07/1784.71	c learnt ternary clauses	: 6
1800.07/1784.71	c learnt constraints	: 8454
1800.07/1784.71	c ignored constraints	: 0
1800.07/1784.71	c root simplifications	: 30
1800.07/1784.71	c removed literals (reason simplification)	: 410086
1800.07/1784.71	c reason swapping (by a shorter reason)	: 0
1800.07/1784.71	c Calls to reduceDB	: 1
1800.07/1784.71	c number of reductions to clauses (during analyze)	: 0
1800.07/1784.71	c number of learned constraints concerned by reduction	: 0
1800.07/1784.71	c number of learning phase by resolution	: 0
1800.07/1784.71	c number of learning phase by cutting planes	: 0
1800.07/1784.71	c speed (assignments/second)	: 146544.20192708125
1800.07/1784.71	c non guided choices	6484
1800.07/1784.71	c learnt constraints type 
1800.07/1784.71	c org.sat4j.minisat.constraints.cnf.LearntBinaryClause => 1
1800.07/1784.71	c org.sat4j.minisat.constraints.cnf.LearntWLClause => 5954
1800.07/1784.71	c constraints type 
1800.07/1784.71	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 985151
1800.07/1784.71	c org.sat4j.minisat.constraints.cnf.UnitClauses => 3
1800.07/1784.71	c org.sat4j.minisat.constraints.card.MinWatchCard => 107
1800.07/1784.71	c ignored satisfied constraints => 3
1800.07/1784.71	c org.sat4j.minisat.constraints.cnf.OriginalBinaryClause => 2970100
1800.07/1784.71	c org.sat4j.pb.constraints.pb.MaxWatchPbLong => 985250
1800.07/1784.71	c 4940614 constraints processed.
1800.07/1784.71	s UNKNOWN
1800.07/1784.71	c Total wall clock time (in seconds): 1784.591

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3710444-1338242868/watcher-3710444-1338242868 -o /tmp/evaluation-result-3710444-1338242868/solver-3710444-1338242868 -C 1800 -W 1900 -M 15500 java -jar HOME/sat4j-sat.jar -opt -s Resolution -S ORDERS=VarOrderHeap -hot -y HOME/instance-3710444-1338242868.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/171 667
/proc/meminfo: memFree=29313312/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=272 CPUtime=0 cores=1,3,5,7
/proc/667/stat : 667 (java) D 665 667 31663 0 -1 4202496 80 0 0 0 0 0 0 0 20 0 1 0 290412759 278528 33 33554432000 1073741824 1073778376 140736964217968 140736964215144 252253924647 0 0 4096 0 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/667/statm: 68 33 25 9 0 25 0

[startup+0.0911391 s]
/proc/loadavg: 2.00 2.00 2.00 2/171 667
/proc/meminfo: memFree=29313312/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=0.06 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 3717 0 1 0 6 0 0 0 20 0 18 0 290412759 9787842560 4417 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 4421 1938 9 0 2380296 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 9558440

[startup+0.100344 s]
/proc/loadavg: 2.00 2.00 2.00 2/171 667
/proc/meminfo: memFree=29313312/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=0.09 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 4284 0 1 0 8 1 0 0 20 0 18 0 290412759 9787842560 4981 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 4981 2113 9 0 2380296 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9558440

[startup+0.300361 s]
/proc/loadavg: 2.00 2.00 2.00 2/171 667
/proc/meminfo: memFree=29313312/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=0.45 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 5635 0 1 0 43 2 0 0 20 0 18 0 290412759 9787842560 21550 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 21550 2223 9 0 2380296 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 9558440

[startup+0.700361 s]
/proc/loadavg: 2.00 2.00 2.00 2/171 667
/proc/meminfo: memFree=29313312/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=0.99 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 5826 0 1 0 93 6 0 0 20 0 18 0 290412759 9787842560 52389 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 52389 2239 9 0 2380296 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 9558440

[startup+1.50077 s]
/proc/loadavg: 2.00 2.00 2.00 2/189 686
/proc/meminfo: memFree=29070736/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=1.91 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 6244 0 1 0 182 9 0 0 20 0 18 0 290412759 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 67088 2239 9 0 2380296 0
[pid=667/tid=669] ppid=665 vsize=9558440 CPUtime=1.36 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) R 665 667 31663 0 -1 4202560 2611 0 1 0 133 3 0 0 20 0 18 0 290412761 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136739225456 252266472717 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9558440 CPUtime=0.05 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) S 665 667 31663 0 -1 4202560 249 0 0 0 4 1 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136582871720 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9558440 CPUtime=0.02 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) S 665 667 31663 0 -1 4202560 15 0 0 0 2 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136581819176 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9558440 CPUtime=0.02 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) S 665 667 31663 0 -1 4202560 11 0 0 0 2 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136580766632 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9558440 CPUtime=0.04 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) S 665 667 31663 0 -1 4202560 66 0 0 0 4 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136579714088 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9558440 CPUtime=0.02 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) S 665 667 31663 0 -1 4202560 19 0 0 0 2 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136578660520 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9558440 CPUtime=0.01 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) S 665 667 31663 0 -1 4202560 64 0 0 0 1 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136577607976 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9558440 CPUtime=0.02 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) S 665 667 31663 0 -1 4202560 14 0 0 0 2 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136576555432 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9558440 CPUtime=0.06 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) S 665 667 31663 0 -1 4202560 66 0 0 0 6 0 0 0 20 0 18 0 290412762 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136575502888 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 70 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136563305064 252266461097 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9558440 CPUtime=0.09 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 980 0 0 0 9 0 0 0 20 0 18 0 290412766 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9558440 CPUtime=0.06 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 905 0 0 0 6 0 0 0 20 0 18 0 290412766 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 67088 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1.91
Current children cumulated vsize (KiB) 9558440

[startup+3.1008 s]
/proc/loadavg: 2.00 2.00 2.00 5/188 693
/proc/meminfo: memFree=28901000/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=4.47 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 8458 0 1 0 413 34 0 0 20 0 18 0 290412759 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 185982 2244 9 0 2380296 0
[pid=667/tid=669] ppid=665 vsize=9558440 CPUtime=2.67 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) R 665 667 31663 0 -1 4202560 2933 0 1 0 258 9 0 0 20 0 18 0 290412761 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136739225440 252266472717 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9558440 CPUtime=0.19 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) S 665 667 31663 0 -1 4202560 414 0 0 0 16 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136582871720 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9558440 CPUtime=0.16 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) S 665 667 31663 0 -1 4202560 72 0 0 0 13 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136581819176 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9558440 CPUtime=0.18 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) S 665 667 31663 0 -1 4202560 80 0 0 0 15 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136580766632 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9558440 CPUtime=0.14 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) S 665 667 31663 0 -1 4202560 404 0 0 0 11 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136579714088 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9558440 CPUtime=0.15 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) S 665 667 31663 0 -1 4202560 69 0 0 0 12 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136578660520 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9558440 CPUtime=0.19 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) S 665 667 31663 0 -1 4202560 383 0 0 0 15 4 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136577607976 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9558440 CPUtime=0.14 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) S 665 667 31663 0 -1 4202560 65 0 0 0 12 2 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136576555432 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9558440 CPUtime=0.2 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) S 665 667 31663 0 -1 4202560 136 0 0 0 17 3 0 0 20 0 18 0 290412762 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136575502888 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 495 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136563305064 252266461097 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9558440 CPUtime=0.16 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 1252 0 0 0 16 0 0 0 20 0 18 0 290412766 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9558440 CPUtime=0.11 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 981 0 0 0 11 0 0 0 20 0 18 0 290412766 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 185982 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 4.47
Current children cumulated vsize (KiB) 9558440

[startup+6.30067 s]
/proc/loadavg: 2.00 2.00 2.00 3/188 693
/proc/meminfo: memFree=27894400/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=10.7 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 19278 0 1 0 986 84 0 0 20 0 18 0 290412759 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 393021 2272 9 0 2380296 0
[pid=667/tid=669] ppid=665 vsize=9558440 CPUtime=4.99 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) S 665 667 31663 0 -1 4202560 3646 0 1 0 480 19 0 0 20 0 18 0 290412761 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136739233240 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9558440 CPUtime=0.72 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) R 665 667 31663 0 -1 4202560 512 0 0 0 64 8 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136582871896 140136741705401 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9558440 CPUtime=0.52 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) D 665 667 31663 0 -1 4202560 752 0 0 0 45 7 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136581818936 252263130087 0 4 0 16800975 18446744071581355491 0 0 -1 1 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9558440 CPUtime=0.63 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) R 665 667 31663 0 -1 4202560 881 0 0 0 54 9 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136580766512 140136741705401 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9558440 CPUtime=0.69 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) D 665 667 31663 0 -1 4202560 519 0 0 0 60 9 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136579714264 140136741705417 0 4 0 16800975 18446744071581355444 0 0 -1 3 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9558440 CPUtime=0.62 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) R 665 667 31663 0 -1 4202560 191 0 0 0 54 8 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136578660696 140136741705401 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9558440 CPUtime=0.64 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) D 665 667 31663 0 -1 4202560 482 0 0 0 56 8 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136577608152 140136741705401 0 4 0 16800975 18446744071581355444 0 0 -1 5 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9558440 CPUtime=0.5 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) R 665 667 31663 0 -1 4202560 1183 0 0 0 44 6 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136576555608 140136742991692 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9558440 CPUtime=0.48 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) D 665 667 31663 0 -1 4202560 666 0 0 0 42 6 0 0 20 0 18 0 290412762 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136575502648 140136741705417 0 4 0 16800975 18446744071581355444 0 0 -1 1 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 1038 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136563303944 252266460220 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 18 0 290412763 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 393021 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9558440 CPUtime=0.38 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 4555 0 0 0 37 1 0 0 20 0 18 0 290412766 9787842560 393022 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9558440 CPUtime=0.35 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 3681 0 0 0 35 0 0 0 20 0 18 0 290412766 9787842560 393022 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 393022 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9558440 CPUtime=0 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 290412766 9787842560 393022 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 10.7
Current children cumulated vsize (KiB) 9558440

[startup+12.7007 s]
/proc/loadavg: 1.92 1.98 1.99 10/208 741
/proc/meminfo: memFree=26287936/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9558440 CPUtime=20.43 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 24650 0 1 0 1905 138 0 0 20 0 18 0 290412759 9787842560 694447 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2389610 694447 2280 9 0 2380296 0
[pid=667/tid=669] ppid=665 vsize=9558440 CPUtime=9.03 cores=1,3,5,7

################
# More data... #
################

[pid=667/tid=683] ppid=665 vsize=9625004 CPUtime=0.87 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 4655 0 0 0 85 2 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9625004 CPUtime=0.68 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 3730 0 0 0 68 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9625004 CPUtime=1.01 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 99 0 0 0 44 57 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=744] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/744/stat : 744 (java) S 665 667 31663 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 290415940 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136554882344 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1737.63
Current children cumulated vsize (KiB) 9625004

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/211 760
/proc/meminfo: memFree=22975988/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9625004 CPUtime=1797.66 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 36465 0 1 0 179464 302 0 0 20 0 19 0 290412759 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2406251 940976 2291 9 0 2396937 0
[pid=667/tid=669] ppid=665 vsize=9625004 CPUtime=1765.88 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) R 665 667 31663 0 -1 4202560 4085 0 1 0 176514 74 0 0 20 0 19 0 290412761 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136739233944 140136612210455 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9625004 CPUtime=2.14 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) S 665 667 31663 0 -1 4202560 2773 0 0 0 193 21 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136582871720 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9625004 CPUtime=2.11 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) S 665 667 31663 0 -1 4202560 2130 0 0 0 192 19 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136581819176 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9625004 CPUtime=2.12 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) S 665 667 31663 0 -1 4202560 4457 0 0 0 189 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136580766632 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9625004 CPUtime=2.22 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) S 665 667 31663 0 -1 4202560 3591 0 0 0 194 28 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136579714088 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9625004 CPUtime=2.34 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) S 665 667 31663 0 -1 4202560 1645 0 0 0 211 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136578660520 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9625004 CPUtime=2.19 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) S 665 667 31663 0 -1 4202560 1812 0 0 0 197 22 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136577607976 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9625004 CPUtime=1.86 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) S 665 667 31663 0 -1 4202560 2278 0 0 0 168 18 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136576555432 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9625004 CPUtime=2.2 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) S 665 667 31663 0 -1 4202560 1848 0 0 0 195 25 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136575502888 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9625004 CPUtime=7.39 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 2178 0 0 0 731 8 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136563305064 252266461097 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9625004 CPUtime=0.87 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 4655 0 0 0 85 2 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9625004 CPUtime=0.68 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 3730 0 0 0 68 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9625004 CPUtime=1.04 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 103 0 0 0 45 59 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=744] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/744/stat : 744 (java) S 665 667 31663 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 290415940 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136554882344 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1797.66
Current children cumulated vsize (KiB) 9625004



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1784.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/211 760
/proc/meminfo: memFree=22938876/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9625004 CPUtime=1800.07 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 36465 0 1 0 179705 302 0 0 20 0 19 0 290412759 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2406251 940976 2291 9 0 2396937 0
[pid=667/tid=669] ppid=665 vsize=9625004 CPUtime=1768.28 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) R 665 667 31663 0 -1 4202560 4085 0 1 0 176754 74 0 0 20 0 19 0 290412761 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136739233944 140136612092215 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9625004 CPUtime=2.14 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) S 665 667 31663 0 -1 4202560 2773 0 0 0 193 21 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136582871720 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9625004 CPUtime=2.11 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) S 665 667 31663 0 -1 4202560 2130 0 0 0 192 19 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136581819176 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9625004 CPUtime=2.12 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) S 665 667 31663 0 -1 4202560 4457 0 0 0 189 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136580766632 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9625004 CPUtime=2.22 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) S 665 667 31663 0 -1 4202560 3591 0 0 0 194 28 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136579714088 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9625004 CPUtime=2.34 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) S 665 667 31663 0 -1 4202560 1645 0 0 0 211 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136578660520 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9625004 CPUtime=2.19 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) S 665 667 31663 0 -1 4202560 1812 0 0 0 197 22 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136577607976 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9625004 CPUtime=1.86 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) S 665 667 31663 0 -1 4202560 2278 0 0 0 168 18 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136576555432 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9625004 CPUtime=2.2 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) S 665 667 31663 0 -1 4202560 1848 0 0 0 195 25 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136575502888 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9625004 CPUtime=7.39 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 2178 0 0 0 731 8 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136563305064 252266461097 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9625004 CPUtime=0.87 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 4655 0 0 0 85 2 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9625004 CPUtime=0.68 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 3730 0 0 0 68 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9625004 CPUtime=1.04 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 103 0 0 0 45 59 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=744] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/744/stat : 744 (java) S 665 667 31663 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 290415940 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136554882344 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 9625004

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1784.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/211 760
/proc/meminfo: memFree=22938876/32873852 swapFree=7624/7624
[pid=667] ppid=665 vsize=9625004 CPUtime=1800.07 cores=1,3,5,7
/proc/667/stat : 667 (java) S 665 667 31663 0 -1 4202496 36465 0 1 0 179705 302 0 0 20 0 19 0 290412759 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140737331953504 252266446909 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/667/statm: 2406251 940976 2291 9 0 2396937 0
[pid=667/tid=669] ppid=665 vsize=9625004 CPUtime=1768.28 cores=1,3,5,7
/proc/667/task/669/stat : 669 (java) R 665 667 31663 0 -1 4202560 4085 0 1 0 176754 74 0 0 20 0 19 0 290412761 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136739233944 140136612092215 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=667/tid=670] ppid=665 vsize=9625004 CPUtime=2.14 cores=1,3,5,7
/proc/667/task/670/stat : 670 (java) S 665 667 31663 0 -1 4202560 2773 0 0 0 193 21 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136582871720 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=671] ppid=665 vsize=9625004 CPUtime=2.11 cores=1,3,5,7
/proc/667/task/671/stat : 671 (java) S 665 667 31663 0 -1 4202560 2130 0 0 0 192 19 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136581819176 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=672] ppid=665 vsize=9625004 CPUtime=2.12 cores=1,3,5,7
/proc/667/task/672/stat : 672 (java) S 665 667 31663 0 -1 4202560 4457 0 0 0 189 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136580766632 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=674] ppid=665 vsize=9625004 CPUtime=2.22 cores=1,3,5,7
/proc/667/task/674/stat : 674 (java) S 665 667 31663 0 -1 4202560 3591 0 0 0 194 28 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136579714088 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=675] ppid=665 vsize=9625004 CPUtime=2.34 cores=1,3,5,7
/proc/667/task/675/stat : 675 (java) S 665 667 31663 0 -1 4202560 1645 0 0 0 211 23 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136578660520 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=676] ppid=665 vsize=9625004 CPUtime=2.19 cores=1,3,5,7
/proc/667/task/676/stat : 676 (java) S 665 667 31663 0 -1 4202560 1812 0 0 0 197 22 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136577607976 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=667/tid=677] ppid=665 vsize=9625004 CPUtime=1.86 cores=1,3,5,7
/proc/667/task/677/stat : 677 (java) S 665 667 31663 0 -1 4202560 2278 0 0 0 168 18 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136576555432 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=678] ppid=665 vsize=9625004 CPUtime=2.2 cores=1,3,5,7
/proc/667/task/678/stat : 678 (java) S 665 667 31663 0 -1 4202560 1848 0 0 0 195 25 0 0 20 0 19 0 290412762 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136575502888 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=667/tid=679] ppid=665 vsize=9625004 CPUtime=7.39 cores=1,3,5,7
/proc/667/task/679/stat : 679 (java) S 665 667 31663 0 -1 4202560 2178 0 0 0 731 8 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136563305064 252266461097 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=680] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/680/stat : 680 (java) S 665 667 31663 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136562251384 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=681] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/681/stat : 681 (java) S 665 667 31663 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 290412763 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136561198728 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=682] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/682/stat : 682 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136560147472 252266469152 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=683] ppid=665 vsize=9625004 CPUtime=0.87 cores=1,3,5,7
/proc/667/task/683/stat : 683 (java) S 665 667 31663 0 -1 4202560 4655 0 0 0 85 2 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136559093816 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=684] ppid=665 vsize=9625004 CPUtime=0.68 cores=1,3,5,7
/proc/667/task/684/stat : 684 (java) S 665 667 31663 0 -1 4202560 3730 0 0 0 68 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136558041272 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=685] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/685/stat : 685 (java) S 665 667 31663 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136556988920 252266460220 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=667/tid=686] ppid=665 vsize=9625004 CPUtime=1.04 cores=1,3,5,7
/proc/667/task/686/stat : 686 (java) S 665 667 31663 0 -1 4202560 103 0 0 0 45 59 0 0 20 0 19 0 290412766 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136555936584 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=667/tid=744] ppid=665 vsize=9625004 CPUtime=0 cores=1,3,5,7
/proc/667/task/744/stat : 744 (java) S 665 667 31663 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 290415940 9856004096 940976 33554432000 1073741824 1073778376 140737331962368 140136554882344 252266461097 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 9625004

Child status: 143

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 667 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=359519
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=361488
# CPU time returned by wait4() is 1795.72
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1784.74
CPU time (s): 1800.07
CPU user time (s): 1797.05
CPU system time (s): 3.02
CPU usage (%): 100.859
Max. virtual memory (cumulated for all children) (KiB): 9625004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.36
system time used= 3.36149
maximum resident set size= 3764020
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36496
page faults= 1
swaps= 0
block input operations= 0
block output operations= 1080
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 41337
involuntary context switches= 11731

runsolver used 6.42202 second user time and 16.1006 second system time

The end

Launcher Data 

Begin job on node131 at 2012-05-29 00:07:53
IDJOB=3710444
IDBENCH=92632
IDSOLVER=2289
FILE ID=node131/3710444-1338242868
RUNJOBID= node131-1338224871-31680
PBS_JOBID= 14624623
Free space on /tmp= 71480 MiB

SOLVER NAME= SAT4J PB specific settings 2.3.2 snapshot
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Large/normalized-minisat100_16_6_7_mh.opb
COMMAND LINE= java -jar HOME/sat4j-sat.jar -opt -s Resolution -S ORDERS=VarOrderHeap -hot -y BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3710444-1338242868/watcher-3710444-1338242868 -o /tmp/evaluation-result-3710444-1338242868/solver-3710444-1338242868 -C 1800 -W 1900 -M 15500  java -jar HOME/sat4j-sat.jar -opt -s Resolution -S ORDERS=VarOrderHeap -hot -y HOME/instance-3710444-1338242868.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 54f73c3b575712a1f6dc41b8a7ab2de4
RANDOM SEED=1747070112

node131.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        29313848 kB
Buffers:          519024 kB
Cached:          2174160 kB
SwapCached:         2328 kB
Active:          1003240 kB
Inactive:        1697268 kB
Active(anon):       6592 kB
Inactive(anon):      996 kB
Active(file):     996648 kB
Inactive(file):  1696272 kB
Unevictable:        7624 kB
Mlocked:            7624 kB
SwapTotal:      67108856 kB
SwapFree:       67099068 kB
Dirty:            226360 kB
Writeback:             0 kB
AnonPages:         90436 kB
Mapped:            14252 kB
Shmem:                 0 kB
Slab:             718612 kB
SReclaimable:     156724 kB
SUnreclaim:       561888 kB
KernelStack:        1584 kB
PageTables:         3760 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     136092 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:     77824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71416 MiB
End job on node131 at 2012-05-29 00:37:40