Trace number 4103944

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
Sat4j PB 2.3.6 Resolution PB16? (TO) 1800.01 1773.81

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-swath.opb
MD5SUM3553224658521cb15e26e6f30dd8f5c2
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9155
Total number of constraints884
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)423
Number of constraints which are nor clauses,nor cardinality constraints461
Minimum length of a constraint1
Maximum length of a constraint6754
Number of terms in the objective function 31
Biggest coefficient in the objective function 1073741824
Number of bits for the biggest coefficient in the objective function 31
Sum of the numbers in the objective function 2147483647
Number of bits of the sum of numbers in the objective function 31
Biggest number in a constraint 16777216000000
Number of bits of the biggest number in a constraint 44
Biggest sum of numbers in a constraint 66042304016951
Number of bits of the biggest sum of numbers46
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.09	c SAT4J: a SATisfiability library for Java (c) 2004-2013 Artois University and CNRS
0.00/0.09	c This is free software under the dual EPL/GNU LGPL licenses.
0.00/0.09	c See www.sat4j.org for details.
0.00/0.09	c version PB16.v20160501
0.00/0.09	c java.runtime.name	Java(TM) SE Runtime Environment
0.00/0.09	c java.vm.name		Java HotSpot(TM) 64-Bit Server VM
0.00/0.09	c java.vm.version	19.1-b02
0.00/0.09	c java.vm.vendor	Sun Microsystems Inc.
0.00/0.09	c sun.arch.data.model	64
0.00/0.09	c java.version		1.6.0_24
0.00/0.09	c os.name		Linux
0.00/0.09	c os.version		2.6.32-71.29.1.el6.x86_64
0.00/0.09	c os.arch		amd64
0.00/0.09	c Free memory 		501472288
0.00/0.09	c Max memory 		7480803328
0.00/0.09	c Total memory 		504102912
0.00/0.09	c Number of processors 	8
0.09/0.11	c Pseudo Boolean Optimization by upper bound
0.09/0.11	c --- Begin Solver configuration ---
0.09/0.11	c org.sat4j.pb.constraints.CompetResolutionPBLongMixedWLClauseCardConstrDataStructure@587bd9f2
0.09/0.11	c Learn all clauses as in MiniSAT
0.09/0.11	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.09/0.11	c VSIDS like heuristics from MiniSAT using a heap lightweight component caching from RSAT taking into account the objective function
0.09/0.11	c No reason simplification
0.09/0.11	c Glucose 2.1 dynamic restart strategy
0.09/0.11	c Glucose 2 learned constraints deletion strategy (LBD updated on propagation) with timer check every 1000 if the learned constraints reach increasing bounds: 5000 step 1000
0.09/0.11	c timeout=2147483s
0.09/0.11	c DB Simplification allowed=false
0.09/0.11	c Listener: org.sat4j.minisat.core.VoidTracing@4e3eca90
0.09/0.11	c --- End Solver configuration ---
0.09/0.11	c solving HOME/instance-4103944-1466256867.opb
0.09/0.11	c reading problem ... 
0.09/0.12	c  objective function found
0.86/0.53	c ... done. Wall clock time 0.412s.
0.86/0.53	c declared #vars     9155
0.86/0.53	c #constraints  1388
0.86/0.53	c constraints type 
0.86/0.53	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 22
0.86/0.53	c org.sat4j.specs.Constr$1 => 401
0.86/0.53	c org.sat4j.minisat.constraints.card.MinWatchCard => 182
0.86/0.53	c org.sat4j.minisat.constraints.cnf.UnitClause => 401
0.86/0.53	c org.sat4j.pb.constraints.pb.MaxWatchPbLong => 382
0.86/0.53	c 1388 constraints processed.
0.86/0.53	c objective function length is 31 literals
4.14/3.34	c cleaning 2489 clauses out of 4998 with flag 17953/5000
9.83/8.85	c cleaning 4255 clauses out of 8510 with flag 39960/11001
27.06/25.74	c cleaning 5628 clauses out of 11256 with flag 56332/18002
43.18/41.50	c cleaning 6815 clauses out of 13632 with flag 76422/26006
62.53/60.39	c cleaning 7909 clauses out of 15818 with flag 98294/35007
86.83/84.32	c cleaning 8960 clauses out of 17920 with flag 119576/45018
114.28/111.40	c cleaning 9978 clauses out of 19956 with flag 141569/56014
143.99/140.97	c cleaning 10984 clauses out of 21967 with flag 165549/68003
176.92/173.44	c cleaning 11995 clauses out of 23989 with flag 191563/81009
213.05/209.13	c cleaning 12993 clauses out of 25985 with flag 219546/95000
251.71/247.46	c cleaning 14004 clauses out of 28007 with flag 249579/110015
293.37/288.71	c cleaning 15000 clauses out of 30000 with flag 281575/126012
337.51/332.58	c cleaning 15993 clauses out of 31988 with flag 315553/143000
385.16/379.46	c cleaning 16998 clauses out of 33997 with flag 351560/161002
435.65/429.26	c cleaning 17997 clauses out of 35997 with flag 389559/180000
488.38/481.10	c cleaning 19000 clauses out of 38000 with flag 429561/200000
543.16/535.18	c cleaning 20009 clauses out of 40018 with flag 471600/221018
601.25/592.34	c cleaning 20998 clauses out of 41995 with flag 515576/243004
662.19/652.57	c cleaning 22003 clauses out of 44006 with flag 561597/266013
726.51/716.07	c cleaning 23000 clauses out of 45999 with flag 609592/290009
781.37/769.65	c cleaning 23995 clauses out of 47991 with flag 659601/315001
841.13/828.32	c cleaning 25000 clauses out of 49999 with flag 711608/341004
900.75/887.01	c cleaning 26005 clauses out of 52009 with flag 765628/368014
965.41/950.56	c cleaning 26988 clauses out of 53994 with flag 821609/396004
1034.82/1018.93	c cleaning 28005 clauses out of 56009 with flag 879616/425007
1106.11/1089.02	c cleaning 29002 clauses out of 58004 with flag 939617/455007
1180.09/1162.18	c cleaning 30000 clauses out of 59999 with flag 1001612/486004
1254.38/1235.53	c cleaning 30989 clauses out of 61999 with flag 1065613/518004
1333.69/1313.70	c cleaning 32001 clauses out of 64010 with flag 1131614/551004
1415.96/1394.79	c cleaning 33000 clauses out of 66005 with flag 1199607/585000
1502.16/1479.97	c cleaning 34003 clauses out of 68019 with flag 1269637/620014
1589.12/1565.71	c cleaning 35010 clauses out of 70019 with flag 1341643/656017
1678.29/1653.64	c cleaning 36000 clauses out of 72002 with flag 1415630/693010
1773.89/1747.93	c cleaning 36996 clauses out of 73993 with flag 1491613/731001
1800.00/1773.77	c starts		: 564
1800.00/1773.77	c conflicts		: 742564
1800.00/1773.77	c decisions		: 3856661
1800.00/1773.77	c propagations		: 13111062
1800.00/1773.77	c inspects		: 7240028477
1800.00/1773.77	c shortcuts		: 0
1800.00/1773.77	c learnt literals	: 2
1800.00/1773.77	c learnt binary clauses	: 2
1800.00/1773.77	c learnt ternary clauses	: 3
1800.00/1773.77	c learnt constraints	: 742561
1800.00/1773.77	c ignored constraints	: 0
1800.00/1773.77	c root simplifications	: 0
1800.00/1773.77	c removed literals (reason simplification)	: 0
1800.00/1773.77	c reason swapping (by a shorter reason)	: 0
1800.00/1773.77	c Calls to reduceDB	: 34
1800.00/1773.77	c Number of update (reduction) of LBD	: 7490
1800.00/1773.77	c Imported unit clauses	: 0
1800.00/1773.77	c number of reductions to clauses (during analyze)	: 0
1800.00/1773.77	c number of learned constraints concerned by reduction	: 0
1800.00/1773.77	c number of learning phase by resolution	: 0
1800.00/1773.77	c number of learning phase by cutting planes	: 0
1800.00/1773.77	c speed (assignments/second)	: 7393.886861828415
1800.00/1773.77	c non guided choices	3456
1800.00/1773.77	c timeout
1800.00/1773.79	c learnt constraints type 
1800.00/1773.79	c org.sat4j.minisat.constraints.cnf.LearntBinaryClause => 2
1800.00/1773.79	c org.sat4j.minisat.constraints.cnf.LearntWLClause => 48558
1800.00/1773.79	s UNKNOWN
1800.00/1773.79	c Total wall clock time (in seconds): 1773.671

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103944-1466256867/watcher-4103944-1466256867 -o /tmp/evaluation-result-4103944-1466256867/solver-4103944-1466256867 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node125-1466240732-22005 --watchdog 1960 java -jar sat4j-pb.jar HOME/instance-4103944-1466256867.opb 

pid=24623
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.30 2.34 2.30 3/194 24626
/proc/meminfo: memFree=29675884/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=2500 CPUtime=0 cores=1,3,5,7
/proc/24626/stat : 24626 (java) D 24623 24626 21988 0 -1 4202496 375 0 0 0 0 0 0 0 20 0 1 0 27733353 2560000 46 33554432000 1073741824 1073778376 140733299095472 140733299092600 270698376487 0 0 4096 0 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 625 46 37 9 0 29 0

[startup+0.100059 s]
/proc/loadavg: 2.30 2.34 2.30 3/194 24626
/proc/meminfo: memFree=29675884/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9558476 CPUtime=0.09 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 4419 0 1 0 8 1 0 0 20 0 18 0 27733353 9787879424 6041 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2389619 6041 2125 9 0 2380296 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9558476

[startup+0.20023 s]
/proc/loadavg: 2.30 2.34 2.30 3/194 24626
/proc/meminfo: memFree=29675884/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9558476 CPUtime=0.29 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 5053 0 1 0 28 1 0 0 20 0 18 0 27733353 9787879424 6863 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2389619 6863 2220 9 0 2380296 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9558476

[startup+0.300242 s]
/proc/loadavg: 2.30 2.34 2.30 3/194 24626
/proc/meminfo: memFree=29675884/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9558476 CPUtime=0.52 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 6370 0 1 0 51 1 0 0 20 0 18 0 27733353 9787879424 9637 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2389619 9637 2243 9 0 2380296 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 9558476

[startup+0.70019 s]
/proc/loadavg: 2.30 2.34 2.30 3/194 24626
/proc/meminfo: memFree=29675884/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=1.29 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 9862 0 1 0 125 4 0 0 20 0 19 0 27733353 9856040960 35315 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 35315 2256 9 0 2396937 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 9625040

[startup+1.50086 s]
/proc/loadavg: 2.30 2.34 2.30 3/213 24645
/proc/meminfo: memFree=29538500/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=2.28 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 11665 0 1 0 223 5 0 0 20 0 19 0 27733353 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 37892 2261 9 0 2396937 0
[pid=24626/tid=24628] ppid=24623 vsize=9625040 CPUtime=1.46 cores=1,3,5,7
/proc/24626/task/24628/stat : 24628 (java) R 24623 24626 21988 0 -1 4202560 2471 0 1 0 143 3 0 0 20 0 19 0 27733354 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186242814440 140186072363480 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24629] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24629/stat : 24629 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186204306216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186203253416 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24631] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24631/stat : 24631 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186202201128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24632] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24632/stat : 24632 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186201148328 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24633] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24633/stat : 24633 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186200095016 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24634] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24634/stat : 24634 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186199042216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24635] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24635/stat : 24635 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186197989928 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 19 0 27733356 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.41 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3750 0 0 0 41 0 0 0 20 0 19 0 27733359 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.38 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 4172 0 0 0 36 2 0 0 20 0 19 0 27733359 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 37892 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.28
Current children cumulated vsize (KiB) 9625040

[startup+3.10074 s]
/proc/loadavg: 2.28 2.34 2.30 3/213 24645
/proc/meminfo: memFree=29506912/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=3.94 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 11785 0 1 0 389 5 0 0 20 0 19 0 27733353 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 44119 2275 9 0 2396937 0
[pid=24626/tid=24628] ppid=24623 vsize=9625040 CPUtime=3.03 cores=1,3,5,7
/proc/24626/task/24628/stat : 24628 (java) R 24623 24626 21988 0 -1 4202560 2481 0 1 0 300 3 0 0 20 0 19 0 27733354 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186242814064 140186072234991 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24629] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24629/stat : 24629 (java) S 24623 24626 21988 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186204306216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186203253416 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24631] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24631/stat : 24631 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186202201128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24632] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24632/stat : 24632 (java) S 24623 24626 21988 0 -1 4202560 14 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186201148328 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24633] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24633/stat : 24633 (java) S 24623 24626 21988 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186200095016 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24634] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24634/stat : 24634 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186199042216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24635] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24635/stat : 24635 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186197989928 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 72 0 0 0 0 0 0 0 20 0 19 0 27733356 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.41 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3750 0 0 0 41 0 0 0 20 0 19 0 27733359 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.38 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 4172 0 0 0 36 2 0 0 20 0 19 0 27733359 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 44119 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 3.94
Current children cumulated vsize (KiB) 9625040

[startup+6.30091 s]
/proc/loadavg: 2.28 2.34 2.30 3/213 24645
/proc/meminfo: memFree=29506560/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=7.31 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 13327 0 1 0 725 6 0 0 20 0 19 0 27733353 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 44020 2279 9 0 2396937 0
[pid=24626/tid=24628] ppid=24623 vsize=9625040 CPUtime=6.22 cores=1,3,5,7
/proc/24626/task/24628/stat : 24628 (java) R 24623 24626 21988 0 -1 4202560 2482 0 1 0 619 3 0 0 20 0 19 0 27733354 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186242813864 140186072235127 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24629] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24629/stat : 24629 (java) S 24623 24626 21988 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186204306216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186203253416 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24631] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24631/stat : 24631 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186202201128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24632] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24632/stat : 24632 (java) S 24623 24626 21988 0 -1 4202560 14 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186201148328 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24633] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24633/stat : 24633 (java) S 24623 24626 21988 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186200095016 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24634] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24634/stat : 24634 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186199042216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24635] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24635/stat : 24635 (java) S 24623 24626 21988 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186197989928 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 27733355 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 72 0 0 0 0 0 0 0 20 0 19 0 27733356 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.43 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3752 0 0 0 43 0 0 0 20 0 19 0 27733359 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.53 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 5711 0 0 0 51 2 0 0 20 0 19 0 27733359 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 44020 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 7.31
Current children cumulated vsize (KiB) 9625040


################
# More data... #
################

[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=4.22 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 1830 0 0 0 366 56 0 0 20 0 19 0 27733355 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=7.33 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 4402 0 0 0 728 5 0 0 20 0 19 0 27733356 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.45 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3752 0 0 0 45 0 0 0 20 0 19 0 27733359 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.59 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 5717 0 0 0 57 2 0 0 20 0 19 0 27733359 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0.39 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 99 0 0 0 17 22 0 0 20 0 19 0 27733359 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 558242 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1747.93
Current children cumulated vsize (KiB) 9625040



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1773.7 s]
/proc/loadavg: 2.22 2.24 2.26 3/213 24778
/proc/meminfo: memFree=27606488/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=1800 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 35825 0 1 0 179574 426 0 0 20 0 19 0 27733353 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 555702 2287 9 0 2396937 0
[pid=24626/tid=24628] ppid=24623 vsize=9625040 CPUtime=1751.8 cores=1,3,5,7
/proc/24626/task/24628/stat : 24628 (java) R 24623 24626 21988 0 -1 4202560 2683 0 1 0 175149 31 0 0 20 0 19 0 27733354 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186242813152 140186072234965 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24629] ppid=24623 vsize=9625040 CPUtime=4.25 cores=1,3,5,7
/proc/24626/task/24629/stat : 24629 (java) S 24623 24626 21988 0 -1 4202560 1495 0 0 0 378 47 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186204306216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=9625040 CPUtime=4.18 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) S 24623 24626 21988 0 -1 4202560 1671 0 0 0 378 40 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186203253416 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24631] ppid=24623 vsize=9625040 CPUtime=4.34 cores=1,3,5,7
/proc/24626/task/24631/stat : 24631 (java) S 24623 24626 21988 0 -1 4202560 3295 0 0 0 384 50 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186202201128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24632] ppid=24623 vsize=9625040 CPUtime=4.45 cores=1,3,5,7
/proc/24626/task/24632/stat : 24632 (java) S 24623 24626 21988 0 -1 4202560 2174 0 0 0 395 50 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186201148328 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24633] ppid=24623 vsize=9625040 CPUtime=4.32 cores=1,3,5,7
/proc/24626/task/24633/stat : 24633 (java) S 24623 24626 21988 0 -1 4202560 2981 0 0 0 379 53 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186200095016 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24634] ppid=24623 vsize=9625040 CPUtime=4.52 cores=1,3,5,7
/proc/24626/task/24634/stat : 24634 (java) S 24623 24626 21988 0 -1 4202560 2265 0 0 0 403 49 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186199042216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24635] ppid=24623 vsize=9625040 CPUtime=4.14 cores=1,3,5,7
/proc/24626/task/24635/stat : 24635 (java) S 24623 24626 21988 0 -1 4202560 1681 0 0 0 367 47 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186197989928 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=4.33 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 1830 0 0 0 377 56 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=7.82 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 4922 0 0 0 777 5 0 0 20 0 19 0 27733356 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.45 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3752 0 0 0 45 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.59 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 5717 0 0 0 57 2 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0.41 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 101 0 0 0 17 24 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 9625040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (1796.16 s) is less than in the last sample (1800 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (3.83997 s) to the 'lost time'.

[startup+1773.7 s]
/proc/loadavg: 2.22 2.24 2.26 3/213 24778
/proc/meminfo: memFree=27606488/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=9625040 CPUtime=1800 cores=1,3,5,7
/proc/24626/stat : 24626 (java) S 24623 24626 21988 0 -1 4202496 35825 0 1 0 179574 426 0 0 20 0 19 0 27733353 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140733299086608 270710898749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 2406260 555702 2287 9 0 2396937 0
[pid=24626/tid=24628] ppid=24623 vsize=9625040 CPUtime=1751.8 cores=1,3,5,7
/proc/24626/task/24628/stat : 24628 (java) R 24623 24626 21988 0 -1 4202560 2683 0 1 0 175149 31 0 0 20 0 19 0 27733354 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186242813152 140186072234965 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24629] ppid=24623 vsize=9625040 CPUtime=4.25 cores=1,3,5,7
/proc/24626/task/24629/stat : 24629 (java) S 24623 24626 21988 0 -1 4202560 1495 0 0 0 378 47 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186204306216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=9625040 CPUtime=4.18 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) S 24623 24626 21988 0 -1 4202560 1671 0 0 0 378 40 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186203253416 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24631] ppid=24623 vsize=9625040 CPUtime=4.34 cores=1,3,5,7
/proc/24626/task/24631/stat : 24631 (java) S 24623 24626 21988 0 -1 4202560 3295 0 0 0 384 50 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186202201128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24632] ppid=24623 vsize=9625040 CPUtime=4.45 cores=1,3,5,7
/proc/24626/task/24632/stat : 24632 (java) S 24623 24626 21988 0 -1 4202560 2174 0 0 0 395 50 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186201148328 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24633] ppid=24623 vsize=9625040 CPUtime=4.32 cores=1,3,5,7
/proc/24626/task/24633/stat : 24633 (java) S 24623 24626 21988 0 -1 4202560 2981 0 0 0 379 53 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186200095016 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24634] ppid=24623 vsize=9625040 CPUtime=4.52 cores=1,3,5,7
/proc/24626/task/24634/stat : 24634 (java) S 24623 24626 21988 0 -1 4202560 2265 0 0 0 403 49 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186199042216 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24635] ppid=24623 vsize=9625040 CPUtime=4.14 cores=1,3,5,7
/proc/24626/task/24635/stat : 24635 (java) S 24623 24626 21988 0 -1 4202560 1681 0 0 0 367 47 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186197989928 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24626/tid=24636] ppid=24623 vsize=9625040 CPUtime=4.33 cores=1,3,5,7
/proc/24626/task/24636/stat : 24636 (java) S 24623 24626 21988 0 -1 4202560 1830 0 0 0 377 56 0 0 20 0 19 0 27733355 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186196937128 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24637] ppid=24623 vsize=9625040 CPUtime=7.82 cores=1,3,5,7
/proc/24626/task/24637/stat : 24637 (java) S 24623 24626 21988 0 -1 4202560 4922 0 0 0 777 5 0 0 20 0 19 0 27733356 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186066328296 270710912937 0 0 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24638] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24638/stat : 24638 (java) S 24623 24626 21988 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186065274360 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24639] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24639/stat : 24639 (java) S 24623 24626 21988 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 27733357 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186064221960 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24640] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24640/stat : 24640 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186063170448 270710920992 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24641] ppid=24623 vsize=9625040 CPUtime=0.45 cores=1,3,5,7
/proc/24626/task/24641/stat : 24641 (java) S 24623 24626 21988 0 -1 4202560 3752 0 0 0 45 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186062117048 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24626/tid=24642] ppid=24623 vsize=9625040 CPUtime=0.59 cores=1,3,5,7
/proc/24626/task/24642/stat : 24642 (java) S 24623 24626 21988 0 -1 4202560 5717 0 0 0 57 2 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186061064248 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24643] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24643/stat : 24643 (java) S 24623 24626 21988 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186060012152 270710912060 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24626/tid=24644] ppid=24623 vsize=9625040 CPUtime=0.41 cores=1,3,5,7
/proc/24626/task/24644/stat : 24644 (java) S 24623 24626 21988 0 -1 4202560 101 0 0 0 17 24 0 0 20 0 19 0 27733359 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186058959560 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24626/tid=24645] ppid=24623 vsize=9625040 CPUtime=0 cores=1,3,5,7
/proc/24626/task/24645/stat : 24645 (java) S 24623 24626 21988 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 27733407 9856040960 555702 33554432000 1073741824 1073778376 140733299095472 140186057905576 270710912937 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 9625040

[startup+1773.81 s]
/proc/loadavg: 2.22 2.24 2.26 3/213 24778
/proc/meminfo: memFree=27606488/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=0 CPUtime=1796.16 cores=1,3,5,7
/proc/24626/stat : 24626 (java) Z 24623 24626 21988 0 -1 4203532 35990 0 1 0 179141 475 0 0 20 0 2 0 27733353 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 0 0 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=0 CPUtime=4.24 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) R 24623 24626 21988 0 -1 4203588 1702 0 0 0 382 42 0 0 20 0 2 0 27733355 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1796.16
Current children cumulated vsize (KiB) 0
#
############


Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 24626 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1773.81 s]
/proc/loadavg: 2.22 2.24 2.26 3/213 24778
/proc/meminfo: memFree=27606488/32872528 swapFree=1542984/1696284
[pid=24626] ppid=24623 vsize=0 CPUtime=1796.16 cores=1,3,5,7
/proc/24626/stat : 24626 (java) Z 24623 24626 21988 0 -1 4203532 35990 0 1 0 179141 475 0 0 20 0 2 0 27733353 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24626/statm: 0 0 0 0 0 0 0
[pid=24626/tid=24630] ppid=24623 vsize=0 CPUtime=4.24 cores=1,3,5,7
/proc/24626/task/24630/stat : 24630 (java) R 24623 24626 21988 0 -1 4203588 1702 0 0 0 382 42 0 0 20 0 2 0 27733355 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1796.16
Current children cumulated vsize (KiB) 0

Child status: 143

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 3.83997
#  lost CPU user time (s): 4.32996
#  lost CPU system time (s): -0.49

Real time (s): 1773.81
CPU time (s): 1800.01
CPU user time (s): 1795.74
CPU system time (s): 4.27128
CPU usage (%): 101.477
Max. virtual memory (cumulated for all children) (KiB): 9625040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1791.41
system time used= 4.76128
maximum resident set size= 2523100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35990
page faults= 1
swaps= 0
block input operations= 0
block output operations= 1688
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 43466
involuntary context switches= 36303

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.3224 second user time and 13.323 second system time

The end

Launcher Data 

Begin job on node125 at 2016-06-18 15:34:27
IDJOB=4103944
IDBENCH=2511
IDSOLVER=2546
FILE ID=node125/4103944-1466256867
RUNJOBID= node125-1466240732-22005
PBS_JOBID= 19918195
Free space on /tmp= 71744 MiB

SOLVER NAME= Sat4j PB 2.3.6 Resolution PB16
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-swath.opb
COMMAND LINE= java -jar sat4j-pb.jar BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103944-1466256867/watcher-4103944-1466256867 -o /tmp/evaluation-result-4103944-1466256867/solver-4103944-1466256867 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node125-1466240732-22005 --watchdog 1960  java -jar sat4j-pb.jar HOME/instance-4103944-1466256867.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3553224658521cb15e26e6f30dd8f5c2
RANDOM SEED=775875749

node125.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.36
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.683
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29676148 kB
Buffers:          130852 kB
Cached:           151404 kB
SwapCached:          688 kB
Active:           546452 kB
Inactive:         216236 kB
Active(anon):     481736 kB
Inactive(anon):     1040 kB
Active(file):      64716 kB
Inactive(file):   215196 kB
Unevictable:     1696284 kB
Mlocked:         1542984 kB
SwapTotal:      67108856 kB
SwapFree:       67098232 kB
Dirty:              2452 kB
Writeback:             0 kB
AnonPages:       2175784 kB
Mapped:            15264 kB
Shmem:                 0 kB
Slab:             603484 kB
SReclaimable:      46968 kB
SUnreclaim:       556516 kB
KernelStack:        1600 kB
PageTables:         9012 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2313276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    618496 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71740 MiB
End job on node125 at 2016-06-18 16:04:01