Trace number 3311272

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 2183.42 1302.58

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v30000-c126000-S926207202-053-UNKNOWN.cnf
MD5SUMbd4912a5ba3146c46ac3a58d7861d9a6
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark37.8762
Satisfiable
(Un)Satisfiability was proved
Number of variables30000
Number of clauses126000
Sum of the clauses size378000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3126000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.11/0.11	51:58 INFO : Reading from input HOME/instance-3311272-1304117518.cnf
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Executor set job limit to 1000000
0.92/0.76	Executor set job limit to 1000000
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
0.92/0.76	Starting Executor!
3.89/2.29	52:00 INFO : 29874 variables remaining out of 30000
3.89/2.29	52:00 INFO : 500964 literals remaining out of 504000
1209.56/336.59	57:32 ERROR: Failed to solve instance
1209.56/336.59	java.lang.OutOfMemoryError: Java heap space
1209.56/336.59		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
1209.56/336.59		at gnu.trove.THash.postInsertHook(THash.java:370)
1209.56/336.59		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1209.56/336.59		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1209.56/336.59		at ibis.structure.Subsumming.run(Subsumming.java:58)
1209.56/336.59		at ibis.structure.Solver.simplify(Solver.java:205)
1209.56/336.59		at ibis.structure.Solver.solve(Solver.java:113)
1209.56/336.59		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1209.56/336.59		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1209.56/336.59		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1209.56/336.59		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1209.56/336.59		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1209.56/336.59		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1209.56/336.59		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1209.56/336.59		at ibis.constellation.Executor.processActivities(Executor.java:75)
1209.56/336.59		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1209.56/336.59		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1209.56/336.59		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1217.83/344.61	57:42 ERROR: Failed to solve instance
1217.83/344.61	java.lang.OutOfMemoryError: Java heap space
1217.83/344.61		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1217.83/344.61		at gnu.trove.THash.postInsertHook(THash.java:370)
1217.83/344.61		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1217.83/344.61		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1217.83/344.61		at ibis.structure.Subsumming.run(Subsumming.java:58)
1217.83/344.61		at ibis.structure.Solver.simplify(Solver.java:205)
1217.83/344.61		at ibis.structure.Solver.solve(Solver.java:113)
1217.83/344.61		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1217.83/344.61		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1217.83/344.61		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1217.83/344.61		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1217.83/344.61		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1217.83/344.61		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1217.83/344.61		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1217.83/344.61		at ibis.constellation.Executor.processActivities(Executor.java:75)
1217.83/344.61		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1217.83/344.61		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1217.83/344.61		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1222.44/349.14	57:47 ERROR: Failed to solve instance
1222.44/349.14	java.lang.OutOfMemoryError: Java heap space
1222.44/349.14		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1222.44/349.14		at gnu.trove.THash.postInsertHook(THash.java:370)
1222.44/349.14		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1222.44/349.14		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1222.44/349.14		at ibis.structure.Subsumming.run(Subsumming.java:58)
1222.44/349.14		at ibis.structure.Solver.simplify(Solver.java:205)
1222.44/349.14		at ibis.structure.Solver.solve(Solver.java:113)
1222.44/349.14		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1222.44/349.14		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1222.44/349.14		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1222.44/349.14		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1222.44/349.14		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1222.44/349.14		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1222.44/349.14		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1222.44/349.14		at ibis.constellation.Executor.processActivities(Executor.java:75)
1222.44/349.14		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1222.44/349.14		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1222.44/349.14		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1228.61/355.12	57:53 ERROR: Failed to solve instance
1228.61/355.12	java.lang.OutOfMemoryError: Java heap space
1228.61/355.12		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1228.61/355.12		at gnu.trove.THash.postInsertHook(THash.java:370)
1228.61/355.12		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1228.61/355.12		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1228.61/355.12		at ibis.structure.Subsumming.run(Subsumming.java:58)
1228.61/355.12		at ibis.structure.Solver.simplify(Solver.java:205)
1228.61/355.12		at ibis.structure.Solver.solve(Solver.java:113)
1228.61/355.12		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1228.61/355.12		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1228.61/355.12		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1228.61/355.12		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1228.61/355.12		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1228.61/355.12		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1228.61/355.12		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1228.61/355.12		at ibis.constellation.Executor.processActivities(Executor.java:75)
1228.61/355.12		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1228.61/355.12		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1228.61/355.12		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1255.68/381.98	58:20 ERROR: Failed to solve instance
1255.68/381.98	java.lang.OutOfMemoryError: Java heap space
1257.12/383.37	58:21 ERROR: Failed to solve instance
1257.12/383.37	java.lang.OutOfMemoryError: Java heap space
1257.12/383.37	58:21 ERROR: Failed to solve instance
1257.12/383.37	java.lang.OutOfMemoryError: Java heap space
1266.62/391.48	58:29 ERROR: Failed to solve instance
1266.62/391.48	java.lang.OutOfMemoryError: Java heap space
1291.99/416.64	58:54 ERROR: Failed to solve instance
1291.99/416.64	java.lang.OutOfMemoryError: Java heap space
1291.99/416.64	58:55 ERROR: Failed to solve instance
1291.99/416.64	java.lang.OutOfMemoryError: Java heap space
1296.65/420.80	58:59 ERROR: Failed to solve instance
1296.65/420.80	java.lang.OutOfMemoryError: Java heap space
1298.53/422.57	59:00 ERROR: Failed to solve instance
1298.53/422.57	java.lang.OutOfMemoryError: Java heap space
1382.20/504.60	00:22 ERROR: Failed to solve instance
1382.20/504.60	java.lang.OutOfMemoryError: Java heap space
1384.64/507.07	00:25 ERROR: Failed to solve instance
1384.64/507.07	java.lang.OutOfMemoryError: Java heap space
2042.08/1164.08	01:49 ERROR: Failed to solve instance
2042.08/1164.08	java.lang.OutOfMemoryError: Java heap space
2042.08/1164.08	11:22 ERROR: Failed to solve instance
2042.08/1164.08	java.lang.OutOfMemoryError: Java heap space
2090.60/1212.37	12:10 ERROR: Failed to solve instance
2090.60/1212.37	java.lang.OutOfMemoryError: Java heap space
2094.95/1216.27	12:14 ERROR: Failed to solve instance
2094.95/1216.27	java.lang.OutOfMemoryError: Java heap space
2098.12/1219.25	12:17 ERROR: Failed to solve instance
2098.12/1219.25	java.lang.OutOfMemoryError: Java heap space
2100.86/1221.53	12:19 ERROR: Failed to solve instance
2100.86/1221.53	java.lang.OutOfMemoryError: Java heap space

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311272-1304117518/watcher-3311272-1304117518 -o /tmp/evaluation-result-3311272-1304117518/solver-3311272-1304117518 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311272-1304117518.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.24 7.64 7.87 3/194 16423
/proc/meminfo: memFree=25281844/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=27172 CPUtime=0 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 1424 0 0 0 0 0 0 0 20 0 2 0 504167911 27824128 894 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 6793 894 684 9 0 381 0
[pid=16423/tid=16424] ppid=16421 vsize=27172 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) S 16421 16423 15661 0 -1 4202560 66 0 0 0 0 0 0 0 22 0 2 0 504167911 27824128 894 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255101845127 0 2147483391 4096 0 18446744071699199166 0 0 -1 5 0 0 0

[startup+0.074595 s]
/proc/loadavg: 6.24 7.64 7.87 3/194 16423
/proc/meminfo: memFree=25281844/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15675736 CPUtime=0.07 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 4723 0 1 0 6 1 0 0 20 0 18 0 504167911 16051953664 4162 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3918934 4162 1938 9 0 3909653 0
[pid=16423/tid=16424] ppid=16421 vsize=15675736 CPUtime=0.06 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4202560 3079 0 1 0 6 0 0 0 25 0 18 0 504167911 16051953664 4162 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912505164128 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 15675736

[startup+0.106624 s]
/proc/loadavg: 6.24 7.64 7.87 3/194 16423
/proc/meminfo: memFree=25281844/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15676916 CPUtime=0.11 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 5733 0 1 0 10 1 0 0 20 0 18 0 504167911 16053161984 5137 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3919229 5137 2119 9 0 3909948 0
[pid=16423/tid=16424] ppid=16421 vsize=15676916 CPUtime=0.09 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4202560 3577 0 1 0 8 1 0 0 18 0 18 0 504167911 16053161984 5137 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912505170474 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 15676916

[startup+0.300549 s]
/proc/loadavg: 6.24 7.64 7.87 3/194 16423
/proc/meminfo: memFree=25281844/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15680688 CPUtime=0.52 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 15956 0 1 0 49 3 0 0 20 0 18 0 504167911 16057024512 14391 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3920172 14398 2207 9 0 3910891 0
[pid=16423/tid=16424] ppid=16421 vsize=15680688 CPUtime=0.28 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4202560 10898 0 1 0 26 2 0 0 18 0 18 0 504167911 16057024512 14400 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912505642195 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15680688

[startup+0.700482 s]
/proc/loadavg: 6.24 7.64 7.87 3/194 16423
/proc/meminfo: memFree=25281844/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15680688 CPUtime=0.92 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 41772 0 1 0 85 7 0 0 20 0 18 0 504167911 16057024512 40205 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3920172 40205 2223 9 0 3910891 0
[pid=16423/tid=16424] ppid=16421 vsize=15680688 CPUtime=0.68 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4202560 35534 0 1 0 62 6 0 0 18 0 18 0 504167911 16057024512 40205 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912505559948 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15680688

[startup+1.50134 s]
/proc/loadavg: 6.24 7.64 7.87 7/220 16450
/proc/meminfo: memFree=24973312/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15719448 CPUtime=2.47 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 57823 0 1 0 238 9 0 0 20 0 22 0 504167911 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3929862 51568 2259 9 0 3920581 0
[pid=16423/tid=16424] ppid=16421 vsize=15719448 CPUtime=1.47 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4202560 35639 0 1 0 141 6 0 0 20 0 22 0 504167911 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780472574864 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16423/tid=16426] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16426/stat : 16426 (java) S 16421 16423 15661 0 -1 4202560 508 0 0 0 0 0 0 0 16 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16427] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16427/stat : 16427 (java) S 16421 16423 15661 0 -1 4202560 701 0 0 0 0 0 0 0 16 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16428] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16428/stat : 16428 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16429] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16429/stat : 16429 (java) S 16421 16423 15661 0 -1 4202560 68 0 0 0 0 0 0 0 18 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16430] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 1486 0 0 0 0 0 0 0 18 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 578 0 0 0 0 0 0 0 18 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 339 0 0 0 0 0 0 0 18 0 22 0 504167912 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16434] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16434/stat : 16434 (java) S 16421 16423 15661 0 -1 4202560 72 0 0 0 0 0 0 0 18 0 22 0 504167913 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 0 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16435] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16435/stat : 16435 (java) S 16421 16423 15661 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504167913 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16436] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16436/stat : 16436 (java) S 16421 16423 15661 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 504167913 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16437] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16437/stat : 16437 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118592433 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16438] ppid=16421 vsize=15719448 CPUtime=0.22 cores=1,3,5,7
/proc/16423/task/16438/stat : 16438 (java) S 16421 16423 15661 0 -1 4202560 2563 0 0 0 22 0 0 0 15 0 22 0 504167915 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16439] ppid=16421 vsize=15719448 CPUtime=0.73 cores=1,3,5,7
/proc/16423/task/16439/stat : 16439 (java) R 16421 16423 15661 0 -1 4202560 14441 0 0 0 71 2 0 0 18 0 22 0 504167915 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780473406872 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=16423/tid=16440] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16440/stat : 16440 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16441] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16441/stat : 16441 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504167915 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16447] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16447/stat : 16447 (java) S 16421 16423 15661 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 504167987 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16448] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16448/stat : 16448 (java) S 16421 16423 15661 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 504167987 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16449] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16449/stat : 16449 (java) S 16421 16423 15661 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 504167987 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16450] ppid=16421 vsize=15719448 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16450/stat : 16450 (java) S 16421 16423 15661 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 504167987 16096714752 51568 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.47
Current children cumulated vsize (KiB) 15719448

[startup+3.10706 s]
/proc/loadavg: 6.62 7.70 7.88 10/220 16450
/proc/meminfo: memFree=24724692/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15719476 CPUtime=5.84 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 73608 0 1 0 572 12 0 0 20 0 22 0 504167911 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3929869 63985 2275 9 0 3920588 0
[pid=16423/tid=16424] ppid=16421 vsize=15719476 CPUtime=2.26 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) S 16421 16423 15661 0 -1 4202560 35696 0 1 0 220 6 0 0 21 0 22 0 504167911 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16426] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16426/stat : 16426 (java) S 16421 16423 15661 0 -1 4202560 508 0 0 0 0 0 0 0 15 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16427] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16427/stat : 16427 (java) S 16421 16423 15661 0 -1 4202560 701 0 0 0 0 0 0 0 15 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16428] ppid=16421 vsize=15719476 CPUtime=0.02 cores=1,3,5,7
/proc/16423/task/16428/stat : 16428 (java) S 16421 16423 15661 0 -1 4202560 3627 0 0 0 2 0 0 0 16 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16429] ppid=16421 vsize=15719476 CPUtime=0.02 cores=1,3,5,7
/proc/16423/task/16429/stat : 16429 (java) S 16421 16423 15661 0 -1 4202560 3753 0 0 0 2 0 0 0 18 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16430] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 1486 0 0 0 0 0 0 0 18 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719476 CPUtime=0.03 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 5241 0 0 0 3 0 0 0 18 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 339 0 0 0 0 0 0 0 18 0 22 0 504167912 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16434] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16434/stat : 16434 (java) S 16421 16423 15661 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 0 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16435] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16435/stat : 16435 (java) S 16421 16423 15661 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504167913 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16436] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16436/stat : 16436 (java) S 16421 16423 15661 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 504167913 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16437] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16437/stat : 16437 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118592433 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16438] ppid=16421 vsize=15719476 CPUtime=0.62 cores=1,3,5,7
/proc/16423/task/16438/stat : 16438 (java) S 16421 16423 15661 0 -1 4202560 4637 0 0 0 62 0 0 0 15 0 22 0 504167915 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16439] ppid=16421 vsize=15719476 CPUtime=1.57 cores=1,3,5,7
/proc/16423/task/16439/stat : 16439 (java) S 16421 16423 15661 0 -1 4202560 16103 0 0 0 155 2 0 0 15 0 22 0 504167915 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16440] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16440/stat : 16440 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16441] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16441/stat : 16441 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504167915 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16447] ppid=16421 vsize=15719476 CPUtime=0.03 cores=1,3,5,7
/proc/16423/task/16447/stat : 16447 (java) R 16421 16423 15661 0 -1 4202560 18 0 0 0 3 0 0 0 15 0 22 0 504167987 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912506086124 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=16423/tid=16448] ppid=16421 vsize=15719476 CPUtime=0.33 cores=1,3,5,7
/proc/16423/task/16448/stat : 16448 (java) R 16421 16423 15661 0 -1 4202560 7 0 0 0 33 0 0 0 15 0 22 0 504167987 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780476375661 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=16423/tid=16449] ppid=16421 vsize=15719476 CPUtime=0.36 cores=1,3,5,7
/proc/16423/task/16449/stat : 16449 (java) S 16421 16423 15661 0 -1 4202560 19 0 0 0 36 0 0 0 15 0 22 0 504167987 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16450] ppid=16421 vsize=15719476 CPUtime=0.49 cores=1,3,5,7
/proc/16423/task/16450/stat : 16450 (java) R 16421 16423 15661 0 -1 4202560 10 0 0 0 49 0 0 0 16 0 22 0 504167987 16096743424 63985 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 46912506280939 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 15719476

[startup+6.30146 s]
/proc/loadavg: 6.62 7.70 7.88 12/220 16450
/proc/meminfo: memFree=23433036/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15719476 CPUtime=18.24 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 266574 0 1 0 1785 39 0 0 20 0 22 0 504167911 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3929869 256095 2275 9 0 3920588 0
[pid=16423/tid=16424] ppid=16421 vsize=15719476 CPUtime=2.26 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) S 16421 16423 15661 0 -1 4202560 35696 0 1 0 220 6 0 0 21 0 22 0 504167911 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16426] ppid=16421 vsize=15719476 CPUtime=0.05 cores=1,3,5,7
/proc/16423/task/16426/stat : 16426 (java) S 16421 16423 15661 0 -1 4202560 5764 0 0 0 4 1 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16427] ppid=16421 vsize=15719476 CPUtime=0.01 cores=1,3,5,7
/proc/16423/task/16427/stat : 16427 (java) S 16421 16423 15661 0 -1 4202560 4037 0 0 0 1 0 0 0 15 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16428] ppid=16421 vsize=15719476 CPUtime=0.19 cores=1,3,5,7
/proc/16423/task/16428/stat : 16428 (java) S 16421 16423 15661 0 -1 4202560 32375 0 0 0 14 5 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16429] ppid=16421 vsize=15719476 CPUtime=0.08 cores=1,3,5,7
/proc/16423/task/16429/stat : 16429 (java) S 16421 16423 15661 0 -1 4202560 12464 0 0 0 7 1 0 0 15 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16430] ppid=16421 vsize=15719476 CPUtime=0.14 cores=1,3,5,7
/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 25487 0 0 0 11 3 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719476 CPUtime=0.14 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 24812 0 0 0 10 4 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719476 CPUtime=0.09 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 18562 0 0 0 7 2 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719476 CPUtime=0.01 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 3839 0 0 0 1 0 0 0 16 0 22 0 504167912 16096743424 256095 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 292539 0 0 0 189 49 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719476 CPUtime=2.6 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 391112 0 0 0 196 64 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719476 CPUtime=3.2 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 374941 0 0 0 261 59 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719476 CPUtime=2.75 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 392255 0 0 0 213 62 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16434] ppid=16421 vsize=15719476 CPUtime=886.37 cores=1,3,5,7
/proc/16423/task/16434/stat : 16434 (java) R 16421 16423 15661 0 -1 4202560 727831 0 0 0 88519 118 0 0 18 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780473450812 0 0 0 16800975 0 0 0 -1 3 0 0 0
[pid=16423/tid=16435] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16435/stat : 16435 (java) S 16421 16423 15661 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16436] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16436/stat : 16436 (java) S 16421 16423 15661 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16437] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16437/stat : 16437 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118592433 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16438] ppid=16421 vsize=15719476 CPUtime=0.83 cores=1,3,5,7
/proc/16423/task/16438/stat : 16438 (java) S 16421 16423 15661 0 -1 4202560 5232 0 0 0 83 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16439] ppid=16421 vsize=15719476 CPUtime=1.65 cores=1,3,5,7
/proc/16423/task/16439/stat : 16439 (java) S 16421 16423 15661 0 -1 4202560 16131 0 0 0 163 2 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16440] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16440/stat : 16440 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16441] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16441/stat : 16441 (java) S 16421 16423 15661 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16447] ppid=16421 vsize=15719476 CPUtime=287.24 cores=1,3,5,7
/proc/16423/task/16447/stat : 16447 (java) S 16421 16423 15661 0 -1 4202560 102570 0 0 0 28708 16 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16448] ppid=16421 vsize=15719476 CPUtime=287.15 cores=1,3,5,7
/proc/16423/task/16448/stat : 16448 (java) S 16421 16423 15661 0 -1 4202560 120054 0 0 0 28700 15 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16449] ppid=16421 vsize=15719476 CPUtime=287.25 cores=1,3,5,7
/proc/16423/task/16449/stat : 16449 (java) S 16421 16423 15661 0 -1 4202560 108893 0 0 0 28709 16 0 0 16 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16450] ppid=16421 vsize=15719476 CPUtime=286.65 cores=1,3,5,7
/proc/16423/task/16450/stat : 16450 (java) S 16421 16423 15661 0 -1 4202560 120208 0 0 0 28642 23 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2060.54
Current children cumulated vsize (KiB) 15719476

[startup+1242.3 s]
/proc/loadavg: 3.05 4.64 5.92 2/193 16511
/proc/meminfo: memFree=9874788/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15719476 CPUtime=2122.79 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 3890405 0 1 0 211635 644 0 0 20 0 22 0 504167911 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3929869 3849598 2294 9 0 3920588 0
[pid=16423/tid=16424] ppid=16421 vsize=15719476 CPUtime=2.26 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) S 16421 16423 15661 0 -1 4202560 35696 0 1 0 220 6 0 0 21 0 22 0 504167911 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16426] ppid=16421 vsize=15719476 CPUtime=3.16 cores=1,3,5,7
/proc/16423/task/16426/stat : 16426 (java) S 16421 16423 15661 0 -1 4202560 389369 0 0 0 253 63 0 0 15 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16427] ppid=16421 vsize=15719476 CPUtime=1.99 cores=1,3,5,7
/proc/16423/task/16427/stat : 16427 (java) S 16421 16423 15661 0 -1 4202560 264182 0 0 0 155 44 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16428] ppid=16421 vsize=15719476 CPUtime=3.1 cores=1,3,5,7
/proc/16423/task/16428/stat : 16428 (java) S 16421 16423 15661 0 -1 4202560 371367 0 0 0 251 59 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16429] ppid=16421 vsize=15719476 CPUtime=1.8 cores=1,3,5,7
/proc/16423/task/16429/stat : 16429 (java) S 16421 16423 15661 0 -1 4202560 176053 0 0 0 151 29 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16430] ppid=16421 vsize=15719476 CPUtime=2.38 cores=1,3,5,7
/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 292539 0 0 0 189 49 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719476 CPUtime=2.6 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 391112 0 0 0 196 64 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719476 CPUtime=3.2 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 374941 0 0 0 261 59 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719476 CPUtime=2.75 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 392255 0 0 0 213 62 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16434] ppid=16421 vsize=15719476 CPUtime=945.59 cores=1,3,5,7
/proc/16423/task/16434/stat : 16434 (java) R 16421 16423 15661 0 -1 4202560 727835 0 0 0 94436 123 0 0 18 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780472591536 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=16423/tid=16435] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16435/stat : 16435 (java) S 16421 16423 15661 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16436] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16436/stat : 16436 (java) S 16421 16423 15661 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16437] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16437/stat : 16437 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118592433 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16438] ppid=16421 vsize=15719476 CPUtime=0.83 cores=1,3,5,7
/proc/16423/task/16438/stat : 16438 (java) S 16421 16423 15661 0 -1 4202560 5232 0 0 0 83 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16439] ppid=16421 vsize=15719476 CPUtime=1.65 cores=1,3,5,7
/proc/16423/task/16439/stat : 16439 (java) S 16421 16423 15661 0 -1 4202560 16131 0 0 0 163 2 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16440] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16440/stat : 16440 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16441] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16441/stat : 16441 (java) S 16421 16423 15661 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16447] ppid=16421 vsize=15719476 CPUtime=288.01 cores=1,3,5,7
/proc/16423/task/16447/stat : 16447 (java) S 16421 16423 15661 0 -1 4202560 102597 0 0 0 28784 17 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16448] ppid=16421 vsize=15719476 CPUtime=287.88 cores=1,3,5,7
/proc/16423/task/16448/stat : 16448 (java) S 16421 16423 15661 0 -1 4202560 120229 0 0 0 28772 16 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16449] ppid=16421 vsize=15719476 CPUtime=288.01 cores=1,3,5,7
/proc/16423/task/16449/stat : 16449 (java) S 16421 16423 15661 0 -1 4202560 108932 0 0 0 28784 17 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16450] ppid=16421 vsize=15719476 CPUtime=287.4 cores=1,3,5,7
/proc/16423/task/16450/stat : 16450 (java) S 16421 16423 15661 0 -1 4202560 120479 0 0 0 28716 24 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2122.79
Current children cumulated vsize (KiB) 15719476



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.82 4.03 5.63 2/193 16513
/proc/meminfo: memFree=9874880/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=15719476 CPUtime=2180.83 cores=1,3,5,7
/proc/16423/stat : 16423 (java) S 16421 16423 15661 0 -1 4202496 3890942 0 1 0 217434 649 0 0 20 0 22 0 504167911 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118571493 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16423/statm: 3929869 3849598 2294 9 0 3920588 0
[pid=16423/tid=16424] ppid=16421 vsize=15719476 CPUtime=2.26 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) S 16421 16423 15661 0 -1 4202560 35696 0 1 0 220 6 0 0 21 0 22 0 504167911 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16426] ppid=16421 vsize=15719476 CPUtime=3.16 cores=1,3,5,7
/proc/16423/task/16426/stat : 16426 (java) S 16421 16423 15661 0 -1 4202560 389369 0 0 0 253 63 0 0 15 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16427] ppid=16421 vsize=15719476 CPUtime=1.99 cores=1,3,5,7
/proc/16423/task/16427/stat : 16427 (java) S 16421 16423 15661 0 -1 4202560 264182 0 0 0 155 44 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16428] ppid=16421 vsize=15719476 CPUtime=3.1 cores=1,3,5,7
/proc/16423/task/16428/stat : 16428 (java) S 16421 16423 15661 0 -1 4202560 371367 0 0 0 251 59 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16429] ppid=16421 vsize=15719476 CPUtime=1.8 cores=1,3,5,7
/proc/16423/task/16429/stat : 16429 (java) S 16421 16423 15661 0 -1 4202560 176053 0 0 0 151 29 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16430] ppid=16421 vsize=15719476 CPUtime=2.38 cores=1,3,5,7
/proc/16423/task/16430/stat : 16430 (java) S 16421 16423 15661 0 -1 4202560 292539 0 0 0 189 49 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16431] ppid=16421 vsize=15719476 CPUtime=2.6 cores=1,3,5,7
/proc/16423/task/16431/stat : 16431 (java) S 16421 16423 15661 0 -1 4202560 391112 0 0 0 196 64 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16432] ppid=16421 vsize=15719476 CPUtime=3.2 cores=1,3,5,7
/proc/16423/task/16432/stat : 16432 (java) S 16421 16423 15661 0 -1 4202560 374941 0 0 0 261 59 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16433] ppid=16421 vsize=15719476 CPUtime=2.75 cores=1,3,5,7
/proc/16423/task/16433/stat : 16433 (java) S 16421 16423 15661 0 -1 4202560 392255 0 0 0 213 62 0 0 16 0 22 0 504167912 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
[pid=16423/tid=16434] ppid=16421 vsize=15719476 CPUtime=1003.19 cores=1,3,5,7
/proc/16423/task/16434/stat : 16434 (java) R 16421 16423 15661 0 -1 4202560 727839 0 0 0 100192 127 0 0 18 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 47780473425965 0 0 0 16800975 0 0 0 -1 5 0 0 0
[pid=16423/tid=16435] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16435/stat : 16435 (java) S 16421 16423 15661 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16436] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16436/stat : 16436 (java) S 16421 16423 15661 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 504167913 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16437] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16437/stat : 16437 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118592433 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16438] ppid=16421 vsize=15719476 CPUtime=0.83 cores=1,3,5,7
/proc/16423/task/16438/stat : 16438 (java) S 16421 16423 15661 0 -1 4202560 5232 0 0 0 83 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16439] ppid=16421 vsize=15719476 CPUtime=1.65 cores=1,3,5,7
/proc/16423/task/16439/stat : 16439 (java) S 16421 16423 15661 0 -1 4202560 16131 0 0 0 163 2 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16440] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16440/stat : 16440 (java) S 16421 16423 15661 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16441] ppid=16421 vsize=15719476 CPUtime=0 cores=1,3,5,7
/proc/16423/task/16441/stat : 16441 (java) S 16421 16423 15661 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 504167915 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118585344 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16447] ppid=16421 vsize=15719476 CPUtime=288.13 cores=1,3,5,7
/proc/16423/task/16447/stat : 16447 (java) S 16421 16423 15661 0 -1 4202560 102765 0 0 0 28795 18 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 5 0 0 0
[pid=16423/tid=16448] ppid=16421 vsize=15719476 CPUtime=287.99 cores=1,3,5,7
/proc/16423/task/16448/stat : 16448 (java) S 16421 16423 15661 0 -1 4202560 120237 0 0 0 28783 16 0 0 16 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 3 0 0 0
[pid=16423/tid=16449] ppid=16421 vsize=15719476 CPUtime=288.11 cores=1,3,5,7
/proc/16423/task/16449/stat : 16449 (java) S 16421 16423 15661 0 -1 4202560 108938 0 0 0 28794 17 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 7 0 0 0
[pid=16423/tid=16450] ppid=16421 vsize=15719476 CPUtime=287.51 cores=1,3,5,7
/proc/16423/task/16450/stat : 16450 (java) S 16421 16423 15661 0 -1 4202560 120826 0 0 0 28727 24 0 0 15 0 22 0 504167987 16096743424 3849598 33554432000 1073741824 1073778376 140736359866320 18446744073709551615 255118584729 0 4 0 16800975 18446604464881009792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2180.83
Current children cumulated vsize (KiB) 15719476

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -16423

[startup+1302.3 s]
/proc/loadavg: 1.75 3.98 5.61 2/194 16514
/proc/meminfo: memFree=9874732/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=0 CPUtime=2183.13 cores=1,3,5,7
/proc/16423/stat : 16423 (java) Z 16421 16423 15661 0 -1 4203548 3890967 0 1 0 217635 678 0 0 18 0 2 0 504167911 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/16423/statm: 0 0 0 0 0 0 0
[pid=16423/tid=16424] ppid=16421 vsize=0 CPUtime=2.54 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4203588 35696 0 1 0 220 34 0 0 18 0 2 0 504167911 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2183.13
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.5 s]
/proc/loadavg: 1.75 3.98 5.61 2/194 16514
/proc/meminfo: memFree=9874732/32951124 swapFree=67111448/67111528
[pid=16423] ppid=16421 vsize=0 CPUtime=2183.33 cores=1,3,5,7
/proc/16423/stat : 16423 (java) Z 16421 16423 15661 0 -1 4203548 3890967 0 1 0 217635 698 0 0 18 0 2 0 504167911 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/16423/statm: 0 0 0 0 0 0 0
[pid=16423/tid=16424] ppid=16421 vsize=0 CPUtime=2.74 cores=1,3,5,7
/proc/16423/task/16424/stat : 16424 (java) R 16421 16423 15661 0 -1 4203588 35696 0 1 0 220 54 0 0 18 0 2 0 504167911 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2183.33
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.58
CPU time (s): 2183.42
CPU user time (s): 2176.36
CPU system time (s): 7.05993
CPU usage (%): 167.623
Max. virtual memory (cumulated for all children) (KiB): 15719476

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2176.36
system time used= 7.05993
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3890967
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 67358
involuntary context switches= 37992

runsolver used 2.07668 second user time and 5.08023 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-30 00:51:58
IDJOB=3311272
IDBENCH=82657
IDSOLVER=1698
FILE ID=node144/3311272-1304117518
RUNJOBID= node144-1304117518-16387
PBS_JOBID= 13170685
Free space on /tmp= 72404 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v30000-c126000-S926207202-053-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311272-1304117518/watcher-3311272-1304117518 -o /tmp/evaluation-result-3311272-1304117518/solver-3311272-1304117518 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311272-1304117518.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bd4912a5ba3146c46ac3a58d7861d9a6
RANDOM SEED=1977837357

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25282248 kB
Buffers:       2108628 kB
Cached:        4940500 kB
SwapCached:         80 kB
Active:         159332 kB
Inactive:      6965896 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25282248 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            5888 kB
Writeback:           0 kB
AnonPages:       75952 kB
Mapped:          22240 kB
Slab:           480292 kB
PageTables:       4728 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   776868 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72404 MiB
End job on node144 at 2011-04-30 01:13:40