Trace number 3311773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 1706.44 1302.6

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1521_s.cnf
MD5SUM4e35cb9894b1ca841d462da2d6957cc5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63882
Number of clauses123981
Sum of the clauses size369562
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22381
Number of clauses of size 3121600
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	14:36 INFO : Reading from input HOME/instance-3311773-1304183675.cnf
0.93/0.76	Executor set job limit to 1000000
0.93/0.76	Executor set job limit to 1000000
0.93/0.76	Executor set job limit to 1000000
0.93/0.76	Executor set job limit to 1000000
0.93/0.76	Starting Executor!
0.93/0.76	Starting Executor!
0.93/0.76	Starting Executor!
0.93/0.76	Starting Executor!
3.58/2.04	14:38 INFO : 63842 variables remaining out of 63882
3.58/2.04	14:38 INFO : 500360 literals remaining out of 493543
575.63/175.55	17:23 ERROR: Failed to solve instance
575.63/175.55	java.lang.OutOfMemoryError: Java heap space
575.63/175.55		at ibis.structure.HyperBinaryResolution.<init>(HyperBinaryResolution.java:52)
575.63/175.55		at ibis.structure.Solver.simplify(Solver.java:191)
575.63/175.55		at ibis.structure.Solver.solve(Solver.java:113)
575.63/175.55		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
575.63/175.55		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
575.63/175.55		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
575.63/175.55		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
575.63/175.55		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
575.63/175.55		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
575.63/175.55		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
575.63/175.55		at ibis.constellation.Executor.processActivities(Executor.java:75)
575.63/175.55		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
575.63/175.55		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
575.63/175.55		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
576.03/175.93	17:31 ERROR: Failed to solve instance
576.03/175.93	java.lang.OutOfMemoryError: Java heap space
576.03/175.93		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
576.03/175.93		at gnu.trove.THash.postInsertHook(THash.java:370)
576.03/175.93		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
576.03/175.93		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
576.03/175.93		at ibis.structure.Subsumming.run(Subsumming.java:58)
576.03/175.93		at ibis.structure.Solver.simplify(Solver.java:205)
576.03/175.93		at ibis.structure.Solver.solve(Solver.java:113)
576.03/175.93		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
576.03/175.93		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
576.03/175.93		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
576.03/175.93		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
576.03/175.93		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
576.03/175.93		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
576.03/175.93		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
576.03/175.93		at ibis.constellation.Executor.processActivities(Executor.java:75)
576.03/175.93		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
576.03/175.93		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
576.03/175.93		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
579.77/179.53	17:35 ERROR: Failed to solve instance
579.77/179.53	java.lang.OutOfMemoryError: Java heap space
579.77/179.53		at gnu.trove.TIntArrayList.ensureCapacity(TIntArrayList.java:100)
579.77/179.53		at gnu.trove.TIntArrayList.add(TIntArrayList.java:144)
579.77/179.53		at ibis.structure.Subsumming.run(Subsumming.java:57)
579.77/179.53		at ibis.structure.Solver.simplify(Solver.java:205)
579.77/179.53		at ibis.structure.Solver.solve(Solver.java:113)
579.77/179.53		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
579.77/179.53		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
579.77/179.53		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
579.77/179.53		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
579.77/179.53		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
579.77/179.53		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
579.77/179.53		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
579.77/179.53		at ibis.constellation.Executor.processActivities(Executor.java:75)
579.77/179.53		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
579.77/179.54		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
579.77/179.54		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
601.76/201.08	17:56 ERROR: Failed to solve instance
601.76/201.08	java.lang.OutOfMemoryError: Java heap space
601.76/201.08		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
601.76/201.08		at gnu.trove.THash.postInsertHook(THash.java:370)
601.76/201.08		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
601.76/201.08		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
601.76/201.08		at ibis.structure.Subsumming.run(Subsumming.java:58)
601.76/201.08		at ibis.structure.Solver.simplify(Solver.java:205)
601.76/201.08		at ibis.structure.Solver.solve(Solver.java:113)
601.76/201.08		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
601.76/201.08		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
601.76/201.08		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
601.76/201.08		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
601.76/201.08		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
601.76/201.08		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
601.76/201.08		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
601.76/201.08		at ibis.constellation.Executor.processActivities(Executor.java:75)
601.76/201.08		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
601.76/201.08		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
601.76/201.08		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
613.10/212.33	18:08 ERROR: Failed to solve instance
613.10/212.33	java.lang.OutOfMemoryError: Java heap space
613.81/213.07	18:08 ERROR: Failed to solve instance
613.81/213.07	java.lang.OutOfMemoryError: Java heap space
693.62/292.85	19:28 ERROR: Failed to solve instance
693.62/292.85	java.lang.OutOfMemoryError: Java heap space
696.48/295.61	19:31 ERROR: Failed to solve instance
696.48/295.61	java.lang.OutOfMemoryError: Java heap space
700.31/299.44	19:35 ERROR: Failed to solve instance
700.31/299.44	java.lang.OutOfMemoryError: Java heap space
747.55/346.60	20:05 ERROR: Failed to solve instance
747.55/346.60	java.lang.OutOfMemoryError: Java heap space
768.48/367.57	20:43 ERROR: Failed to solve instance
768.48/367.57	java.lang.OutOfMemoryError: Java heap space
772.20/371.29	20:47 ERROR: Failed to solve instance
772.20/371.29	java.lang.OutOfMemoryError: Java heap space
774.25/373.28	20:49 ERROR: Failed to solve instance
774.25/373.28	java.lang.OutOfMemoryError: Java heap space
776.71/375.69	20:51 ERROR: Failed to solve instance
776.71/375.69	java.lang.OutOfMemoryError: Java heap space
779.55/378.49	20:54 ERROR: Failed to solve instance
779.55/378.49	java.lang.OutOfMemoryError: Java heap space
779.95/378.84	20:54 ERROR: Failed to solve instance
779.95/378.84	java.lang.OutOfMemoryError: Java heap space
789.75/387.96	Exception in thread "SingleThreadedConstellation 2" java.lang.OutOfMemoryError: Java heap space
792.94/391.10	21:07 ERROR: Failed to solve instance
792.94/391.10	java.lang.OutOfMemoryError: Java heap space
794.76/392.94	21:08 ERROR: Failed to solve instance
794.76/392.94	java.lang.OutOfMemoryError: Java heap space
796.69/394.87	21:10 ERROR: Failed to solve instance
796.69/394.87	java.lang.OutOfMemoryError: Java heap space
799.72/397.81	21:13 ERROR: Failed to solve instance
799.72/397.81	java.lang.OutOfMemoryError: Java heap space
800.85/398.97	21:14 ERROR: Failed to solve instance
800.85/398.97	java.lang.OutOfMemoryError: Java heap space
802.10/400.15	21:16 ERROR: Failed to solve instance
802.10/400.15	java.lang.OutOfMemoryError: Java heap space
810.55/408.02	21:24 ERROR: Failed to solve instance
810.55/408.02	java.lang.OutOfMemoryError: Java heap space
811.99/409.49	21:25 ERROR: Failed to solve instance
811.99/409.49	java.lang.OutOfMemoryError: Java heap space
812.39/409.84	21:25 ERROR: Failed to solve instance
812.39/409.84	java.lang.OutOfMemoryError: Java heap space
832.79/430.22	21:46 ERROR: Failed to solve instance
832.79/430.22	java.lang.OutOfMemoryError: Java heap space
892.91/490.35	22:38 ERROR: Failed to solve instance
892.91/490.35	java.lang.OutOfMemoryError: Java heap space
1143.75/741.15	26:57 ERROR: Failed to solve instance
1143.75/741.15	java.lang.OutOfMemoryError: Java heap space
1168.98/766.31	27:22 ERROR: Failed to solve instance
1168.98/766.31	java.lang.OutOfMemoryError: Java heap space
1170.90/768.26	27:24 ERROR: Failed to solve instance
1170.90/768.26	java.lang.OutOfMemoryError: Java heap space
1171.10/768.49	27:24 ERROR: Failed to solve instance
1171.10/768.49	java.lang.OutOfMemoryError: Java heap space
1175.95/773.09	27:29 ERROR: Failed to solve instance
1175.95/773.09	java.lang.OutOfMemoryError: Java heap space
1183.56/780.41	27:36 ERROR: Failed to solve instance
1183.56/780.41	java.lang.OutOfMemoryError: Java heap space
1185.44/782.30	27:38 ERROR: Failed to solve instance
1185.44/782.30	java.lang.OutOfMemoryError: Java heap space
1186.95/783.79	27:39 ERROR: Failed to solve instance
1186.95/783.79	java.lang.OutOfMemoryError: Java heap space
1499.72/1096.48	32:52 ERROR: Failed to solve instance
1499.72/1096.48	java.lang.OutOfMemoryError: Java heap space
1501.67/1098.34	32:54 ERROR: Failed to solve instance
1501.67/1098.34	java.lang.OutOfMemoryError: Java heap space
1503.30/1099.99	32:56 ERROR: Failed to solve instance
1503.30/1099.99	java.lang.OutOfMemoryError: Java heap space
1512.89/1109.16	33:05 ERROR: Failed to solve instance
1512.89/1109.16	java.lang.OutOfMemoryError: Java heap space
1581.21/1177.45	33:51 ERROR: Failed to solve instance
1581.21/1177.45	java.lang.OutOfMemoryError: Java heap space

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311773-1304183675/watcher-3311773-1304183675 -o /tmp/evaluation-result-3311773-1304183675/solver-3311773-1304183675 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311773-1304183675.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.73 4.12 5.51 2/192 591
/proc/meminfo: memFree=30728908/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=9100 CPUtime=0 cores=0,2,4,6
/proc/591/stat : 591 (java) R 589 591 32546 0 -1 4202496 493 0 0 0 0 0 0 0 22 0 1 0 529967187 9318400 154 33554432000 1073741824 1073778376 140733759388240 18446744073709551615 274664631895 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/591/statm: 2275 154 125 9 0 67 0

[startup+0.0216749 s]
/proc/loadavg: 3.73 4.12 5.51 2/192 591
/proc/meminfo: memFree=30728908/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15602060 CPUtime=0.01 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 3305 0 1 0 1 0 0 0 22 0 11 0 529967187 15976509440 2747 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16784584 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3900515 2750 1598 9 0 3891263 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15602060

[startup+0.100654 s]
/proc/loadavg: 3.73 4.12 5.51 2/192 591
/proc/meminfo: memFree=30728908/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15742268 CPUtime=0.1 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 5565 0 1 0 9 1 0 0 22 0 18 0 529967187 16120082432 4976 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3935567 4976 2117 9 0 3926286 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15742268

[startup+0.300639 s]
/proc/loadavg: 3.73 4.12 5.51 2/192 591
/proc/meminfo: memFree=30728908/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15747600 CPUtime=0.52 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 14859 0 1 0 49 3 0 0 22 0 18 0 529967187 16125542400 13027 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3936900 13033 2207 9 0 3927619 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15747600

[startup+0.700546 s]
/proc/loadavg: 3.73 4.12 5.51 2/192 591
/proc/meminfo: memFree=30728908/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15747600 CPUtime=0.93 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 41921 0 1 0 87 6 0 0 22 0 18 0 529967187 16125542400 40087 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3936900 40087 2223 9 0 3927619 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 15747600

[startup+1.50138 s]
/proc/loadavg: 3.73 4.12 5.51 12/218 627
/proc/meminfo: memFree=30345216/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15770800 CPUtime=2.54 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 55463 0 1 0 245 9 0 0 22 0 22 0 529967187 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3942700 49574 2262 9 0 3933419 0
[pid=591/tid=593] ppid=589 vsize=15770800 CPUtime=1.47 cores=0,2,4,6
/proc/591/task/593/stat : 593 (java) R 589 591 32546 0 -1 4202560 35679 0 1 0 142 5 0 0 21 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543871696896 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=591/tid=594] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/594/stat : 594 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=595] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/595/stat : 595 (java) S 589 591 32546 0 -1 4202560 706 0 0 0 0 0 0 0 18 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=606] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/606/stat : 606 (java) S 589 591 32546 0 -1 4202560 770 0 0 0 0 0 0 0 16 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=607] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/607/stat : 607 (java) S 589 591 32546 0 -1 4202560 265 0 0 0 0 0 0 0 18 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=608] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/608/stat : 608 (java) S 589 591 32546 0 -1 4202560 1287 0 0 0 0 0 0 0 18 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=609] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/609/stat : 609 (java) S 589 591 32546 0 -1 4202560 15 0 0 0 0 0 0 0 17 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=610] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/610/stat : 610 (java) S 589 591 32546 0 -1 4202560 1468 0 0 0 0 0 0 0 16 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=611] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 114 0 0 0 0 0 0 0 18 0 22 0 529967188 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=612] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) S 589 591 32546 0 -1 4202560 72 0 0 0 0 0 0 0 18 0 22 0 529967189 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 0 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=613] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529967189 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529967190 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529967192 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15770800 CPUtime=0.23 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 2646 0 0 0 23 0 0 0 15 0 22 0 529967192 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=617] ppid=589 vsize=15770800 CPUtime=0.76 cores=0,2,4,6
/proc/591/task/617/stat : 617 (java) R 589 591 32546 0 -1 4202560 11014 0 0 0 75 1 0 0 18 0 22 0 529967192 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543870150189 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529967192 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=619] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/619/stat : 619 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529967192 16149299200 49574 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=624] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/624/stat : 624 (java) S 589 591 32546 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 529967263 16149299200 49576 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=625] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/625/stat : 625 (java) S 589 591 32546 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 529967263 16149299200 49577 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=626] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/626/stat : 626 (java) S 589 591 32546 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 529967264 16149299200 49578 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=627] ppid=589 vsize=15770800 CPUtime=0 cores=0,2,4,6
/proc/591/task/627/stat : 627 (java) S 589 591 32546 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 529967264 16149299200 49578 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.54
Current children cumulated vsize (KiB) 15770800

[startup+4.21192 s]
/proc/loadavg: 3.73 4.12 5.51 10/218 627
/proc/meminfo: memFree=30035960/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15768624 CPUtime=9.8 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 273333 0 1 0 940 40 0 0 22 0 22 0 529967187 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3942156 262929 2275 9 0 3932875 0
[pid=591/tid=593] ppid=589 vsize=15768624 CPUtime=2.01 cores=0,2,4,6
/proc/591/task/593/stat : 593 (java) S 589 591 32546 0 -1 4202560 35729 0 1 0 196 5 0 0 22 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=594] ppid=589 vsize=15768624 CPUtime=0.09 cores=0,2,4,6
/proc/591/task/594/stat : 594 (java) R 589 591 32546 0 -1 4202560 14878 0 0 0 7 2 0 0 16 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=591/tid=595] ppid=589 vsize=15768624 CPUtime=0.07 cores=0,2,4,6
/proc/591/task/595/stat : 595 (java) S 589 591 32546 0 -1 4202560 13600 0 0 0 6 1 0 0 16 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=606] ppid=589 vsize=15768624 CPUtime=0.13 cores=0,2,4,6
/proc/591/task/606/stat : 606 (java) S 589 591 32546 0 -1 4202560 23567 0 0 0 9 4 0 0 15 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=607] ppid=589 vsize=15768624 CPUtime=0.16 cores=0,2,4,6
/proc/591/task/607/stat : 607 (java) S 589 591 32546 0 -1 4202560 31037 0 0 0 12 4 0 0 15 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=608] ppid=589 vsize=15768624 CPUtime=0.08 cores=0,2,4,6
/proc/591/task/608/stat : 608 (java) S 589 591 32546 0 -1 4202560 13385 0 0 0 6 2 0 0 15 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=609] ppid=589 vsize=15768624 CPUtime=0.12 cores=0,2,4,6
/proc/591/task/609/stat : 609 (java) S 589 591 32546 0 -1 4202560 28338 0 0 0 8 4 0 0 16 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=610] ppid=589 vsize=15768624 CPUtime=0.06 cores=0,2,4,6
/proc/591/task/610/stat : 610 (java) S 589 591 32546 0 -1 4202560 10596 0 0 0 6 0 0 0 15 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=611] ppid=589 vsize=15768624 CPUtime=0.06 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 7631 0 0 0 5 1 0 0 15 0 22 0 529967188 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=612] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) S 589 591 32546 0 -1 4202560 598 0 0 0 0 0 0 0 15 0 22 0 529967189 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 0 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=613] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529967189 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529967190 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529967192 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15768624 CPUtime=0.76 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 6173 0 0 0 75 1 0 0 15 0 22 0 529967192 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=617] ppid=589 vsize=15768624 CPUtime=1.23 cores=0,2,4,6
/proc/591/task/617/stat : 617 (java) S 589 591 32546 0 -1 4202560 11140 0 0 0 122 1 0 0 15 0 22 0 529967192 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529967192 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=619] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/619/stat : 619 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529967192 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=624] ppid=589 vsize=15768624 CPUtime=1.03 cores=0,2,4,6
/proc/591/task/624/stat : 624 (java) R 589 591 32546 0 -1 4202560 6293 0 0 0 103 0 0 0 16 0 22 0 529967263 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 46912506221603 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=591/tid=625] ppid=589 vsize=15768624 CPUtime=1.11 cores=0,2,4,6
/proc/591/task/625/stat : 625 (java) R 589 591 32546 0 -1 4202560 29238 0 0 0 108 3 0 0 15 0 22 0 529967263 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543873119104 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=591/tid=626] ppid=589 vsize=15768624 CPUtime=1.51 cores=0,2,4,6
/proc/591/task/626/stat : 626 (java) R 589 591 32546 0 -1 4202560 18931 0 0 0 149 2 0 0 15 0 22 0 529967264 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 46912506396739 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=591/tid=627] ppid=589 vsize=15768624 CPUtime=1.21 cores=0,2,4,6
/proc/591/task/627/stat : 627 (java) R 589 591 32546 0 -1 4202560 20814 0 0 0 120 1 0 0 15 0 22 0 529967264 16147070976 262929 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 46912506423431 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.8
Current children cumulated vsize (KiB) 15768624

[startup+6.30152 s]
/proc/loadavg: 4.47 4.27 5.55 6/218 627
/proc/meminfo: memFree=26769580/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15768624 CPUtime=17.5 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 483878 0 1 0 1676 74 0 0 22 0 22 0 529967187 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3942156 473031 2283 9 0 3932875 0
[pid=591/tid=593] ppid=589 vsize=15768624 CPUtime=2.01 cores=0,2,4,6
/proc/591/task/593/stat : 593 (java) S 589 591 32546 0 -1 4202560 35729 0 1 0 196 5 0 0 22 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=594] ppid=589 vsize=15768624 CPUtime=0.11 cores=0,2,4,6
/proc/591/task/594/stat : 594 (java) S 589 591 32546 0 -1 4202560 17138 0 0 0 9 2 0 0 15 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=595] ppid=589 vsize=15768624 CPUtime=0.18 cores=0,2,4,6
/proc/591/task/595/stat : 595 (java) S 589 591 32546 0 -1 4202560 28222 0 0 0 14 4 0 0 16 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=606] ppid=589 vsize=15768624 CPUtime=0.26 cores=0,2,4,6
/proc/591/task/606/stat : 606 (java) S 589 591 32546 0 -1 4202560 62576 0 0 0 15 11 0 0 16 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=607] ppid=589 vsize=15768624 CPUtime=0.16 cores=0,2,4,6
/proc/591/task/607/stat : 607 (java) S 589 591 32546 0 -1 4202560 31037 0 0 0 12 4 0 0 15 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=608] ppid=589 vsize=15768624 CPUtime=0.15 cores=0,2,4,6
/proc/591/task/608/stat : 608 (java) S 589 591 32546 0 -1 4202560 28247 0 0 0 11 4 0 0 15 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=609] ppid=589 vsize=15768624 CPUtime=0.21 cores=0,2,4,6
/proc/591/task/609/stat : 609 (java) S 589 591 32546 0 -1 4202560 39473 0 0 0 15 6 0 0 15 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=610] ppid=589 vsize=15768624 CPUtime=0.14 cores=0,2,4,6
/proc/591/task/610/stat : 610 (java) S 589 591 32546 0 -1 4202560 35085 0 0 0 9 5 0 0 16 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=611] ppid=589 vsize=15768624 CPUtime=0.22 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 42068 0 0 0 14 8 0 0 16 0 22 0 529967188 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=612] ppid=589 vsize=15768624 CPUtime=0.2 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) S 589 591 32546 0 -1 4202560 12116 0 0 0 19 1 0 0 16 0 22 0 529967189 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 0 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=613] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529967189 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529967190 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529967192 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15768624 CPUtime=0.79 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 6406 0 0 0 78 1 0 0 15 0 22 0 529967192 16147070976 473031 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=591/tid=611] ppid=589 vsize=15768624 CPUtime=2.9 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 359904 0 0 0 221 69 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=612] ppid=589 vsize=15768624 CPUtime=1043.67 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) R 589 591 32546 0 -1 4202560 675606 0 0 0 104213 154 0 0 18 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543868227721 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=591/tid=613] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 21 0 529967190 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15768624 CPUtime=0.95 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 6441 0 0 0 94 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=617] ppid=589 vsize=15768624 CPUtime=1.29 cores=0,2,4,6
/proc/591/task/617/stat : 617 (java) S 589 591 32546 0 -1 4202560 11142 0 0 0 128 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=619] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/619/stat : 619 (java) S 589 591 32546 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=624] ppid=589 vsize=15768624 CPUtime=128.59 cores=0,2,4,6
/proc/591/task/624/stat : 624 (java) S 589 591 32546 0 -1 4202560 74102 0 0 0 12835 24 0 0 15 0 21 0 529967263 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=626] ppid=589 vsize=15768624 CPUtime=129.16 cores=0,2,4,6
/proc/591/task/626/stat : 626 (java) S 589 591 32546 0 -1 4202560 100764 0 0 0 12897 19 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=627] ppid=589 vsize=15768624 CPUtime=128.98 cores=0,2,4,6
/proc/591/task/627/stat : 627 (java) S 589 591 32546 0 -1 4202560 92684 0 0 0 12878 20 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1586.11
Current children cumulated vsize (KiB) 15768624

[startup+1242.3 s]
/proc/loadavg: 4.87 5.00 5.29 6/217 711
/proc/meminfo: memFree=15086956/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15768624 CPUtime=1646.12 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 3917410 0 1 0 163853 759 0 0 22 0 21 0 529967187 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3942156 3834470 2295 9 0 3932875 0
[pid=591/tid=593] ppid=589 vsize=15768624 CPUtime=2.01 cores=0,2,4,6
/proc/591/task/593/stat : 593 (java) S 589 591 32546 0 -1 4202560 35729 0 1 0 196 5 0 0 22 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=594] ppid=589 vsize=15768624 CPUtime=3.17 cores=0,2,4,6
/proc/591/task/594/stat : 594 (java) S 589 591 32546 0 -1 4202560 354157 0 0 0 253 64 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=595] ppid=589 vsize=15768624 CPUtime=2.62 cores=0,2,4,6
/proc/591/task/595/stat : 595 (java) S 589 591 32546 0 -1 4202560 274603 0 0 0 218 44 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=606] ppid=589 vsize=15768624 CPUtime=3.03 cores=0,2,4,6
/proc/591/task/606/stat : 606 (java) S 589 591 32546 0 -1 4202560 330269 0 0 0 242 61 0 0 15 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=607] ppid=589 vsize=15768624 CPUtime=3.19 cores=0,2,4,6
/proc/591/task/607/stat : 607 (java) S 589 591 32546 0 -1 4202560 396423 0 0 0 249 70 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=608] ppid=589 vsize=15768624 CPUtime=3.29 cores=0,2,4,6
/proc/591/task/608/stat : 608 (java) S 589 591 32546 0 -1 4202560 456268 0 0 0 252 77 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=609] ppid=589 vsize=15768624 CPUtime=2.92 cores=0,2,4,6
/proc/591/task/609/stat : 609 (java) S 589 591 32546 0 -1 4202560 329557 0 0 0 234 58 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=610] ppid=589 vsize=15768624 CPUtime=3 cores=0,2,4,6
/proc/591/task/610/stat : 610 (java) S 589 591 32546 0 -1 4202560 318679 0 0 0 244 56 0 0 15 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=611] ppid=589 vsize=15768624 CPUtime=2.9 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 359904 0 0 0 221 69 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=612] ppid=589 vsize=15768624 CPUtime=1103.61 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) R 589 591 32546 0 -1 4202560 675608 0 0 0 110199 162 0 0 18 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543870169571 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=591/tid=613] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 21 0 529967190 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15768624 CPUtime=0.95 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 6441 0 0 0 94 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=617] ppid=589 vsize=15768624 CPUtime=1.29 cores=0,2,4,6
/proc/591/task/617/stat : 617 (java) S 589 591 32546 0 -1 4202560 11142 0 0 0 128 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=619] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/619/stat : 619 (java) S 589 591 32546 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=624] ppid=589 vsize=15768624 CPUtime=128.61 cores=0,2,4,6
/proc/591/task/624/stat : 624 (java) S 589 591 32546 0 -1 4202560 74532 0 0 0 12836 25 0 0 15 0 21 0 529967263 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=626] ppid=589 vsize=15768624 CPUtime=129.19 cores=0,2,4,6
/proc/591/task/626/stat : 626 (java) S 589 591 32546 0 -1 4202560 101081 0 0 0 12899 20 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=627] ppid=589 vsize=15768624 CPUtime=129 cores=0,2,4,6
/proc/591/task/627/stat : 627 (java) S 589 591 32546 0 -1 4202560 92734 0 0 0 12880 20 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1646.12
Current children cumulated vsize (KiB) 15768624



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 5.01 5.01 5.27 6/217 712
/proc/meminfo: memFree=14952040/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=15768624 CPUtime=1703.83 cores=0,2,4,6
/proc/591/stat : 591 (java) S 589 591 32546 0 -1 4202496 3918182 0 1 0 169614 769 0 0 22 0 21 0 529967187 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/591/statm: 3942156 3834470 2295 9 0 3932875 0
[pid=591/tid=593] ppid=589 vsize=15768624 CPUtime=2.01 cores=0,2,4,6
/proc/591/task/593/stat : 593 (java) S 589 591 32546 0 -1 4202560 35729 0 1 0 196 5 0 0 22 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=594] ppid=589 vsize=15768624 CPUtime=3.17 cores=0,2,4,6
/proc/591/task/594/stat : 594 (java) S 589 591 32546 0 -1 4202560 354157 0 0 0 253 64 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=595] ppid=589 vsize=15768624 CPUtime=2.62 cores=0,2,4,6
/proc/591/task/595/stat : 595 (java) S 589 591 32546 0 -1 4202560 274603 0 0 0 218 44 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=606] ppid=589 vsize=15768624 CPUtime=3.03 cores=0,2,4,6
/proc/591/task/606/stat : 606 (java) S 589 591 32546 0 -1 4202560 330269 0 0 0 242 61 0 0 15 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=607] ppid=589 vsize=15768624 CPUtime=3.19 cores=0,2,4,6
/proc/591/task/607/stat : 607 (java) S 589 591 32546 0 -1 4202560 396423 0 0 0 249 70 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=608] ppid=589 vsize=15768624 CPUtime=3.29 cores=0,2,4,6
/proc/591/task/608/stat : 608 (java) S 589 591 32546 0 -1 4202560 456268 0 0 0 252 77 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=609] ppid=589 vsize=15768624 CPUtime=2.92 cores=0,2,4,6
/proc/591/task/609/stat : 609 (java) S 589 591 32546 0 -1 4202560 329557 0 0 0 234 58 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=610] ppid=589 vsize=15768624 CPUtime=3 cores=0,2,4,6
/proc/591/task/610/stat : 610 (java) S 589 591 32546 0 -1 4202560 318679 0 0 0 244 56 0 0 15 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=611] ppid=589 vsize=15768624 CPUtime=2.9 cores=0,2,4,6
/proc/591/task/611/stat : 611 (java) S 589 591 32546 0 -1 4202560 359904 0 0 0 221 69 0 0 16 0 21 0 529967188 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=612] ppid=589 vsize=15768624 CPUtime=1161.27 cores=0,2,4,6
/proc/591/task/612/stat : 612 (java) R 589 591 32546 0 -1 4202560 675612 0 0 0 115958 169 0 0 18 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 47543872886979 0 0 0 16800975 0 0 0 -1 4 0 0 0
[pid=591/tid=613] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/613/stat : 613 (java) S 589 591 32546 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 21 0 529967189 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=614] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/614/stat : 614 (java) S 589 591 32546 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 21 0 529967190 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 6 0 0 0
[pid=591/tid=615] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/615/stat : 615 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676631985 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
[pid=591/tid=616] ppid=589 vsize=15768624 CPUtime=0.95 cores=0,2,4,6
/proc/591/task/616/stat : 616 (java) S 589 591 32546 0 -1 4202560 6441 0 0 0 94 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=617] ppid=589 vsize=15768624 CPUtime=1.29 cores=0,2,4,6
/proc/591/task/617/stat : 617 (java) S 589 591 32546 0 -1 4202560 11142 0 0 0 128 1 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) S 589 591 32546 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=619] ppid=589 vsize=15768624 CPUtime=0 cores=0,2,4,6
/proc/591/task/619/stat : 619 (java) S 589 591 32546 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 21 0 529967192 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624896 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=624] ppid=589 vsize=15768624 CPUtime=128.63 cores=0,2,4,6
/proc/591/task/624/stat : 624 (java) S 589 591 32546 0 -1 4202560 74777 0 0 0 12837 26 0 0 15 0 21 0 529967263 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 2 0 0 0
[pid=591/tid=626] ppid=589 vsize=15768624 CPUtime=129.2 cores=0,2,4,6
/proc/591/task/626/stat : 626 (java) S 589 591 32546 0 -1 4202560 101563 0 0 0 12900 20 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 0 0 0 0
[pid=591/tid=627] ppid=589 vsize=15768624 CPUtime=129.02 cores=0,2,4,6
/proc/591/task/627/stat : 627 (java) S 589 591 32546 0 -1 4202560 92771 0 0 0 12881 21 0 0 15 0 21 0 529967264 16147070976 3834470 33554432000 1073741824 1073778376 140734449144528 18446744073709551615 274676624281 0 4 0 16800975 18446604445722339264 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1703.83
Current children cumulated vsize (KiB) 15768624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -591

[startup+1302.3 s]
/proc/loadavg: 5.01 5.01 5.27 6/218 713
/proc/meminfo: memFree=14895732/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=0 CPUtime=1706.12 cores=0,2,4,6
/proc/591/stat : 591 (java) Z 589 591 32546 0 -1 4203548 3918214 0 1 0 169815 797 0 0 18 0 2 0 529967187 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/591/statm: 0 0 0 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=0 CPUtime=0.28 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) R 589 591 32546 0 -1 4203588 1 0 0 0 0 28 0 0 18 0 2 0 529967192 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1706.12
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.4 s]
/proc/loadavg: 5.01 5.01 5.27 6/218 713
/proc/meminfo: memFree=14895732/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=0 CPUtime=1706.22 cores=0,2,4,6
/proc/591/stat : 591 (java) Z 589 591 32546 0 -1 4203548 3918214 0 1 0 169815 807 0 0 18 0 2 0 529967187 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/591/statm: 0 0 0 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=0 CPUtime=0.38 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) R 589 591 32546 0 -1 4203588 1 0 0 0 0 38 0 0 18 0 2 0 529967192 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1706.22
Current children cumulated vsize (KiB) 0

[startup+1302.5 s]
/proc/loadavg: 5.01 5.01 5.27 6/198 713
/proc/meminfo: memFree=27665852/32951132 swapFree=67111356/67111528
[pid=591] ppid=589 vsize=0 CPUtime=1706.32 cores=0,2,4,6
/proc/591/stat : 591 (java) Z 589 591 32546 0 -1 4203548 3918214 0 1 0 169815 817 0 0 18 0 2 0 529967187 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/591/statm: 0 0 0 0 0 0 0
[pid=591/tid=618] ppid=589 vsize=0 CPUtime=0.48 cores=0,2,4,6
/proc/591/task/618/stat : 618 (java) R 589 591 32546 0 -1 4203588 1 0 0 0 0 48 0 0 18 0 2 0 529967192 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1706.32
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.6
CPU time (s): 1706.44
CPU user time (s): 1698.16
CPU system time (s): 8.27874
CPU usage (%): 131.002
Max. virtual memory (cumulated for all children) (KiB): 15770800

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1698.16
system time used= 8.27874
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3918214
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 94498
involuntary context switches= 40732

runsolver used 2.05069 second user time and 5.49416 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-30 19:14:36
IDJOB=3311773
IDBENCH=83191
IDSOLVER=1698
FILE ID=node131/3311773-1304183675
RUNJOBID= node131-1304183675-554
PBS_JOBID= 13172445
Free space on /tmp= 72056 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1521_s.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311773-1304183675/watcher-3311773-1304183675 -o /tmp/evaluation-result-3311773-1304183675/solver-3311773-1304183675 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311773-1304183675.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4e35cb9894b1ca841d462da2d6957cc5
RANDOM SEED=1604287019

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30729196 kB
Buffers:        262296 kB
Cached:        1574900 kB
SwapCached:        168 kB
Active:         264444 kB
Inactive:      1647436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30729196 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:            6024 kB
Writeback:           0 kB
AnonPages:       74500 kB
Mapped:          21360 kB
Slab:           247976 kB
PageTables:       5036 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   783404 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72056 MiB
End job on node131 at 2011-04-30 19:36:18