Trace number 3312356

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 2192.33 1302.52

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S1368340883-085-UNKNOWN.cnf
MD5SUMc6eeff67aa308a86267a5f4d04512b40
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark50.5953
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	18:59 INFO : Reading from input HOME/instance-3312356-1304111939.cnf
1.13/0.91	Executor set job limit to 1000000
1.13/0.91	Executor set job limit to 1000000
1.13/0.91	Executor set job limit to 1000000
1.13/0.91	Executor set job limit to 1000000
1.13/0.91	Starting Executor!
1.13/0.91	Starting Executor!
1.13/0.91	Starting Executor!
1.13/0.91	Starting Executor!
3.68/2.38	19:01 INFO : 39840 variables remaining out of 40000
3.68/2.38	19:01 INFO : 667932 literals remaining out of 672000
1204.91/324.65	24:24 ERROR: Failed to solve instance
1204.91/324.65	java.lang.OutOfMemoryError: Java heap space
1204.91/324.65		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1204.91/324.65		at gnu.trove.THash.postInsertHook(THash.java:370)
1204.91/324.65		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1204.91/324.65		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1204.91/324.65		at ibis.structure.Subsumming.run(Subsumming.java:58)
1204.91/324.65		at ibis.structure.Solver.simplify(Solver.java:205)
1204.91/324.65		at ibis.structure.Solver.solve(Solver.java:113)
1204.91/324.65		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1204.91/324.65		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1204.91/324.65		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1204.91/324.65		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1204.91/324.65		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1204.91/324.65		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1204.91/324.65		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1204.91/324.65		at ibis.constellation.Executor.processActivities(Executor.java:75)
1204.91/324.65		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1204.91/324.65		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1204.91/324.65		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1210.28/329.76	24:29 ERROR: Failed to solve instance
1210.28/329.76	java.lang.OutOfMemoryError: Java heap space
1210.28/329.76		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:222)
1210.28/329.76		at gnu.trove.THash.postInsertHook(THash.java:370)
1210.28/329.76		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1210.28/329.76		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1210.28/329.76		at ibis.structure.Subsumming.run(Subsumming.java:58)
1210.28/329.76		at ibis.structure.Solver.simplify(Solver.java:205)
1210.28/329.76		at ibis.structure.Solver.solve(Solver.java:113)
1210.28/329.76		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1210.28/329.76		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1210.28/329.76		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1210.28/329.76		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1210.28/329.76		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1210.28/329.76		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1210.28/329.76		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1210.28/329.76		at ibis.constellation.Executor.processActivities(Executor.java:75)
1210.28/329.76		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1210.28/329.76		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1210.28/329.76		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1311.09/428.75	26:08 ERROR: Failed to solve instance
1311.09/428.75	java.lang.OutOfMemoryError: Java heap space
1311.09/428.75		at ibis.structure.Subsumming.run(Subsumming.java:46)
1311.09/428.75		at ibis.structure.Solver.simplify(Solver.java:205)
1311.09/428.75		at ibis.structure.Solver.solve(Solver.java:113)
1311.09/428.75		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1311.09/428.75		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1311.09/428.75		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1311.09/428.75		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1311.09/428.75		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1311.09/428.75		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1311.09/428.75		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1311.09/428.75		at ibis.constellation.Executor.processActivities(Executor.java:75)
1311.09/428.75		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1311.09/428.75		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1311.09/428.75		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1318.20/435.35	26:14 ERROR: Failed to solve instance
1318.20/435.35	java.lang.OutOfMemoryError: Java heap space
1318.20/435.35		at gnu.trove.TIntLongHashMap.rehash(TIntLongHashMap.java:221)
1318.20/435.35		at gnu.trove.THash.postInsertHook(THash.java:370)
1318.20/435.35		at gnu.trove.TIntLongHashMap.doPut(TIntLongHashMap.java:193)
1318.20/435.35		at gnu.trove.TIntLongHashMap.put(TIntLongHashMap.java:160)
1318.20/435.35		at ibis.structure.Subsumming.run(Subsumming.java:58)
1318.20/435.35		at ibis.structure.Solver.simplify(Solver.java:205)
1318.20/435.35		at ibis.structure.Solver.solve(Solver.java:113)
1318.20/435.35		at ibis.structure.SolveActivity.initialize(SolveActivity.java:29)
1318.20/435.35		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
1318.20/435.35		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
1318.20/435.35		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
1318.20/435.35		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
1318.20/435.35		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
1318.20/435.35		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
1318.20/435.35		at ibis.constellation.Executor.processActivities(Executor.java:75)
1318.20/435.35		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
1318.20/435.35		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
1318.20/435.35		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
1322.74/439.82	26:19 ERROR: Failed to solve instance
1322.74/439.82	java.lang.OutOfMemoryError: Java heap space
1325.81/442.81	26:22 ERROR: Failed to solve instance
1325.81/442.81	java.lang.OutOfMemoryError: Java heap space
1329.32/446.02	26:25 ERROR: Failed to solve instance
1329.32/446.02	java.lang.OutOfMemoryError: Java heap space
1333.42/449.96	26:29 ERROR: Failed to solve instance
1333.42/449.96	java.lang.OutOfMemoryError: Java heap space
1335.21/451.62	26:31 ERROR: Failed to solve instance
1335.21/451.62	java.lang.OutOfMemoryError: Java heap space
1338.39/454.54	26:33 ERROR: Failed to solve instance
1338.39/454.54	java.lang.OutOfMemoryError: Java heap space
1344.82/460.42	26:39 ERROR: Failed to solve instance
1344.82/460.42	java.lang.OutOfMemoryError: Java heap space
1542.39/656.15	29:55 ERROR: Failed to solve instance
1542.39/656.15	java.lang.OutOfMemoryError: Java heap space
1779.84/892.96	33:52 ERROR: Failed to solve instance
1779.84/892.96	java.lang.OutOfMemoryError: Java heap space
1780.35/893.42	33:52 ERROR: Failed to solve instance
1780.35/893.42	java.lang.OutOfMemoryError: Java heap space
1781.06/894.16	33:53 ERROR: Failed to solve instance
1781.06/894.16	java.lang.OutOfMemoryError: Java heap space
1786.81/899.88	33:59 ERROR: Failed to solve instance
1786.81/899.88	java.lang.OutOfMemoryError: Java heap space
1923.53/1036.00	36:15 ERROR: Failed to solve instance
1923.53/1036.00	java.lang.OutOfMemoryError: Java heap space
2069.49/1181.65	38:40 ERROR: Failed to solve instance
2069.49/1181.65	java.lang.OutOfMemoryError: Java heap space
2120.44/1232.54	39:31 ERROR: Failed to solve instance
2120.44/1232.54	java.lang.OutOfMemoryError: Java heap space
2129.75/1241.29	39:40 ERROR: Failed to solve instance
2129.75/1241.29	java.lang.OutOfMemoryError: Java heap space
2163.06/1273.95	40:13 ERROR: Failed to solve instance
2163.06/1273.95	java.lang.OutOfMemoryError: Java heap space

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312356-1304111939/watcher-3312356-1304111939 -o /tmp/evaluation-result-3312356-1304111939/solver-3312356-1304111939 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312356-1304111939.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.75 4.79 6.39 3/194 3875
/proc/meminfo: memFree=31071656/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 1408 0 0 0 0 0 0 0 22 0 2 0 522792647 26714112 878 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 6522 880 675 9 0 381 0
[pid=3875/tid=3876] ppid=3873 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) S 3873 3875 2999 0 -1 4202560 56 0 0 0 0 0 0 0 23 0 2 0 522792648 26714112 884 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235589942919 0 2147483391 4096 0 18446744071699215550 0 0 -1 5 0 0 0

[startup+0.0890201 s]
/proc/loadavg: 3.75 4.79 6.39 3/194 3875
/proc/meminfo: memFree=31071656/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15676880 CPUtime=0.09 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 5494 0 1 0 8 1 0 0 22 0 18 0 522792647 16053125120 4894 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3919220 4897 2115 9 0 3909939 0
[pid=3875/tid=3876] ppid=3873 vsize=15676880 CPUtime=0.07 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) R 3873 3875 2999 0 -1 4202560 3331 0 1 0 6 1 0 0 18 0 18 0 522792648 16053125120 4897 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606695291 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15676880

[startup+0.101045 s]
/proc/loadavg: 3.75 4.79 6.39 3/194 3875
/proc/meminfo: memFree=31071656/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15676880 CPUtime=0.1 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 5641 0 1 0 9 1 0 0 22 0 18 0 522792647 16053125120 5041 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3919220 5041 2117 9 0 3909939 0
[pid=3875/tid=3876] ppid=3873 vsize=15676880 CPUtime=0.08 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) R 3873 3875 2999 0 -1 4202560 3475 0 1 0 7 1 0 0 18 0 18 0 522792648 16053125120 5041 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 47911868552499 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676880

[startup+0.301041 s]
/proc/loadavg: 3.75 4.79 6.39 3/194 3875
/proc/meminfo: memFree=31071656/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15680392 CPUtime=0.51 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 16337 0 1 0 48 3 0 0 22 0 18 0 522792647 16056721408 14790 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3920098 14797 2207 9 0 3910817 0
[pid=3875/tid=3876] ppid=3873 vsize=15680392 CPUtime=0.28 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) R 3873 3875 2999 0 -1 4202560 11234 0 1 0 26 2 0 0 18 0 18 0 522792648 16056721408 14799 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 46912505641747 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15680392

[startup+0.700971 s]
/proc/loadavg: 3.75 4.79 6.39 3/194 3875
/proc/meminfo: memFree=31071656/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15680392 CPUtime=0.92 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 41835 0 1 0 85 7 0 0 22 0 18 0 522792647 16056721408 40286 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3920098 40286 2223 9 0 3910817 0
[pid=3875/tid=3876] ppid=3873 vsize=15680392 CPUtime=0.67 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) R 3873 3875 2999 0 -1 4202560 35533 0 1 0 62 5 0 0 18 0 18 0 522792648 16056721408 40286 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 46912505562845 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15680392

[startup+1.50077 s]
/proc/loadavg: 3.75 4.79 6.39 6/220 3901
/proc/meminfo: memFree=30860896/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15684504 CPUtime=2.22 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 55358 0 1 0 214 8 0 0 22 0 22 0 522792647 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3921126 50990 2262 9 0 3911845 0
[pid=3875/tid=3876] ppid=3873 vsize=15684504 CPUtime=1.46 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) R 3873 3875 2999 0 -1 4202560 35636 0 1 0 141 5 0 0 21 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 46912505719284 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=3875/tid=3878] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3878/stat : 3878 (java) S 3873 3875 2999 0 -1 4202560 2337 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3879] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3879/stat : 3879 (java) S 3873 3875 2999 0 -1 4202560 952 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3880] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3880/stat : 3880 (java) S 3873 3875 2999 0 -1 4202560 20 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3881] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3881/stat : 3881 (java) S 3873 3875 2999 0 -1 4202560 79 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3882] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 722 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 646 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 59 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 392 0 0 0 0 0 0 0 16 0 22 0 522792648 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) S 3873 3875 2999 0 -1 4202560 72 0 0 0 0 0 0 0 16 0 22 0 522792649 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 0 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3887] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3887/stat : 3887 (java) S 3873 3875 2999 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 522792650 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3888] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3888/stat : 3888 (java) S 3873 3875 2999 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 522792650 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3889] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3889/stat : 3889 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606690225 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3890] ppid=3873 vsize=15684504 CPUtime=0.55 cores=1,3,5,7
/proc/3875/task/3890/stat : 3890 (java) S 3873 3875 2999 0 -1 4202560 11655 0 0 0 54 1 0 0 19 0 22 0 522792652 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3891] ppid=3873 vsize=15684504 CPUtime=0.14 cores=1,3,5,7
/proc/3875/task/3891/stat : 3891 (java) S 3873 3875 2999 0 -1 4202560 1360 0 0 0 14 0 0 0 17 0 22 0 522792652 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3892] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3892/stat : 3892 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3893] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3893/stat : 3893 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522792652 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3898] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3898/stat : 3898 (java) S 3873 3875 2999 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 522792739 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3899] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3899/stat : 3899 (java) S 3873 3875 2999 0 -1 4202560 10 0 0 0 0 0 0 0 16 0 22 0 522792739 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3900] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3900/stat : 3900 (java) S 3873 3875 2999 0 -1 4202560 7 0 0 0 0 0 0 0 16 0 22 0 522792739 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3901] ppid=3873 vsize=15684504 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3901/stat : 3901 (java) S 3873 3875 2999 0 -1 4202560 7 0 0 0 0 0 0 0 16 0 22 0 522792739 16060932096 50990 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.22
Current children cumulated vsize (KiB) 15684504

[startup+3.10149 s]
/proc/loadavg: 4.01 4.83 6.39 9/220 3901
/proc/meminfo: memFree=30775336/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15689524 CPUtime=5.43 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 67820 0 1 0 533 10 0 0 22 0 22 0 522792647 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3922381 63308 2275 9 0 3913100 0
[pid=3875/tid=3876] ppid=3873 vsize=15689524 CPUtime=2.35 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) S 3873 3875 2999 0 -1 4202560 35690 0 1 0 230 5 0 0 25 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3878] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3878/stat : 3878 (java) S 3873 3875 2999 0 -1 4202560 2337 0 0 0 0 0 0 0 15 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3879] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3879/stat : 3879 (java) S 3873 3875 2999 0 -1 4202560 952 0 0 0 0 0 0 0 15 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3880] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3880/stat : 3880 (java) S 3873 3875 2999 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3881] ppid=3873 vsize=15689524 CPUtime=0.02 cores=1,3,5,7
/proc/3875/task/3881/stat : 3881 (java) S 3873 3875 2999 0 -1 4202560 2115 0 0 0 2 0 0 0 16 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3882] ppid=3873 vsize=15689524 CPUtime=0.02 cores=1,3,5,7
/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 2900 0 0 0 2 0 0 0 16 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 646 0 0 0 0 0 0 0 15 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15689524 CPUtime=0.01 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 3242 0 0 0 1 0 0 0 16 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15689524 CPUtime=0.02 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 3820 0 0 0 2 0 0 0 16 0 22 0 522792648 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) S 3873 3875 2999 0 -1 4202560 93 0 0 0 0 0 0 0 15 0 22 0 522792649 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 0 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3887] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3887/stat : 3887 (java) S 3873 3875 2999 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 522792650 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3888] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3888/stat : 3888 (java) S 3873 3875 2999 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 522792650 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3889] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3889/stat : 3889 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606690225 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3890] ppid=3873 vsize=15689524 CPUtime=1.01 cores=1,3,5,7
/proc/3875/task/3890/stat : 3890 (java) S 3873 3875 2999 0 -1 4202560 11745 0 0 0 100 1 0 0 15 0 22 0 522792652 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3891] ppid=3873 vsize=15689524 CPUtime=0.86 cores=1,3,5,7
/proc/3875/task/3891/stat : 3891 (java) S 3873 3875 2999 0 -1 4202560 2818 0 0 0 86 0 0 0 15 0 22 0 522792652 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3892] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3892/stat : 3892 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3893] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3893/stat : 3893 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522792652 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3898] ppid=3873 vsize=15689524 CPUtime=0.09 cores=1,3,5,7
/proc/3875/task/3898/stat : 3898 (java) S 3873 3875 2999 0 -1 4202560 29 0 0 0 9 0 0 0 15 0 22 0 522792739 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3899] ppid=3873 vsize=15689524 CPUtime=0.38 cores=1,3,5,7
/proc/3875/task/3899/stat : 3899 (java) S 3873 3875 2999 0 -1 4202560 10 0 0 0 38 0 0 0 15 0 22 0 522792739 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3900] ppid=3873 vsize=15689524 CPUtime=0.43 cores=1,3,5,7
/proc/3875/task/3900/stat : 3900 (java) R 3873 3875 2999 0 -1 4202560 9 0 0 0 43 0 0 0 15 0 22 0 522792739 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 47911869804670 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=3875/tid=3901] ppid=3873 vsize=15689524 CPUtime=0.12 cores=1,3,5,7
/proc/3875/task/3901/stat : 3901 (java) R 3873 3875 2999 0 -1 4202560 8 0 0 0 12 0 0 0 16 0 22 0 522792739 16066072576 63308 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 46912506270223 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.43
Current children cumulated vsize (KiB) 15689524

[startup+6.30093 s]
/proc/loadavg: 4.01 4.83 6.39 11/220 3901
/proc/meminfo: memFree=29395268/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15689524 CPUtime=18.12 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 283735 0 1 0 1773 39 0 0 22 0 22 0 522792647 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3922381 277792 2275 9 0 3913100 0
[pid=3875/tid=3876] ppid=3873 vsize=15689524 CPUtime=2.35 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) S 3873 3875 2999 0 -1 4202560 35690 0 1 0 230 5 0 0 25 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3878] ppid=3873 vsize=15689524 CPUtime=0.08 cores=1,3,5,7
/proc/3875/task/3878/stat : 3878 (java) S 3873 3875 2999 0 -1 4202560 12208 0 0 0 7 1 0 0 15 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3879] ppid=3873 vsize=15689524 CPUtime=0.05 cores=1,3,5,7
/proc/3875/task/3879/stat : 3879 (java) S 3873 3875 2999 0 -1 4202560 6095 0 0 0 4 1 0 0 15 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3880] ppid=3873 vsize=15689524 CPUtime=0.21 cores=1,3,5,7
/proc/3875/task/3880/stat : 3880 (java) S 3873 3875 2999 0 -1 4202560 31193 0 0 0 17 4 0 0 16 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3881] ppid=3873 vsize=15689524 CPUtime=0.09 cores=1,3,5,7
/proc/3875/task/3881/stat : 3881 (java) S 3873 3875 2999 0 -1 4202560 15537 0 0 0 8 1 0 0 15 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3882] ppid=3873 vsize=15689524 CPUtime=0.24 cores=1,3,5,7
/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 40409 0 0 0 19 5 0 0 16 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15689524 CPUtime=0.17 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 30332 0 0 0 14 3 0 0 16 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15689524 CPUtime=0.22 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 29807 0 0 0 18 4 0 0 16 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15689524 CPUtime=0.18 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 26694 0 0 0 15 3 0 0 15 0 22 0 522792648 16066072576 277792 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 396039 0 0 0 270 65 0 0 15 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15689524 CPUtime=3.19 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 358989 0 0 0 261 58 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15689524 CPUtime=3.57 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 412456 0 0 0 290 67 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15689524 CPUtime=2.71 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 289235 0 0 0 224 47 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=15689524 CPUtime=883.25 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) R 3873 3875 2999 0 -1 4202560 703451 0 0 0 88237 88 0 0 25 0 22 0 522792649 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 47911869573589 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=3875/tid=3887] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3887/stat : 3887 (java) S 3873 3875 2999 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3888] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3888/stat : 3888 (java) S 3873 3875 2999 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3889] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3889/stat : 3889 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606690225 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3890] ppid=3873 vsize=15689524 CPUtime=1.01 cores=1,3,5,7
/proc/3875/task/3890/stat : 3890 (java) S 3873 3875 2999 0 -1 4202560 11745 0 0 0 100 1 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3891] ppid=3873 vsize=15689524 CPUtime=1.04 cores=1,3,5,7
/proc/3875/task/3891/stat : 3891 (java) S 3873 3875 2999 0 -1 4202560 2849 0 0 0 104 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3892] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3892/stat : 3892 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3893] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3893/stat : 3893 (java) S 3873 3875 2999 0 -1 4202560 64 0 0 0 0 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3898] ppid=3873 vsize=15689524 CPUtime=288.67 cores=1,3,5,7
/proc/3875/task/3898/stat : 3898 (java) S 3873 3875 2999 0 -1 4202560 60138 0 0 0 28852 15 0 0 16 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3899] ppid=3873 vsize=15689524 CPUtime=289.75 cores=1,3,5,7
/proc/3875/task/3899/stat : 3899 (java) S 3873 3875 2999 0 -1 4202560 64874 0 0 0 28963 12 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3900] ppid=3873 vsize=15689524 CPUtime=289.83 cores=1,3,5,7
/proc/3875/task/3900/stat : 3900 (java) S 3873 3875 2999 0 -1 4202560 60115 0 0 0 28971 12 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3901] ppid=3873 vsize=15689524 CPUtime=288.83 cores=1,3,5,7
/proc/3875/task/3901/stat : 3901 (java) S 3873 3875 2999 0 -1 4202560 73201 0 0 0 28869 14 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2070.21
Current children cumulated vsize (KiB) 15689524

[startup+1242.3 s]
/proc/loadavg: 3.20 4.67 5.51 2/193 3954
/proc/meminfo: memFree=15858984/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15689524 CPUtime=2131.01 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 3910094 0 1 0 212468 633 0 0 22 0 22 0 522792647 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3922381 3835150 2294 9 0 3913100 0
[pid=3875/tid=3876] ppid=3873 vsize=15689524 CPUtime=2.35 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) S 3873 3875 2999 0 -1 4202560 35690 0 1 0 230 5 0 0 25 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3878] ppid=3873 vsize=15689524 CPUtime=3.04 cores=1,3,5,7
/proc/3875/task/3878/stat : 3878 (java) S 3873 3875 2999 0 -1 4202560 398364 0 0 0 239 65 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3879] ppid=3873 vsize=15689524 CPUtime=3.44 cores=1,3,5,7
/proc/3875/task/3879/stat : 3879 (java) S 3873 3875 2999 0 -1 4202560 341637 0 0 0 287 57 0 0 15 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3880] ppid=3873 vsize=15689524 CPUtime=3.09 cores=1,3,5,7
/proc/3875/task/3880/stat : 3880 (java) S 3873 3875 2999 0 -1 4202560 342288 0 0 0 253 56 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3881] ppid=3873 vsize=15689524 CPUtime=2.89 cores=1,3,5,7
/proc/3875/task/3881/stat : 3881 (java) S 3873 3875 2999 0 -1 4202560 357065 0 0 0 232 57 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3882] ppid=3873 vsize=15689524 CPUtime=3.35 cores=1,3,5,7
/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 396039 0 0 0 270 65 0 0 15 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15689524 CPUtime=3.19 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 358989 0 0 0 261 58 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15689524 CPUtime=3.57 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 412456 0 0 0 290 67 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15689524 CPUtime=2.71 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 289235 0 0 0 224 47 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=15689524 CPUtime=942.98 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) R 3873 3875 2999 0 -1 4202560 703453 0 0 0 94209 89 0 0 18 0 22 0 522792649 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 47911869573123 0 0 0 16800975 0 0 0 -1 5 0 0 0
[pid=3875/tid=3887] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3887/stat : 3887 (java) S 3873 3875 2999 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3888] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3888/stat : 3888 (java) S 3873 3875 2999 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3889] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3889/stat : 3889 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606690225 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3890] ppid=3873 vsize=15689524 CPUtime=1.01 cores=1,3,5,7
/proc/3875/task/3890/stat : 3890 (java) S 3873 3875 2999 0 -1 4202560 11745 0 0 0 100 1 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3891] ppid=3873 vsize=15689524 CPUtime=1.04 cores=1,3,5,7
/proc/3875/task/3891/stat : 3891 (java) S 3873 3875 2999 0 -1 4202560 2849 0 0 0 104 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3892] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3892/stat : 3892 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3893] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3893/stat : 3893 (java) S 3873 3875 2999 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3898] ppid=3873 vsize=15689524 CPUtime=288.95 cores=1,3,5,7
/proc/3875/task/3898/stat : 3898 (java) S 3873 3875 2999 0 -1 4202560 60156 0 0 0 28879 16 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3899] ppid=3873 vsize=15689524 CPUtime=290.01 cores=1,3,5,7
/proc/3875/task/3899/stat : 3899 (java) S 3873 3875 2999 0 -1 4202560 65280 0 0 0 28989 12 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3900] ppid=3873 vsize=15689524 CPUtime=290.09 cores=1,3,5,7
/proc/3875/task/3900/stat : 3900 (java) S 3873 3875 2999 0 -1 4202560 60173 0 0 0 28997 12 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3901] ppid=3873 vsize=15689524 CPUtime=289.11 cores=1,3,5,7
/proc/3875/task/3901/stat : 3901 (java) S 3873 3875 2999 0 -1 4202560 73223 0 0 0 28896 15 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2131.01
Current children cumulated vsize (KiB) 15689524



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.87 4.05 5.25 2/193 3956
/proc/meminfo: memFree=15859040/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=15689524 CPUtime=2189.8 cores=1,3,5,7
/proc/3875/stat : 3875 (java) S 3873 3875 2999 0 -1 4202496 3910583 0 1 0 218342 638 0 0 22 0 22 0 522792647 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 3922381 3835150 2294 9 0 3913100 0
[pid=3875/tid=3876] ppid=3873 vsize=15689524 CPUtime=2.35 cores=1,3,5,7
/proc/3875/task/3876/stat : 3876 (java) S 3873 3875 2999 0 -1 4202560 35690 0 1 0 230 5 0 0 25 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3878] ppid=3873 vsize=15689524 CPUtime=3.04 cores=1,3,5,7
/proc/3875/task/3878/stat : 3878 (java) S 3873 3875 2999 0 -1 4202560 398364 0 0 0 239 65 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3879] ppid=3873 vsize=15689524 CPUtime=3.44 cores=1,3,5,7
/proc/3875/task/3879/stat : 3879 (java) S 3873 3875 2999 0 -1 4202560 341637 0 0 0 287 57 0 0 15 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3880] ppid=3873 vsize=15689524 CPUtime=3.09 cores=1,3,5,7
/proc/3875/task/3880/stat : 3880 (java) S 3873 3875 2999 0 -1 4202560 342288 0 0 0 253 56 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3881] ppid=3873 vsize=15689524 CPUtime=2.89 cores=1,3,5,7
/proc/3875/task/3881/stat : 3881 (java) S 3873 3875 2999 0 -1 4202560 357065 0 0 0 232 57 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3882] ppid=3873 vsize=15689524 CPUtime=3.35 cores=1,3,5,7
/proc/3875/task/3882/stat : 3882 (java) S 3873 3875 2999 0 -1 4202560 396039 0 0 0 270 65 0 0 15 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3883] ppid=3873 vsize=15689524 CPUtime=3.19 cores=1,3,5,7
/proc/3875/task/3883/stat : 3883 (java) S 3873 3875 2999 0 -1 4202560 358989 0 0 0 261 58 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3884] ppid=3873 vsize=15689524 CPUtime=3.57 cores=1,3,5,7
/proc/3875/task/3884/stat : 3884 (java) S 3873 3875 2999 0 -1 4202560 412456 0 0 0 290 67 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3885] ppid=3873 vsize=15689524 CPUtime=2.71 cores=1,3,5,7
/proc/3875/task/3885/stat : 3885 (java) S 3873 3875 2999 0 -1 4202560 289235 0 0 0 224 47 0 0 16 0 22 0 522792648 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=15689524 CPUtime=1000.29 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) R 3873 3875 2999 0 -1 4202560 703458 0 0 0 99938 91 0 0 20 0 22 0 522792649 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 47911869574433 0 0 0 16800975 0 0 0 -1 3 0 0 0
[pid=3875/tid=3887] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3887/stat : 3887 (java) S 3873 3875 2999 0 -1 4202560 18 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3888] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3888/stat : 3888 (java) S 3873 3875 2999 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 522792650 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3889] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3889/stat : 3889 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606690225 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3890] ppid=3873 vsize=15689524 CPUtime=1.01 cores=1,3,5,7
/proc/3875/task/3890/stat : 3890 (java) S 3873 3875 2999 0 -1 4202560 11745 0 0 0 100 1 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3891] ppid=3873 vsize=15689524 CPUtime=1.04 cores=1,3,5,7
/proc/3875/task/3891/stat : 3891 (java) S 3873 3875 2999 0 -1 4202560 2849 0 0 0 104 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 7 0 0 0
[pid=3875/tid=3892] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3892/stat : 3892 (java) S 3873 3875 2999 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3893] ppid=3873 vsize=15689524 CPUtime=0 cores=1,3,5,7
/proc/3875/task/3893/stat : 3893 (java) S 3873 3875 2999 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 522792652 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606683136 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3898] ppid=3873 vsize=15689524 CPUtime=289.33 cores=1,3,5,7
/proc/3875/task/3898/stat : 3898 (java) S 3873 3875 2999 0 -1 4202560 60241 0 0 0 28916 17 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
[pid=3875/tid=3899] ppid=3873 vsize=15689524 CPUtime=290.38 cores=1,3,5,7
/proc/3875/task/3899/stat : 3899 (java) S 3873 3875 2999 0 -1 4202560 65302 0 0 0 29025 13 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 5 0 0 0
[pid=3875/tid=3900] ppid=3873 vsize=15689524 CPUtime=290.47 cores=1,3,5,7
/proc/3875/task/3900/stat : 3900 (java) S 3873 3875 2999 0 -1 4202560 60434 0 0 0 29034 13 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 1 0 0 0
[pid=3875/tid=3901] ppid=3873 vsize=15689524 CPUtime=289.48 cores=1,3,5,7
/proc/3875/task/3901/stat : 3901 (java) S 3873 3875 2999 0 -1 4202560 73336 0 0 0 28933 15 0 0 15 0 22 0 522792739 16066072576 3835150 33554432000 1073741824 1073778376 140733981360576 18446744073709551615 235606682521 0 4 0 16800975 18446604458570892416 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2189.8
Current children cumulated vsize (KiB) 15689524

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -3875

[startup+1302.3 s]
/proc/loadavg: 1.87 4.05 5.25 2/194 3957
/proc/meminfo: memFree=15859032/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=0 CPUtime=2192.1 cores=1,3,5,7
/proc/3875/stat : 3875 (java) Z 3873 3875 2999 0 -1 4203548 3910607 0 1 0 218544 666 0 0 18 0 2 0 522792647 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 0 0 0 0 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=0 CPUtime=1002.58 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) R 3873 3875 2999 0 -1 4203588 703458 0 0 0 100139 119 0 0 18 0 2 0 522792649 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2192.1
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.5 s]
/proc/loadavg: 1.87 4.05 5.25 2/194 3957
/proc/meminfo: memFree=15859032/32950928 swapFree=67111404/67111528
[pid=3875] ppid=3873 vsize=0 CPUtime=2192.3 cores=1,3,5,7
/proc/3875/stat : 3875 (java) Z 3873 3875 2999 0 -1 4203548 3910607 0 1 0 218544 686 0 0 18 0 2 0 522792647 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/3875/statm: 0 0 0 0 0 0 0
[pid=3875/tid=3886] ppid=3873 vsize=0 CPUtime=1002.78 cores=1,3,5,7
/proc/3875/task/3886/stat : 3886 (java) R 3873 3875 2999 0 -1 4203588 703458 0 0 0 100139 139 0 0 18 0 2 0 522792649 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2192.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.52
CPU time (s): 2192.33
CPU user time (s): 2185.44
CPU system time (s): 6.88595
CPU usage (%): 168.314
Max. virtual memory (cumulated for all children) (KiB): 15689524

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2185.44
system time used= 6.88595
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3910607
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 79282
involuntary context switches= 37575

runsolver used 2.21166 second user time and 4.95025 second system time

The end

Launcher Data 

Begin job on node120 at 2011-04-29 23:18:59
IDJOB=3312356
IDBENCH=82541
IDSOLVER=1699
FILE ID=node120/3312356-1304111939
RUNJOBID= node120-1304111938-3839
PBS_JOBID= 13170661
Free space on /tmp= 72068 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S1368340883-085-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312356-1304111939/watcher-3312356-1304111939 -o /tmp/evaluation-result-3312356-1304111939/solver-3312356-1304111939 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312356-1304111939.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c6eeff67aa308a86267a5f4d04512b40
RANDOM SEED=1424317247

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31071928 kB
Buffers:        492292 kB
Cached:         814776 kB
SwapCached:          8 kB
Active:         560112 kB
Inactive:       959272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31071928 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:            8664 kB
Writeback:           0 kB
AnonPages:      212224 kB
Mapped:          22840 kB
Slab:           296188 kB
PageTables:       5100 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   784604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72072 MiB
End job on node120 at 2011-04-29 23:40:41