Trace number 4391287

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
AbsCon 2019-07-23? (TO) 2408.05 661.662

General information on the benchmark

NameFapp/Fapp-ext/
Fapp-ext-05-0350_c18.xml
MD5SUM51b7f32ab0afbf3da7a228f765e579fa
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark521763735
Best CPU time to get the best result obtained on this benchmark2400.14
Satisfiable
(Un)Satisfiability was proved
Number of variables7232
Number of constraints4665
Number of domains18
Minimum domain size1
Maximum domain size135
Distribution of domain sizes[{"size":1,"count":3},{"size":2,"count":2524},{"size":11,"count":2177},{"size":12,"count":1},{"size":25,"count":55},{"size":33,"count":45},{"size":44,"count":26},{"size":48,"count":22},{"size":51,"count":17},{"size":55,"count":31},{"size":91,"count":204},{"size":102,"count":203},{"size":106,"count":126},{"size":135,"count":1798}]
Minimum variable degree2
Maximum variable degree2178
Distribution of variable degrees[{"degree":2,"count":6532},{"degree":3,"count":5},{"degree":4,"count":7},{"degree":5,"count":11},{"degree":6,"count":11},{"degree":7,"count":19},{"degree":8,"count":26},{"degree":9,"count":28},{"degree":10,"count":31},{"degree":11,"count":40},{"degree":12,"count":48},{"degree":13,"count":50},{"degree":14,"count":80},{"degree":15,"count":109},{"degree":16,"count":148},{"degree":17,"count":81},{"degree":18,"count":2},{"degree":19,"count":2},{"degree":21,"count":1},{"degree":2178,"count":1}]
Minimum constraint arity2
Maximum constraint arity6
Distribution of constraint arities[{"arity":2,"count":311},{"arity":3,"count":2177},{"arity":6,"count":2177}]
Number of extensional constraints4665
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":4665}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

2.40/1.87	
2.40/1.87	AbsCon 2 
2.40/1.89	
100.43/61.24	  Instance
100.43/61.24	    name=instance-4391287-1568391769, framework=COP, bounds=-infty..+infty
100.43/61.24	
100.43/61.24	  Loading variables...
101.09/61.46	  Loading constraints...

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11607 MiB free)
  memory of node 1: 16384 MiB (13655 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391287-1568391769/watcher-4391287-1568391769 -o /tmp/evaluation-result-4391287-1568391769/solver-4391287-1568391769 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node119-1568388843-13119 --watchdog 2560 java -cp AbsCon19-06.jar AbsCon HOME/instance-4391287-1568391769.xml -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=14321, runsolver pid=14318

[startup+0.100211 s]*
/proc/loadavg: 2.01 1.92 1.83 5/229 14336
/proc/meminfo: memFree=25853032/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10659884 memory=29744 CPUtime=0.13 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 5933 0 0 0 12 1 0 0 20 0 15 0 415092011 10915721216 7436 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2664971 7436 2858 1 0 2627468 0
[pid=14321/tid=14323] ppid=14318 vsize=10659884 memory=7892391828772250251 CPUtime=0.09 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) R 14318 14321 10765 0 -1 4202560 3288 0 0 0 8 1 0 0 20 0 15 0 415092011 10915721216 7436 33554432000 4194304 4196468 140727300437296 140459121990688 140459117782173 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10659884 memory=-9181546050914066336 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458724289552 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458723237008 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458722183952 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458721131408 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458609760496 140459117771394 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458608706720 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458607653616 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458606602192 140459117778843 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10659884 memory=0 CPUtime=0.01 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 562 0 0 0 1 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) R 14318 14321 10765 0 -1 1077944384 124 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458604497776 140459117771394 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0.02 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) R 14318 14321 10765 0 -1 4202560 609 0 0 0 2 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458603441400 140459109997374 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 7436 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 0.13 s
Current children cumulated vsize: 10659884 KiB
Current children cumulated memory: 29744 KiB

[startup+0.210553 s]*
/proc/loadavg: 2.01 1.92 1.83 3/229 14336
/proc/meminfo: memFree=25846016/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10659884 memory=35020 CPUtime=0.33 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 6863 0 0 0 31 2 0 0 20 0 15 0 415092011 10915721216 8755 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2664971 8755 2989 1 0 2627468 0
[pid=14321/tid=14323] ppid=14318 vsize=10659884 memory=7022364594140610616 CPUtime=0.19 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) R 14318 14321 10765 0 -1 4202560 3876 0 0 0 18 1 0 0 20 0 15 0 415092011 10915721216 8755 33554432000 4194304 4196468 140727300437296 140459121998392 140459117782173 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10659884 memory=365 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458724289552 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10659884 memory=139761670224784 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458723237008 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458722183952 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458721131408 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458609760496 140459117771394 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458608706720 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458607653616 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458606602192 140459117778843 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10659884 memory=0 CPUtime=0.03 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 769 0 0 0 3 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10659884 memory=-1 CPUtime=0.02 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 219 0 0 0 2 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458604497776 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0.05 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 639 0 0 0 5 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458603444720 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 8755 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 0.33 s
Current children cumulated vsize: 10659884 KiB
Current children cumulated memory: 35020 KiB

[startup+0.313896 s]*
/proc/loadavg: 2.01 1.92 1.83 4/229 14336
/proc/meminfo: memFree=25838444/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10659884 memory=40432 CPUtime=0.48 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 9438 0 0 0 45 3 0 0 20 0 15 0 415092011 10915721216 10108 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2664971 10108 3002 1 0 2627468 0
[pid=14321/tid=14323] ppid=14318 vsize=10659884 memory=7311146985107750967 CPUtime=0.31 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) R 14318 14321 10765 0 -1 4202560 6362 0 0 0 28 3 0 0 20 0 15 0 415092011 10915721216 10108 33554432000 4194304 4196468 140727300437296 140459121992640 140459117782173 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10659884 memory=10528 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458724289552 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10659884 memory=139761670224760 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458723237008 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458722183952 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458721131408 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458609760496 140459117771394 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458608706720 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 415092014 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458607653616 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10659884 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458606602192 140459117778843 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10659884 memory=0 CPUtime=0.05 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 816 0 0 0 5 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10659884 memory=-1 CPUtime=0.03 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 228 0 0 0 3 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458604497776 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0.08 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 677 0 0 0 8 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458603444720 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10659884 memory=-1 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10659884 memory=139761667155584 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092017 10915721216 10108 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 0.48 s
Current children cumulated vsize: 10659884 KiB
Current children cumulated memory: 40432 KiB

[startup+0.700789 s]
/proc/loadavg: 2.01 1.92 1.83 3/229 14336
/proc/meminfo: memFree=25830644/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10661932 memory=62644 CPUtime=1.09 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 12773 0 0 0 103 6 0 0 20 0 15 0 415092011 10917818368 15661 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2665483 15661 3073 1 0 2627980 0
[pid=14321/tid=14323] ppid=14318 vsize=10661932 memory=14056 CPUtime=0.67 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) R 14318 14321 10765 0 -1 4202560 8903 0 0 0 63 4 0 0 20 0 15 0 415092011 10917818368 15661 33554432000 4194304 4196468 140727300437296 140459121992272 140459099133719 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10661932 memory=2116 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458724289552 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10661932 memory=520 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458723237008 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10661932 memory=1560 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458722183952 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10661932 memory=924 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458721131408 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10661932 memory=3688 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092014 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458609760496 140459117771394 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10661932 memory=1984 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 415092014 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458608706720 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10661932 memory=1440 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 415092014 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458607653616 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10661932 memory=812 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458606602192 140459117778843 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10661932 memory=7086240636179272035 CPUtime=0.1 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 952 0 0 0 10 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10661932 memory=7453282923444726100 CPUtime=0.1 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) R 14318 14321 10765 0 -1 4202560 496 0 0 0 10 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458604497776 140459099285893 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10661932 memory=7223879631928058176 CPUtime=0.18 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 1062 0 0 0 18 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458603444720 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10661932 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10661932 memory=7955161671362897768 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092017 10917818368 15661 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 1.09 s
Current children cumulated vsize: 10661932 KiB
Current children cumulated memory: 62644 KiB

[startup+1.50079 s]
/proc/loadavg: 2.01 1.92 1.83 3/229 14336
/proc/meminfo: memFree=25814324/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10663980 memory=74780 CPUtime=1.99 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 18354 0 0 0 192 7 0 0 20 0 15 0 415092011 10919915520 18695 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2665995 18695 3097 1 0 2628492 0
[pid=14321/tid=14323] ppid=14318 vsize=10663980 memory=6493990552776 CPUtime=1.47 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) R 14318 14321 10765 0 -1 4202560 13086 0 0 0 142 5 0 0 20 0 15 0 415092011 10919915520 18695 33554432000 4194304 4196468 140727300437296 140459121991552 140459101903132 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10663980 memory=288230596050944315 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10919915520 18695 33554432000 4194304 4196468 140727300437296 140458724289552 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10663980 memory=14699582244260401 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10919915520 18695 33554432000 4194304 4196468 140727300437296 140458723237008 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10663980 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) S 14318 14321 10765 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 415092012 10919915520 18695 33554432000 4194304 4196468 140727300437296 140458722183952 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10663980 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) S 14318 14321 10765 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 415092012 10919915520 18695 33554432000 4194304 4196468 140727300437296 140458721131408 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10663980 memory=0 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 77 0 0 0 0 0 0 0 20 0 15 0 415092014 10919915520 18695 33554432000 4194304 4196468 140727300437296 140458609760496 140459117771394 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0

################
# More data... #
################

/proc/14321/task/14326/stat : 14326 (java) R 14318 14321 10765 0 -1 4202560 193127 0 0 0 57719 199 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458722183840 140459097786431 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10746276 memory=988 CPUtime=580.24 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) R 14318 14321 10765 0 -1 4202560 179371 0 0 0 57839 185 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458721131608 140459102745284 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10746276 memory=2008 CPUtime=15.91 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 181837 0 0 0 1578 13 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458609758816 140459117770453 0 0 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10746276 memory=3504 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 60 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458608706784 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10746276 memory=39852 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 66 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458607653632 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10746276 memory=8268864 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458606602192 140459117778843 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10746276 memory=6791534058613427641 CPUtime=2.36 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 9531 0 0 0 234 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10746276 memory=2624 CPUtime=2.26 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 9095 0 0 0 225 1 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458604497824 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10746276 memory=4100 CPUtime=0.9 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 7569 0 0 0 88 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458603444480 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10746276 memory=1440 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10746276 memory=6791534058613427641 CPUtime=0.63 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 997 0 0 0 26 37 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 2 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14337] ppid=14318 vsize=10746276 memory=2580 CPUtime=58.55 cores=1,3,5,7
/proc/14321/task/14337/stat : 14337 (java) S 14318 14321 10765 0 -1 1077944384 17842 0 0 0 5835 20 0 0 20 0 16 0 415092199 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458516795712 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 2400.16 s
Current children cumulated vsize: 10746276 KiB
Current children cumulated memory: 8268864 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+661.662 s]
# the end of solver process 14321 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.48 s, system=8.56614 s

Solver just ended.
Dumping a history of the last processes samples

[startup+660.801 s]
/proc/loadavg: 5.87 4.97 3.48 6/230 14399
/proc/meminfo: memFree=17435376/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10746276 memory=8268864 CPUtime=2404.95 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 1382384 0 0 0 239644 851 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2686569 2067216 3373 1 0 2646705 0
[pid=14321/tid=14323] ppid=14318 vsize=10746276 memory=8268864 CPUtime=1.85 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) S 14318 14321 10765 0 -1 1077944384 15327 0 0 0 178 7 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140459122003120 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10746276 memory=1052 CPUtime=580.23 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) R 14318 14321 10765 0 -1 4202560 416114 0 0 0 57810 213 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458724289752 140459102457792 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10746276 memory=776 CPUtime=580.34 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) R 14318 14321 10765 0 -1 4202560 350146 0 0 0 57831 203 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458723237208 140459103825072 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10746276 memory=4872558044660077418 CPUtime=580.38 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) R 14318 14321 10765 0 -1 4202560 193127 0 0 0 57839 199 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458722183840 140459097786417 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10746276 memory=2008 CPUtime=581.42 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) R 14318 14321 10765 0 -1 4202560 179371 0 0 0 57957 185 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458721131608 140459102710883 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10746276 memory=1436 CPUtime=15.91 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 181837 0 0 0 1578 13 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458609758816 140459117770453 0 0 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10746276 memory=4164 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 60 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458608706784 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10746276 memory=1548 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 66 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458607653632 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10746276 memory=8268864 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458606601840 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10746276 memory=8268864 CPUtime=2.36 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 9531 0 0 0 234 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10746276 memory=988 CPUtime=2.26 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 9095 0 0 0 225 1 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458604497824 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10746276 memory=2008 CPUtime=0.9 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 7569 0 0 0 88 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458603444480 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10746276 memory=1436 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10746276 memory=6791534058613427641 CPUtime=0.63 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 997 0 0 0 26 37 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 2 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14337] ppid=14318 vsize=10746276 memory=2624 CPUtime=58.55 cores=1,3,5,7
/proc/14321/task/14337/stat : 14337 (java) S 14318 14321 10765 0 -1 1077944384 17842 0 0 0 5835 20 0 0 20 0 16 0 415092199 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458516795712 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 2404.95 s
Current children cumulated vsize: 10746276 KiB
Current children cumulated memory: 8268864 KiB

[startup+661.201 s]
/proc/loadavg: 5.80 4.97 3.49 7/230 14399
/proc/meminfo: memFree=17435368/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10746276 memory=8268864 CPUtime=2406.51 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 1382384 0 0 0 239800 851 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2686569 2067216 3373 1 0 2646705 0
[pid=14321/tid=14323] ppid=14318 vsize=10746276 memory=1804 CPUtime=1.85 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) S 14318 14321 10765 0 -1 1077944384 15327 0 0 0 178 7 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140459122003120 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10746276 memory=920 CPUtime=580.62 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) R 14318 14321 10765 0 -1 4202560 416114 0 0 0 57849 213 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458724289552 140459102756893 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10746276 memory=3852 CPUtime=580.74 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) R 14318 14321 10765 0 -1 4202560 350146 0 0 0 57871 203 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458723237208 140459102756828 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10746276 memory=2776 CPUtime=580.77 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) R 14318 14321 10765 0 -1 4202560 193127 0 0 0 57878 199 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458722183952 140459102756909 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10746276 memory=2624 CPUtime=581.8 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) R 14318 14321 10765 0 -1 4202560 179371 0 0 0 57995 185 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458721131608 140459102217850 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10746276 memory=4100 CPUtime=15.92 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 181837 0 0 0 1579 13 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458609759040 140459117770453 0 0 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10746276 memory=1408 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 60 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458608706784 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10746276 memory=3340 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 66 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458607653632 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10746276 memory=540496 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458606601840 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10746276 memory=1404 CPUtime=2.36 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 9531 0 0 0 234 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10746276 memory=3252 CPUtime=2.26 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 9095 0 0 0 225 1 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458604497824 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10746276 memory=303430223234596890 CPUtime=0.9 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 7569 0 0 0 88 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458603444480 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10746276 memory=288230596050944315 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10746276 memory=14699582244260401 CPUtime=0.63 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 997 0 0 0 26 37 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 2 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14337] ppid=14318 vsize=10746276 memory=2008 CPUtime=58.55 cores=1,3,5,7
/proc/14321/task/14337/stat : 14337 (java) S 14318 14321 10765 0 -1 1077944384 17842 0 0 0 5835 20 0 0 20 0 16 0 415092199 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458516795712 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 2406.51 s
Current children cumulated vsize: 10746276 KiB
Current children cumulated memory: 8268864 KiB

[startup+661.601 s]
/proc/loadavg: 5.80 4.97 3.49 7/230 14399
/proc/meminfo: memFree=17435368/32770624 swapFree=66939840/67108860
[pid=14321] ppid=14318 vsize=10746276 memory=8268864 CPUtime=2407.95 cores=1,3,5,7
/proc/14321/stat : 14321 (java) S 14318 14321 10765 0 -1 1077944320 1382384 0 0 0 239944 851 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140727300419840 140459117760247 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
/proc/14321/statm: 2686569 2067216 3373 1 0 2646705 0
[pid=14321/tid=14323] ppid=14318 vsize=10746276 memory=8268864 CPUtime=1.85 cores=1,3,5,7
/proc/14321/task/14323/stat : 14323 (java) S 14318 14321 10765 0 -1 1077944384 15327 0 0 0 178 7 0 0 20 0 16 0 415092011 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140459122003120 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14324] ppid=14318 vsize=10746276 memory=1548 CPUtime=580.97 cores=1,3,5,7
/proc/14321/task/14324/stat : 14324 (java) R 14318 14321 10765 0 -1 4202560 416114 0 0 0 57884 213 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458724289752 140459102457886 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14325] ppid=14318 vsize=10746276 memory=1728 CPUtime=581.08 cores=1,3,5,7
/proc/14321/task/14325/stat : 14325 (java) R 14318 14321 10765 0 -1 4202560 350146 0 0 0 57905 203 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458723237208 140459102710903 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14326] ppid=14318 vsize=10746276 memory=7988 CPUtime=581.12 cores=1,3,5,7
/proc/14321/task/14326/stat : 14326 (java) R 14318 14321 10765 0 -1 4202560 193127 0 0 0 57913 199 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458722183952 140459102458022 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14327] ppid=14318 vsize=10746276 memory=1804 CPUtime=582.15 cores=1,3,5,7
/proc/14321/task/14327/stat : 14327 (java) R 14318 14321 10765 0 -1 4202560 179371 0 0 0 58030 185 0 0 20 0 16 0 415092012 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458721131408 140459102457894 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14328] ppid=14318 vsize=10746276 memory=920 CPUtime=15.97 cores=1,3,5,7
/proc/14321/task/14328/stat : 14328 (java) S 14318 14321 10765 0 -1 1077944384 181837 0 0 0 1584 13 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458609758816 140459117770453 0 0 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14329] ppid=14318 vsize=10746276 memory=3852 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (java) S 14318 14321 10765 0 -1 1077944384 60 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458608706784 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14330] ppid=14318 vsize=10746276 memory=2776 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14330/stat : 14330 (java) S 14318 14321 10765 0 -1 1077944384 66 0 0 0 0 0 0 0 20 0 16 0 415092014 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458607653632 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14331] ppid=14318 vsize=10746276 memory=2624 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (java) S 14318 14321 10765 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458606601840 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14332] ppid=14318 vsize=10746276 memory=3504 CPUtime=2.36 cores=1,3,5,7
/proc/14321/task/14332/stat : 14332 (java) S 14318 14321 10765 0 -1 1077944384 9531 0 0 0 234 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458605550320 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14333] ppid=14318 vsize=10746276 memory=39852 CPUtime=2.26 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (java) S 14318 14321 10765 0 -1 1077944384 9095 0 0 0 225 1 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458604497824 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14334] ppid=14318 vsize=10746276 memory=988 CPUtime=0.9 cores=1,3,5,7
/proc/14321/task/14334/stat : 14334 (java) S 14318 14321 10765 0 -1 1077944384 7569 0 0 0 88 2 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458603444480 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14335] ppid=14318 vsize=10746276 memory=2008 CPUtime=0 cores=1,3,5,7
/proc/14321/task/14335/stat : 14335 (java) S 14318 14321 10765 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458602392416 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14336] ppid=14318 vsize=10746276 memory=8268864 CPUtime=0.63 cores=1,3,5,7
/proc/14321/task/14336/stat : 14336 (java) S 14318 14321 10765 0 -1 1077944384 997 0 0 0 26 37 0 0 20 0 16 0 415092017 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458601339440 140459117771394 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 2 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
[pid=14321/tid=14337] ppid=14318 vsize=10746276 memory=111636 CPUtime=58.55 cores=1,3,5,7
/proc/14321/task/14337/stat : 14337 (java) S 14318 14321 10765 0 -1 1077944384 17842 0 0 0 5835 20 0 0 20 0 16 0 415092199 11004186624 2067216 33554432000 4194304 4196468 140727300437296 140458516795712 140459117770453 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 15826944 140727300441099 140727300441202 140727300441202 140727300444111 0
Current children cumulated CPU time: 2407.95 s
Current children cumulated vsize: 10746276 KiB
Current children cumulated memory: 8268864 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 661.662
CPU time (s): 2408.05
CPU user time (s): 2399.48
CPU system time (s): 8.56614
CPU usage (%): 363.94
Max. virtual memory (cumulated for all children) (KiB): 10746276
Max. memory (cumulated for all children) (KiB): 8268864

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.48
system time used= 8.56614
maximum resident set size= 8269052
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1382484
page faults= 0
swaps= 0
block input operations= 0
block output operations= 808
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29067
involuntary context switches= 20464


# summary of solver processes directly reported to runsolver:
#   pid: 14321
#   total CPU time (s): 2408.05
#   total CPU user time (s): 2399.48
#   total CPU system time (s): 8.56614

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.75713 second user time and 7.21704 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-13 18:22:11
IDJOB=4391287
IDBENCH=141284
IDSOLVER=2833
FILE ID=node119/4391287-1568391769
RUNJOBID= node119-1568388843-13119
PBS_JOBID= 21701844
Free space on /tmp= 60924 MiB

SOLVER NAME= AbsCon 2019-07-23
BENCH NAME= XCSP18/Fapp/Fapp-ext/Fapp-ext-05-0350_c18.xml
COMMAND LINE= java -cp AbsCon19-06.jar AbsCon BENCHNAME -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391287-1568391769/watcher-4391287-1568391769 -o /tmp/evaluation-result-4391287-1568391769/solver-4391287-1568391769 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node119-1568388843-13119 --watchdog 2560  java -cp AbsCon19-06.jar AbsCon HOME/instance-4391287-1568391769.xml -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 51b7f32ab0afbf3da7a228f765e579fa
RANDOM SEED=469068843

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25869364 kB
MemAvailable:   31451900 kB
Buffers:          188332 kB
Cached:          5659344 kB
SwapCached:        61108 kB
Active:          2769928 kB
Inactive:        3512904 kB
Active(anon):     373432 kB
Inactive(anon):   103112 kB
Active(file):    2396496 kB
Inactive(file):  3409792 kB
Unevictable:      107056 kB
Mlocked:          107056 kB
SwapTotal:      67108860 kB
SwapFree:       66939840 kB
Dirty:            592228 kB
Writeback:             0 kB
AnonPages:        482932 kB
Mapped:            56800 kB
Shmem:             32816 kB
Slab:             213908 kB
SReclaimable:     184168 kB
SUnreclaim:        29740 kB
KernelStack:        3728 kB
PageTables:         6492 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1375804 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    342016 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 60916 MiB
End job on node119 at 2019-09-13 18:33:13