Trace number 4291602

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
OscaR - Hybrid 2018-07-02? (TO) 2400.05 2381.92

General information on the benchmark

NameNurseRostering/
NurseRostering-11_c18.xml
MD5SUM05c4130aaeb0756e89b7f80c2b4d0b20
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark9322
Best CPU time to get the best result obtained on this benchmark2520.13
Satisfiable
(Un)Satisfiability was proved
Number of variables2678
Number of constraints6759
Number of domains17
Minimum domain size1
Maximum domain size51
Distribution of domain sizes[{"size":1,"count":124},{"size":2,"count":536},{"size":7,"count":1400},{"size":29,"count":254},{"size":51,"count":364}]
Minimum variable degree2
Maximum variable degree31
Distribution of variable degrees[{"degree":2,"count":1078},{"degree":3,"count":200},{"degree":19,"count":42},{"degree":20,"count":50},{"degree":21,"count":8},{"degree":22,"count":36},{"degree":23,"count":52},{"degree":24,"count":78},{"degree":25,"count":85},{"degree":26,"count":95},{"degree":27,"count":362},{"degree":28,"count":348},{"degree":29,"count":159},{"degree":30,"count":69},{"degree":31,"count":16}]
Minimum constraint arity2
Maximum constraint arity100
Distribution of constraint arities[{"arity":2,"count":2382},{"arity":3,"count":2340},{"arity":4,"count":300},{"arity":6,"count":920},{"arity":7,"count":270},{"arity":29,"count":350},{"arity":51,"count":196},{"arity":100,"count":1}]
Number of extensional constraints1546
Number of intensional constraints836
Distribution of constraint types[{"type":"extension","count":1546},{"type":"intension","count":836},{"type":"regular","count":2590},{"type":"sum","count":100},{"type":"count","count":1686},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data

0.66/0.55	c version: 2018-07-02
0.66/0.56	c seed: 271149695
0.66/0.56	c timeout: 2400
0.66/0.56	c memlimit: 11000
0.66/0.56	c nbcore: 4
0.66/0.58	c Parsing instance...
10.30/3.93	c Parsing done, starting first complete search...
2400.03/2381.90	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10949 MiB free)
  memory of node 1: 16384 MiB (7389 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4291602-1532231260/watcher-4291602-1532231260 -o /tmp/evaluation-result-4291602-1532231260/solver-4291602-1532231260 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532226532-29116 --watchdog 2560 java -Xmx11000m -jar oscarCPXcsp3-hybrid.jar --randomseed 271149695 --timelimit 2400 --memlimit 11000 --nbcore 4 HOME/instance-4291602-1532231260.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29567, runsolver pid=29564

[startup+0.100213 s]*
/proc/loadavg: 1.69 1.66 1.68 4/215 29582
/proc/meminfo: memFree=18759992/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14082740 memory=32052 CPUtime=0.11 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 6393 0 0 0 10 1 0 0 20 0 15 0 40689172 14420725760 7948 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3520685 8013 3140 1 0 3482761 0
[pid=29567/tid=29569] ppid=29564 vsize=14082740 memory=-8629632960754389123 CPUtime=0.09 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 4504 0 0 0 8 1 0 0 20 0 15 0 40689172 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304802253264 140304778332011 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689174 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 8013 33554432000 4194304 4196468 140725648340768 140304270734752 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304269682160 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 298 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0.01 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 240 0 0 0 1 0 0 0 20 0 15 0 40689177 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689178 14420725760 8079 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 0.11 s
Current children cumulated vsize: 14082740 KiB
Current children cumulated memory: 32052 KiB

[startup+0.21006 s]*
/proc/loadavg: 1.69 1.66 1.68 4/215 29582
/proc/meminfo: memFree=18745604/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14082740 memory=47536 CPUtime=0.29 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 9981 0 0 0 27 2 0 0 20 0 15 0 40689172 14420725760 11884 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3520685 11884 3380 1 0 3482761 0
[pid=29567/tid=29569] ppid=29564 vsize=14082740 memory=7022364594140610616 CPUtime=0.19 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) S 29564 29567 29085 0 -1 1077944384 7723 0 0 0 18 1 0 0 20 0 15 0 40689172 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304802284512 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14082740 memory=343 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14082740 memory=288371042516035200 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 15 0 40689174 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304270734752 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304269682160 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14082740 memory=0 CPUtime=0.01 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) R 29564 29567 29085 0 -1 1077944384 339 0 0 0 1 0 0 0 20 0 15 0 40689177 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304267577424 140304798066389 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14082740 memory=-1 CPUtime=0.01 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) R 29564 29567 29085 0 -1 4202560 255 0 0 0 1 0 0 0 20 0 15 0 40689177 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304266516288 140304783181311 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0.06 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 283 0 0 0 6 0 0 0 20 0 15 0 40689177 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689178 14420725760 11884 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 14082740 KiB
Current children cumulated memory: 47536 KiB

[startup+0.310384 s]*
/proc/loadavg: 1.69 1.66 1.68 3/215 29582
/proc/meminfo: memFree=18742564/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14082740 memory=51048 CPUtime=0.42 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 10342 0 0 0 40 2 0 0 20 0 15 0 40689172 14420725760 12762 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3520685 12762 3419 1 0 3482761 0
[pid=29567/tid=29569] ppid=29564 vsize=14082740 memory=7311146985107750967 CPUtime=0.29 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 8052 0 0 0 27 2 0 0 20 0 15 0 40689172 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304802264880 140304778332011 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14082740 memory=288230609002954775 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14082740 memory=288371042516035200 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689173 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 15 0 40689174 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304270734752 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 40689175 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304269682160 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14082740 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14082740 memory=0 CPUtime=0.02 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 346 0 0 0 2 0 0 0 20 0 15 0 40689177 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14082740 memory=-1 CPUtime=0.02 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 271 0 0 0 2 0 0 0 20 0 15 0 40689177 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0.08 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 292 0 0 0 8 0 0 0 20 0 15 0 40689177 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14082740 memory=-1 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14082740 memory=140666364323456 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689178 14420725760 12762 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 0.42 s
Current children cumulated vsize: 14082740 KiB
Current children cumulated memory: 51048 KiB

[startup+0.700724 s]
/proc/loadavg: 1.69 1.66 1.68 3/215 29582
/proc/meminfo: memFree=18720800/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14084808 memory=88692 CPUtime=0.98 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 17051 0 0 0 94 4 0 0 20 0 15 0 40689172 14422843392 22173 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3521202 22173 3499 1 0 3483273 0
[pid=29567/tid=29569] ppid=29564 vsize=14084808 memory=1728 CPUtime=0.66 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 14382 0 0 0 63 3 0 0 20 0 15 0 40689172 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304802262064 140304798078109 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14084808 memory=1004 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14084808 memory=11956 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14084808 memory=5520 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14084808 memory=792 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689173 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14084808 memory=1228 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 5 0 0 0 0 0 0 0 20 0 15 0 40689174 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14084808 memory=1944 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 33 0 0 0 0 0 0 0 20 0 15 0 40689175 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304270734752 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14084808 memory=1424 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 21 0 0 0 0 0 0 0 20 0 15 0 40689175 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304269682160 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14084808 memory=4612 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14084808 memory=7163631965283378496 CPUtime=0.06 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 504 0 0 0 6 0 0 0 20 0 15 0 40689177 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14084808 memory=6083353102074538087 CPUtime=0.08 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 412 0 0 0 8 0 0 0 20 0 15 0 40689177 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14084808 memory=6935658124599644240 CPUtime=0.15 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 374 0 0 0 15 0 0 0 20 0 15 0 40689177 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14084808 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14084808 memory=31396 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689178 14422843392 22173 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 0.98 s
Current children cumulated vsize: 14084808 KiB
Current children cumulated memory: 88692 KiB

[startup+1.5034 s]
/proc/loadavg: 1.69 1.66 1.68 6/198 29588
/proc/meminfo: memFree=20500072/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14088904 memory=182432 CPUtime=3.54 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 26844 0 0 0 347 7 0 0 20 0 15 0 40689172 14427037696 45590 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3522226 45608 3549 1 0 3484297 0
[pid=29567/tid=29569] ppid=29564 vsize=14088904 memory=0 CPUtime=1.46 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 17632 0 0 0 141 5 0 0 20 0 15 0 40689172 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304802289232 140304798068118 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14088904 memory=15384468 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14088904 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14088904 memory=3 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 1 0 0 0 0 0 0 0 20 0 15 0 40689173 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14088904 memory=0 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 2 0 0 0 0 0 0 0 20 0 15 0 40689173 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14088904 memory=99 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 97 0 0 0 0 0 0 0 20 0 15 0 40689174 14427037696 45608 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0

################
# More data... #
################

/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 71077 0 0 0 225645 43 0 0 20 0 15 0 40689172 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304802294256 140304400920299 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14093000 memory=1004 CPUtime=3.02 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 15882 0 0 0 287 15 0 0 20 0 15 0 40689173 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14093000 memory=2015848 CPUtime=3.06 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 17258 0 0 0 288 18 0 0 20 0 15 0 40689173 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14093000 memory=2015848 CPUtime=3 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 17328 0 0 0 283 17 0 0 20 0 15 0 40689173 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14093000 memory=2015848 CPUtime=3.06 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 18420 0 0 0 289 17 0 0 20 0 15 0 40689173 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14093000 memory=281332438900800 CPUtime=1.2 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 16290 0 0 0 111 9 0 0 20 0 15 0 40689174 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14093000 memory=2015848 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 56 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304270734816 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14093000 memory=2015848 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 46 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304269682176 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14093000 memory=1200 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14093000 memory=2015848 CPUtime=3.7 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 9867 0 0 0 369 1 0 0 20 0 15 0 40689177 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14093000 memory=640 CPUtime=3.72 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 14403 0 0 0 370 2 0 0 20 0 15 0 40689177 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14093000 memory=2015848 CPUtime=1.49 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 11096 0 0 0 147 2 0 0 20 0 15 0 40689177 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14093000 memory=2015848 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14093000 memory=290 CPUtime=0.54 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1479 0 0 0 23 31 0 0 20 0 15 0 40689178 14431232000 503962 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 2279.76 s
Current children cumulated vsize: 14093000 KiB
Current children cumulated memory: 2015848 KiB

[startup+2322.3 s]
/proc/loadavg: 1.18 1.36 1.49 3/215 29756
/proc/meminfo: memFree=17274364/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2340.09 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 197048 0 0 0 233864 145 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3523250 504474 3602 1 0 3485321 0
[pid=29567/tid=29569] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2316.66 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 71964 0 0 0 231623 43 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304802294336 140304400623535 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.14 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 16281 0 0 0 298 16 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.17 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 17654 0 0 0 299 18 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.13 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 17570 0 0 0 295 18 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.18 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 18651 0 0 0 301 17 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14093000 memory=2017896 CPUtime=1.25 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 16635 0 0 0 115 10 0 0 20 0 15 0 40689174 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 56 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304270734816 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 46 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304269682176 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14093000 memory=1240 CPUtime=3.7 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 9871 0 0 0 369 1 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.72 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 14407 0 0 0 370 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14093000 memory=2017896 CPUtime=1.49 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 11101 0 0 0 147 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14093000 memory=4028 CPUtime=0.56 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1496 0 0 0 24 32 0 0 20 0 15 0 40689178 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 2340.09 s
Current children cumulated vsize: 14093000 KiB
Current children cumulated memory: 2017896 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2381.9 s]
/proc/loadavg: 1.36 1.37 1.49 3/215 29757
/proc/meminfo: memFree=17272804/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2400.03 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 199624 0 0 0 239856 147 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3523250 504474 3602 1 0 3485321 0
[pid=29567/tid=29569] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2376.07 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 72904 0 0 0 237564 43 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304802294368 140304400661313 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.26 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 16417 0 0 0 310 16 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14093000 memory=0 CPUtime=3.29 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 18068 0 0 0 310 19 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.24 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 18196 0 0 0 306 18 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.29 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 18717 0 0 0 312 17 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14093000 memory=2017896 CPUtime=1.29 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 16987 0 0 0 119 10 0 0 20 0 15 0 40689174 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 56 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304270734816 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14093000 memory=18444 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 46 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304269682176 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14093000 memory=8384 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14093000 memory=1712 CPUtime=3.7 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 9875 0 0 0 369 1 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14093000 memory=1692 CPUtime=3.72 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 14411 0 0 0 370 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14093000 memory=916 CPUtime=1.49 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 11106 0 0 0 147 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0.58 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1525 0 0 0 25 33 0 0 20 0 15 0 40689178 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 14093000 KiB
Current children cumulated memory: 2017896 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2381.92 s]
# the end of solver process 29567 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2398.57 s, system=1.48465 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2381.9 s]
/proc/loadavg: 1.36 1.37 1.49 3/215 29757
/proc/meminfo: memFree=17272804/32770624 swapFree=67108860/67108860
[pid=29567] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2400.03 cores=0,2,4,6
/proc/29567/stat : 29567 (java) S 29564 29567 29085 0 -1 1077944320 199624 0 0 0 239856 147 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140725648323312 140304798056183 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
/proc/29567/statm: 3523250 504474 3602 1 0 3485321 0
[pid=29567/tid=29569] ppid=29564 vsize=14093000 memory=2017896 CPUtime=2376.07 cores=0,2,4,6
/proc/29567/task/29569/stat : 29569 (java) R 29564 29567 29085 0 -1 4202560 72904 0 0 0 237564 43 0 0 20 0 15 0 40689172 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304802294368 140304400661313 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29570] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.26 cores=0,2,4,6
/proc/29567/task/29570/stat : 29570 (java) S 29564 29567 29085 0 -1 1077944384 16417 0 0 0 310 16 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304713124112 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29571] ppid=29564 vsize=14093000 memory=0 CPUtime=3.29 cores=0,2,4,6
/proc/29567/task/29571/stat : 29571 (java) S 29564 29567 29085 0 -1 1077944384 18068 0 0 0 310 19 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304712071568 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29572] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.24 cores=0,2,4,6
/proc/29567/task/29572/stat : 29572 (java) S 29564 29567 29085 0 -1 1077944384 18196 0 0 0 306 18 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304711019024 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29573] ppid=29564 vsize=14093000 memory=2017896 CPUtime=3.29 cores=0,2,4,6
/proc/29567/task/29573/stat : 29573 (java) S 29564 29567 29085 0 -1 1077944384 18717 0 0 0 312 17 0 0 20 0 15 0 40689173 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304709966480 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29574] ppid=29564 vsize=14093000 memory=2017896 CPUtime=1.29 cores=0,2,4,6
/proc/29567/task/29574/stat : 29574 (java) S 29564 29567 29085 0 -1 1077944384 16987 0 0 0 119 10 0 0 20 0 15 0 40689174 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304271788528 140304798067330 0 0 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29575] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29575/stat : 29575 (java) S 29564 29567 29085 0 -1 1077944384 56 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304270734816 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29576] ppid=29564 vsize=14093000 memory=18444 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29576/stat : 29576 (java) S 29564 29567 29085 0 -1 1077944384 46 0 0 0 0 0 0 0 20 0 15 0 40689175 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304269682176 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29577] ppid=29564 vsize=14093000 memory=8384 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29577/stat : 29577 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304268630736 140304798074779 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29578] ppid=29564 vsize=14093000 memory=1712 CPUtime=3.7 cores=0,2,4,6
/proc/29567/task/29578/stat : 29578 (java) S 29564 29567 29085 0 -1 1077944384 9875 0 0 0 369 1 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304267577328 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 0 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29579] ppid=29564 vsize=14093000 memory=1692 CPUtime=3.72 cores=0,2,4,6
/proc/29567/task/29579/stat : 29579 (java) S 29564 29567 29085 0 -1 1077944384 14411 0 0 0 370 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304266524784 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29580] ppid=29564 vsize=14093000 memory=916 CPUtime=1.49 cores=0,2,4,6
/proc/29567/task/29580/stat : 29580 (java) S 29564 29567 29085 0 -1 1077944384 11106 0 0 0 147 2 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304265472240 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 6 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29581] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0 cores=0,2,4,6
/proc/29567/task/29581/stat : 29581 (java) S 29564 29567 29085 0 -1 1077944384 3 0 0 0 0 0 0 0 20 0 15 0 40689177 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304264419936 140304798066389 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
[pid=29567/tid=29582] ppid=29564 vsize=14093000 memory=2017896 CPUtime=0.58 cores=0,2,4,6
/proc/29567/task/29582/stat : 29582 (java) S 29564 29567 29085 0 -1 1077944384 1525 0 0 0 25 33 0 0 20 0 15 0 40689178 14431232000 504474 33554432000 4194304 4196468 140725648340768 140304263367472 140304798067330 0 4 0 16800975 18446744071579849748 0 0 -1 4 0 0 0 0 0 6293624 6294260 11825152 140725648344149 140725648344329 140725648344329 140725648347087 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 14093000 KiB
Current children cumulated memory: 2017896 KiB

Child status: 143
Real time (s): 2381.92
CPU time (s): 2400.05
CPU user time (s): 2398.57
CPU system time (s): 1.48465
CPU usage (%): 100.762
Max. virtual memory (cumulated for all children) (KiB): 14093000
Max. memory (cumulated for all children) (KiB): 2017896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.57
system time used= 1.48465
maximum resident set size= 2018388
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 199807
page faults= 0
swaps= 0
block input operations= 0
block output operations= 2640
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87043
involuntary context switches= 4712


# summary of solver processes directly reported to runsolver:
#   pid: 29567
#   total CPU time (s): 2400.05
#   total CPU user time (s): 2398.57
#   total CPU system time (s): 1.48465

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.0841 second user time and 20.43 second system time

The end

Launcher Data

Begin job on node151 at 2018-07-22 05:47:40
IDJOB=4291602
IDBENCH=141054
IDSOLVER=2746
FILE ID=node151/4291602-1532231260
RUNJOBID= node151-1532226532-29116
PBS_JOBID= 21018950
Free space on /tmp= 55036 MiB

SOLVER NAME= OscaR - Hybrid 2018-07-02
BENCH NAME= XCSP18/NurseRostering/NurseRostering-11_c18.xml
COMMAND LINE= java -Xmx11000m -jar oscarCPXcsp3-hybrid.jar --randomseed RANDOMSEED --timelimit TIMELIMIT --memlimit 11000 --nbcore NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4291602-1532231260/watcher-4291602-1532231260 -o /tmp/evaluation-result-4291602-1532231260/solver-4291602-1532231260 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532226532-29116 --watchdog 2560  java -Xmx11000m -jar oscarCPXcsp3-hybrid.jar --randomseed 271149695 --timelimit 2400 --memlimit 11000 --nbcore 4 HOME/instance-4291602-1532231260.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 05c4130aaeb0756e89b7f80c2b4d0b20
RANDOM SEED=271149695

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18779200 kB
MemAvailable:   30119720 kB
Buffers:          228980 kB
Cached:         11261192 kB
SwapCached:            0 kB
Active:          2864492 kB
Inactive:       10496172 kB
Active(anon):    1873252 kB
Inactive(anon):    16936 kB
Active(file):     991240 kB
Inactive(file): 10479236 kB
Unevictable:        7940 kB
Mlocked:            7940 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             35940 kB
Writeback:             0 kB
AnonPages:       1981104 kB
Mapped:            48832 kB
Shmem:             17032 kB
Slab:             325884 kB
SReclaimable:     298504 kB
SUnreclaim:        27380 kB
KernelStack:        3808 kB
PageTables:         9128 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2812520 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1902592 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 55000 MiB
End job on node151 at 2018-07-22 06:27:22