Trace number 4410078

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)115 2012.44 252.021

General information on the benchmark

NameGolombRuler/
GolombRuler-a3v18-13_c18.xml
MD5SUM66cce14b45be89e007abc3e2885e8941
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark110
Best CPU time to get the best result obtained on this benchmark1994.42
Satisfiable
(Un)Satisfiability was proved
Number of variables182
Number of constraints79
Number of domains2
Minimum domain size169
Maximum domain size170
Distribution of domain sizes[{"size":169,"count":78},{"size":170,"count":13}]
Minimum variable degree0
Maximum variable degree13
Distribution of variable degrees[{"degree":0,"count":91},{"degree":2,"count":78},{"degree":12,"count":12},{"degree":13,"count":1}]
Minimum constraint arity3
Maximum constraint arity78
Distribution of constraint arities[{"arity":3,"count":78},{"arity":78,"count":1}]
Number of extensional constraints0
Number of intensional constraints78
Distribution of constraint types[{"type":"intension","count":78},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.07	c
0.00/0.07	c This is cosoco 2.00 --  
0.00/0.07	c
0.00/0.07	c command line: cosoco -model -nbcores=8 HOME/instance-4410078-1569836934.xml 
0.00/0.07	c enable optimization
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.02 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 182
0.00/0.07	c |            Domain Sizes: 169..170
0.00/0.07	c |
0.00/0.07	c |             Constraints: 80
0.00/0.07	c |                   Arity: 1..78  -- Unary: 1  -- Ternary: 78
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          All Different: 1
0.00/0.07	c |                          Intension: 1
0.00/0.07	c |                          Sum: 78
0.00/0.07	c |                          
0.00/0.07	c |               Objective: Minimize Intension
0.00/0.07	
0.00/0.07	c =========================================================================================================
0.00/0.07	c Parallel mode: Portfolio
0.00/0.07	c [pFactory][Group N°0] created (threads:8).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.07	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.07	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.07	c [pFactory][Group N°0] task 7 launched on thread 1.
0.00/0.07	c [pFactory][Group N°0] task 6 launched on thread 0.
0.00/0.07	c [pFactory][Group N°0] task 5 launched on thread 2.
0.00/0.07	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.07	c [pFactory][Group N°0] task 3 launched on thread 7.
0.00/0.07	c [pFactory][Group N°0] task 2 launched on thread 4.
0.00/0.07	c [pFactory][Group N°0] task 1 launched on thread 3.
0.00/0.07	c [pFactory][Group N°0] task 0 launched on thread 5.
0.00/0.07	o 169
0.64/0.12	o 154
0.64/0.14	o 153
0.64/0.17	o 150
0.64/0.17	o 144
0.64/0.19	o 138
0.64/0.21	o 136
1.51/0.23	o 135
1.51/0.25	o 133
3.08/0.43	o 131
3.88/0.60	o 123
18.10/2.36	o 122
48.52/6.13	o 115
2012.34/252.02	
2012.34/252.02	c *** INTERRUPTED ***
2012.34/252.02	c call to solver        : 4
2012.34/252.02	c
2012.34/252.02	c restarts              : 68000       
2012.34/252.02	c conflicts             : 776529       (386 /sec)
2012.34/252.02	c decisions             : 1264250      (628 /sec)
2012.34/252.02	c propagations          : 843212715   (419007 /sec)
2012.34/252.02	c root propagations     : 728         
2012.34/252.02	c filter calls          : 126287329      (62754 /sec)
2012.34/252.02	c useless filter calls  : 17127103       (13 %)
2012.34/252.02	c Memory used           : 606.35 MB
2012.34/252.02	c Best bound time (wc)  : 6.13169 s
2012.34/252.02	c CPU time              : 2012.41 s
2012.34/252.02	c real time             : 252.016 s
2012.34/252.02	
2012.34/252.02	s SATISFIABLE
2012.34/252.02	c Best value found: 115
2012.34/252.02	
2012.34/252.02	
2012.34/252.02	v <instantiation type='solution' cost='115'>
2012.34/252.02	v <list>x[0] x[10] x[11] x[12] x[1] x[2] x[3] x[4] x[5] x[6] x[7] x[8] x[9] y[0][0] y[0][10] y[0][11] y[0][12] y[0][1] y[0][2] y[0][3] y[0][4] y[0][5] y[0][6] y[0][7] y[0][8] y[0][9] y[10][0] y[10][10] y[10][11] y[10][12] y[10][1] y[10][2] y[10][3] y[10][4] y[10][5] y[10][6] y[10][7] y[10][8] y[10][9] y[11][0] y[11][10] y[11][11] y[11][12] y[11][1] y[11][2] y[11][3] y[11][4] y[11][5] y[11][6] y[11][7] y[11][8] y[11][9] y[12][0] y[12][10] y[12][11] y[12][12] y[12][1] y[12][2] y[12][3] y[12][4] y[12][5] y[12][6] y[12][7] y[12][8] y[12][9] y[1][0] y[1][10] y[1][11] y[1][12] y[1][1] y[1][2] y[1][3] y[1][4] y[1][5] y[1][6] y[1][7] y[1][8] y[1][9] y[2][0] y[2][10] y[2][11] y[2][12] y[2][1] y[2][2] y[2][3] y[2][4] y[2][5] y[2][6] y[2][7] y[2][8] y[2][9] y[3][0] y[3][10] y[3][11] y[3][12] y[3][1] y[3][2] y[3][3] y[3][4] y[3][5] y[3][6] y[3][7] y[3][8] y[3][9] y[4][0] y[4][10] y[4][11] y[4][12] y[4][1] y[4][2] y[4][3] y[4][4] y[4][5] y[4][6] y[4][7] y[4][8] y[4][9] y[5][0] y[5][10] y[5][11] y[5][12] y[5][1] y[5][2] y[5][3] y[5][4] y[5][5] y[5][6] y[5][7] y[5][8] y[5][9] y[6][0] y[6][10] y[6][11] y[6][12] y[6][1] y[6][2] y[6][3] y[6][4] y[6][5] y[6][6] y[6][7] y[6][8] y[6][9] y[7][0] y[7][10] y[7][11] y[7][12] y[7][1] y[7][2] y[7][3] y[7][4] y[7][5] y[7][6] y[7][7] y[7][8] y[7][9] y[8][0] y[8][10] y[8][11] y[8][12] y[8][1] y[8][2] y[8][3] y[8][4] y[8][5] y[8][6] y[8][7] y[8][8] y[8][9] y[9][0] y[9][10] y[9][11] y[9][12] y[9][1] y[9][2] y[9][3] y[9][4] y[9][5] y[9][6] y[9][7] y[9][8] y[9][9] </list>
2012.34/252.02	v <values>0 108 113 115 1 10 38 41 61 65 83 94 100 * 108 113 115 1 10 38 41 61 65 83 94 100 * * 5 7 * * * * * * * * * * * * 2 * * * * * * * * * * * * * * * * * * * * * * * 107 112 114 * 9 37 40 60 64 82 93 99 * 98 103 105 * * 28 31 51 55 73 84 90 * 70 75 77 * * * 3 23 27 45 56 62 * 67 72 74 * * * * 20 24 42 53 59 * 47 52 54 * * * * * 4 22 33 39 * 43 48 50 * * * * * * 18 29 35 * 25 30 32 * * * * * * * 11 17 * 14 19 21 * * * * * * * * 6 * 8 13 15 * * * * * * * * * </values>
2012.34/252.02	v </instantiation>
2012.34/252.02

Verifier Data 

OK	115

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15265 MiB free)
  memory of node 1: 16384 MiB (15553 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4410078-1569836934/watcher-4410078-1569836934 -o /tmp/evaluation-result-4410078-1569836934/solver-4410078-1569836934 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569827265-24285 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4410078-1569836934.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=27032, runsolver pid=27029
Current StackSize limit: 8192 KiB


[startup+0.100423 s]*
/proc/loadavg: 3.09 3.95 6.16 9/200 27041
/proc/meminfo: memFree=31553932/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=7668 CPUtime=0.64 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 2416 0 0 0 64 0 0 0 20 0 9 0 559946435 635797504 1917 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 1917 870 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=576460756329955530 CPUtime=0.07 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 38 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207308745744 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=0 CPUtime=0.07 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 47 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207300353040 5149706 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=3688642837102868128 CPUtime=0.07 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 39 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207291960128 5078762 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=0 CPUtime=0.07 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 38 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207283567632 5150604 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=0 CPUtime=0.07 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 37 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207275174944 5149706 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=0 CPUtime=0.07 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 39 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207266782016 5081341 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=-1 CPUtime=0.07 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 37 0 0 0 7 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207258389536 5075597 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=0 CPUtime=0.06 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 37 0 0 0 6 0 0 0 20 0 9 0 559946438 635797504 1917 33554432000 4194304 6211132 140731814901104 140207249996816 5149690 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 0.64 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 7668 KiB

[startup+0.210423 s]*
/proc/loadavg: 3.09 3.95 6.16 10/200 27041
/proc/meminfo: memFree=31553636/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=621156 memory=9640 CPUtime=1.51 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 2798 0 0 0 150 1 0 0 20 0 9 0 559946435 636063744 2410 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155289 2410 883 493 0 148594 0
[pid=27032/tid=27034] ppid=27029 vsize=621156 memory=8316850467074736180 CPUtime=0.18 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 82 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207308745856 5074613 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=621156 memory=9432 CPUtime=0.18 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 110 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207300353296 5186260 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=621156 memory=140642043653286 CPUtime=0.18 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 78 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207291960352 5081355 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=621156 memory=-1 CPUtime=0.18 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 108 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207283567648 5390167 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=621156 memory=0 CPUtime=0.18 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 78 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207275174928 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=621156 memory=0 CPUtime=0.18 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 81 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207266781752 5390016 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=621156 memory=-1 CPUtime=0.18 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 77 0 0 0 18 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207258389512 5397328 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=621156 memory=0 CPUtime=0.16 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 80 0 0 0 16 0 0 0 20 0 9 0 559946438 636063744 2410 33554432000 4194304 6211132 140731814901104 140207249996816 5081965 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 1.51 s
Current children cumulated vsize: 621156 KiB
Current children cumulated memory: 9640 KiB

[startup+0.310423 s]*
/proc/loadavg: 3.09 3.95 6.16 9/200 27041
/proc/meminfo: memFree=31553636/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=9680 CPUtime=2.3 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 2815 0 0 0 229 1 0 0 20 0 9 0 559946435 635797504 2420 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2420 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=1398722017469774279 CPUtime=0.28 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 82 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207308745856 5075208 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=0 CPUtime=0.28 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 110 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207300353296 5079024 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=0 CPUtime=0.28 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 78 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207291960352 5082358 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=6944656592455097440 CPUtime=0.28 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 108 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207283567888 5148716 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=0 CPUtime=0.28 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 95 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207275175184 5078765 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=0 CPUtime=0.28 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 81 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207266781752 5079440 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=0 CPUtime=0.28 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 77 0 0 0 28 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207258389512 5149706 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=0 CPUtime=0.25 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 80 0 0 0 25 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207249996928 5075312 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 2.3 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 9680 KiB

[startup+0.70042 s]
/proc/loadavg: 3.64 4.05 6.18 9/200 27041
/proc/meminfo: memFree=31553416/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=9680 CPUtime=5.33 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 2827 0 0 0 532 1 0 0 20 0 9 0 559946435 635797504 2420 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2420 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=1548 CPUtime=0.66 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 82 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207308745744 5079432 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=8564 CPUtime=0.66 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 110 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207300353056 5078890 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=1712 CPUtime=0.66 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 78 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207291960336 5079248 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=1112 CPUtime=0.66 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 108 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207283567632 5149706 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=1004 CPUtime=0.66 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 96 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207275174928 5081337 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=1560 CPUtime=0.66 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 86 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207266782224 5081952 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=932 CPUtime=0.66 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 77 0 0 0 66 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207258389536 5082427 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=3768 CPUtime=0.62 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 86 0 0 0 62 0 0 0 20 0 9 0 559946438 635797504 2420 33554432000 4194304 6211132 140731814901104 140207249996928 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 5.33 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 9680 KiB

[startup+1.50042 s]
/proc/loadavg: 3.64 4.05 6.18 9/199 27041
/proc/meminfo: memFree=31552920/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10232 CPUtime=11.71 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 3764 0 0 0 1170 1 0 0 20 0 9 0 559946435 635797504 2558 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2558 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=9319 CPUtime=1.46 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 182 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207308745744 5075560 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=23472 CPUtime=1.46 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 251 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207300352840 5148719 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=0 CPUtime=1.46 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 130 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207291960336 5075221 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=8243114992657236051 CPUtime=1.46 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 279 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207283567632 5081975 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=288292194505458544 CPUtime=1.46 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 151 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207275174928 5149945 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=7956805424100234340 CPUtime=1.46 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 280 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207266782224 5081337 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=281283851122144 CPUtime=1.46 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 228 0 0 0 146 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207258389520 5074760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=3540022958417647360 CPUtime=1.4 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 159 0 0 0 140 0 0 0 20 0 9 0 559946438 635797504 2558 33554432000 4194304 6211132 140731814901104 140207249996816 5081992 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 11.71 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10232 KiB

[startup+3.10942 s]
/proc/loadavg: 3.64 4.05 6.18 9/199 27041
/proc/meminfo: memFree=31553508/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10284 CPUtime=24.55 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 5027 0 0 0 2454 1 0 0 20 0 9 0 559946435 635797504 2571 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2571 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=10232 CPUtime=3.06 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 433 0 0 0 306 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207308746000 5149958 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=1060 CPUtime=3.07 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 387 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207300352840 5082393 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=10232 CPUtime=3.07 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 232 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207291960336 5446270 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=9319 CPUtime=3.07 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 410 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207283567744 5149714 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=23472 CPUtime=3.07 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 287 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207275174928 5081341 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=286 CPUtime=3.07 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 504 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207266782224 5389970 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=286 CPUtime=3.07 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 395 0 0 0 307 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207258389520 5081280 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=279 CPUtime=2.99 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 275 0 0 0 299 0 0 0 20 0 9 0 559946438 635797504 2571 33554432000 4194304 6211132 140731814901104 140207249996816 5082393 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 24.55 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10284 KiB

[startup+6.30043 s]
/proc/loadavg: 4.07 4.13 6.20 9/199 27041
/proc/meminfo: memFree=31553832/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10292 CPUtime=50.04 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 7295 0 0 0 5003 1 0 0 20 0 9 0 559946435 635797504 2573 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2573 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=140646334215807 CPUtime=6.25 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 705 0 0 0 625 0 0 0 20 0 9 0 559946438 635797504 2573 33554432000 4194304 6211132 140731814901104 140207308746000 5078762 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=56 CPUtime=6.26 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 676 0 0 0 626 0 0 0 20 0 9 0 559946438 635797504 2573 33554432000 4194304 6211132 140731814901104 140207300353040 5081443 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=10284 CPUtime=6.26 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 430 0 0 0 626 0 0 0 20 0 9 0 559946438 635797504 2573 33554432000 4194304 6211132 140731814901104 140207291960448 5079253 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=0 CPUtime=6.26 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 740 0 0 0 626 0 0 0 20 0 9 0 559946438 635797504 2573 33554432000 4194304 6211132 140731814901104 140207283567744 5082759 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0

################
# More data... #
################

/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 955 0 0 0 2546 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207291960336 5149184 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=3504 CPUtime=25.46 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 1492 0 0 0 2546 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207283567632 5389987 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=6485400618181 CPUtime=25.46 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 1146 0 0 0 2546 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207275174928 5149690 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=33 CPUtime=25.46 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 1708 0 0 0 2546 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207266782224 5149690 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=6935054825532540783 CPUtime=25.46 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1127 0 0 0 2546 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207258389176 5186278 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=10408 CPUtime=25.11 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1015 0 0 0 2511 0 0 0 20 0 9 0 559946438 635797504 2602 33554432000 4194304 6211132 140731814901104 140207249996928 5078752 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 203.39 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10408 KiB

[startup+51.1104 s]
/proc/loadavg: 6.52 4.78 6.32 9/199 27044
/proc/meminfo: memFree=31552800/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10412 CPUtime=407.92 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 14752 0 0 0 40790 2 0 0 20 0 9 0 559946435 635797504 2603 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2603 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=10412 CPUtime=51.05 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 1452 0 0 0 5105 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207308745744 5149714 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=10412 CPUtime=51.07 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 1616 0 0 0 5107 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207300353152 5074526 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=164 CPUtime=51.07 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 1262 0 0 0 5107 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207291960336 5075237 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=281283850855136 CPUtime=51.06 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 1921 0 0 0 5106 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207283567384 5148683 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=3028 CPUtime=51.07 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 1464 0 0 0 5107 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207275174928 5075686 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=2012 CPUtime=51.05 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 2209 0 0 0 5105 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207266782224 5082367 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=164 CPUtime=51.07 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1370 0 0 0 5107 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207258389176 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=0 CPUtime=50.4 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1354 0 0 0 5040 0 0 0 20 0 9 0 559946438 635797504 2603 33554432000 4194304 6211132 140731814901104 140207249996928 5082803 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 407.92 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10412 KiB

[startup+102.301 s]
/proc/loadavg: 7.44 5.30 6.42 9/199 27047
/proc/meminfo: memFree=31554148/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10416 CPUtime=816.76 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 16616 0 0 0 81674 2 0 0 20 0 9 0 559946435 635797504 2604 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2604 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=10416 CPUtime=102.23 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 1644 0 0 0 10223 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207308745744 5078762 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=10416 CPUtime=102.25 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 1835 0 0 0 10225 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207300353152 5082393 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=10412 CPUtime=102.26 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 1462 0 0 0 10226 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207291960336 5074376 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=0 CPUtime=102.24 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 2201 0 0 0 10224 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207283567304 5078951 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=3504 CPUtime=102.25 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 1730 0 0 0 10225 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207275174928 5392282 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=0 CPUtime=102.23 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 2530 0 0 0 10223 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207266782224 5397267 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=500 CPUtime=102.25 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1570 0 0 0 10225 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207258389176 5446307 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=1560 CPUtime=100.96 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1540 0 0 0 10096 0 0 0 20 0 9 0 559946438 635797504 2604 33554432000 4194304 6211132 140731814901104 140207249996928 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 816.76 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10416 KiB

[startup+162.3 s]
/proc/loadavg: 8.01 5.85 6.54 9/200 27058
/proc/meminfo: memFree=31553440/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10420 CPUtime=1295.9 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 18395 0 0 0 129588 2 0 0 20 0 9 0 559946435 635797504 2605 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2605 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=10420 CPUtime=162.23 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 1809 0 0 0 16223 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207308745744 5149732 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=10420 CPUtime=162.24 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 2067 0 0 0 16224 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207300353152 5075269 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=281283851261552 CPUtime=162.24 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 1691 0 0 0 16224 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207291960336 5075208 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=10416 CPUtime=162.22 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 2469 0 0 0 16222 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207283567384 5186301 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=10420 CPUtime=162.24 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 1912 0 0 0 16224 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207275174928 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=10420 CPUtime=162.22 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 2886 0 0 0 16222 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207266782224 5078762 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=10420 CPUtime=162.23 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1703 0 0 0 16223 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207258389176 5193742 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=10420 CPUtime=160.2 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1754 0 0 0 16020 0 0 0 20 0 9 0 559946438 635797504 2605 33554432000 4194304 6211132 140731814901104 140207249996928 5149800 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 1295.9 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10420 KiB

[startup+222.3 s]
/proc/loadavg: 8.37 6.34 6.66 9/200 27063
/proc/meminfo: memFree=31553304/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10424 CPUtime=1775.07 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 19306 0 0 0 177505 2 0 0 20 0 9 0 559946435 635797504 2606 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2606 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=10424 CPUtime=222.22 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 1875 0 0 0 22222 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207308745744 5078923 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=10424 CPUtime=222.24 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 2180 0 0 0 22224 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207300353152 5076405 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=10424 CPUtime=222.22 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 1781 0 0 0 22222 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207291960336 5193744 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=10424 CPUtime=222.21 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 2602 0 0 0 22221 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207283567384 5404006 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=10424 CPUtime=222.23 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 2050 0 0 0 22223 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207275174776 5389987 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=10424 CPUtime=222.21 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 3042 0 0 0 22221 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207266782224 5075296 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=10424 CPUtime=222.23 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1801 0 0 0 22223 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207258389176 5149825 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=3504 CPUtime=219.43 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1871 0 0 0 21943 0 0 0 20 0 9 0 559946438 635797504 2606 33554432000 4194304 6211132 140731814901104 140207249996928 5079440 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 1775.07 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10424 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252 s]*
/proc/loadavg: 8.47 6.56 6.72 9/200 27063
/proc/meminfo: memFree=31553836/32770624 swapFree=66999256/67108860
[pid=27032] ppid=27029 vsize=620896 memory=10432 CPUtime=2012.34 cores=0-7
/proc/27032/stat : 27032 (cosoco) S 27029 27032 24258 0 -1 1077944320 20204 0 0 0 201232 2 0 0 20 0 9 0 559946435 635797504 2608 33554432000 4194304 6211132 140731814901104 140731814899360 140207331888887 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
/proc/27032/statm: 155224 2608 883 493 0 148529 0
[pid=27032/tid=27034] ppid=27029 vsize=620896 memory=3952 CPUtime=251.93 cores=0-7
/proc/27032/task/27034/stat : 27034 (cosoco) R 27029 27032 24258 0 -1 4202560 1921 0 0 0 25193 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207308745744 5149920 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27035] ppid=27029 vsize=620896 memory=2828 CPUtime=251.94 cores=0-7
/proc/27032/task/27035/stat : 27035 (cosoco) R 27029 27032 24258 0 -1 4202560 2304 0 0 0 25194 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207300353152 5074575 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27036] ppid=27029 vsize=620896 memory=1398722017469774279 CPUtime=251.92 cores=0-7
/proc/27032/task/27036/stat : 27036 (cosoco) R 27029 27032 24258 0 -1 4202560 1886 0 0 0 25192 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207291960448 5082487 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27037] ppid=27029 vsize=620896 memory=1060 CPUtime=251.91 cores=0-7
/proc/27032/task/27037/stat : 27037 (cosoco) R 27029 27032 24258 0 -1 4202560 2743 0 0 0 25191 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207283567256 5393104 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27038] ppid=27029 vsize=620896 memory=1548 CPUtime=251.94 cores=0-7
/proc/27032/task/27038/stat : 27038 (cosoco) R 27029 27032 24258 0 -1 4202560 2177 0 0 0 25194 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207275174928 5075571 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27039] ppid=27029 vsize=620896 memory=8564 CPUtime=251.91 cores=0-7
/proc/27032/task/27039/stat : 27039 (cosoco) R 27029 27032 24258 0 -1 4202560 3181 0 0 0 25191 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207266782224 5079374 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27040] ppid=27029 vsize=620896 memory=1712 CPUtime=251.93 cores=0-7
/proc/27032/task/27040/stat : 27040 (cosoco) R 27029 27032 24258 0 -1 4202560 1895 0 0 0 25193 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207258389176 5186301 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
[pid=27032/tid=27041] ppid=27029 vsize=620896 memory=1112 CPUtime=248.77 cores=0-7
/proc/27032/task/27041/stat : 27041 (cosoco) R 27029 27032 24258 0 -1 4202560 1993 0 0 0 24877 0 0 0 20 0 9 0 559946438 635797504 2608 33554432000 4194304 6211132 140731814901104 140207249996928 5081349 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 31797248 140731814904854 140731814904946 140731814904946 140731814907854 0
Current children cumulated CPU time: 2012.34 s
Current children cumulated vsize: 620896 KiB
Current children cumulated memory: 10432 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.021 s]
# the end of solver process 27032 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2012.41 s, system=0.027985 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.021
CPU time (s): 2012.44
CPU user time (s): 2012.41
CPU system time (s): 0.027985
CPU usage (%): 798.52
Max. virtual memory (cumulated for all children) (KiB): 621156
Max. memory (cumulated for all children) (KiB): 10432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2012.41
system time used= 0.027985
maximum resident set size= 10592
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20260
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 126
involuntary context switches= 16741


# summary of solver processes directly reported to runsolver:
#   pid: 27032
#   total CPU time (s): 2012.44
#   total CPU user time (s): 2012.41
#   total CPU system time (s): 0.027985

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.13381 second user time and 2.03299 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-30 11:47:55
IDJOB=4410078
IDBENCH=141368
IDSOLVER=2878
FILE ID=node103/4410078-1569836934
RUNJOBID= node103-1569827265-24285
PBS_JOBID= 21705929
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP18/GolombRuler/GolombRuler-a3v18-13_c18.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4410078-1569836934/watcher-4410078-1569836934 -o /tmp/evaluation-result-4410078-1569836934/solver-4410078-1569836934 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569827265-24285 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4410078-1569836934.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 66cce14b45be89e007abc3e2885e8941
RANDOM SEED=798394923

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31558592 kB
MemAvailable:   31868372 kB
Buffers:          186064 kB
Cached:           467772 kB
SwapCached:         7000 kB
Active:           339276 kB
Inactive:         329208 kB
Active(anon):      22748 kB
Inactive(anon):    74172 kB
Active(file):     316528 kB
Inactive(file):   255036 kB
Unevictable:      107704 kB
Mlocked:          107704 kB
SwapTotal:      67108860 kB
SwapFree:       66999256 kB
Dirty:              4208 kB
Writeback:             0 kB
AnonPages:        115696 kB
Mapped:            26020 kB
Shmem:             73656 kB
Slab:             137248 kB
SReclaimable:     108104 kB
SUnreclaim:        29144 kB
KernelStack:        3424 kB
PageTables:         5176 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     539036 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 62028 MiB
End job on node103 at 2019-09-30 11:52:07