Trace number 4398701

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)67514 2012.55 252.014

General information on the benchmark

NameQuadraticAssignment/QuadraticAssignment-m1-s1/
QuadraticAssignment-tai10a.xml
MD5SUMb58690ea851c8aad9573a552336d280c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark67514
Best CPU time to get the best result obtained on this benchmark30.4709
Satisfiable
(Un)Satisfiability was proved
Number of variables110
Number of constraints46
Number of domains2
Minimum domain size10
Maximum domain size35
Distribution of domain sizes[{"size":10,"count":10},{"size":35,"count":45}]
Minimum variable degree0
Maximum variable degree10
Distribution of variable degrees[{"degree":0,"count":55},{"degree":2,"count":45},{"degree":10,"count":10}]
Minimum constraint arity3
Maximum constraint arity10
Distribution of constraint arities[{"arity":3,"count":45},{"arity":10,"count":1}]
Number of extensional constraints45
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":45},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -model -nbcores=8 HOME/instance-4398701-1568608300.xml 
0.00/0.01	c enable optimization
0.00/0.01	c ========================================[ Problem Statistics ]===========================================
0.00/0.01	c |                                                                                                       
0.00/0.01	c |  Parse time        :         0.01 s 
0.00/0.01	c |
0.00/0.01	c |               Variables: 110
0.00/0.01	c |            Domain Sizes: 10..35
0.00/0.01	c |
0.00/0.01	c |             Constraints: 47
0.00/0.01	c |                   Arity: 3..45  -- Ternary: 45
0.00/0.01	c | 
0.00/0.01	c |                   Types: 
0.00/0.01	c |                          All Different: 1
0.00/0.01	c |                          Extension: 45  (nb tuples: 90..90) -- (shared: 352)
0.00/0.01	c |                          Sum: 1
0.00/0.01	c |                          
0.00/0.01	c |               Objective: Minimize Sum
0.00/0.01	
0.00/0.01	c =========================================================================================================
0.00/0.01	c Parallel mode: Portfolio
0.00/0.01	c [pFactory][Group N°0] created (threads:8).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.01	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.01	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.01	c [pFactory][Group N°0] task 7 launched on thread 0.
0.00/0.01	c [pFactory][Group N°0] task 6 launched on thread 1.
0.00/0.01	c [pFactory][Group N°0] task 5 launched on thread 5.
0.00/0.01	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.01	c [pFactory][Group N°0] task 3 launched on thread 2.
0.00/0.01	c [pFactory][Group N°0] task 2 launched on thread 4.
0.00/0.01	c [pFactory][Group N°0] task 1 launched on thread 7.
0.00/0.01	c [pFactory][Group N°0] task 0 launched on thread 3.
0.00/0.01	o 98440
0.00/0.01	o 96732
0.00/0.01	o 91481
0.00/0.02	o 90220
0.00/0.02	o 88189
0.00/0.02	o 86618
0.00/0.02	o 86385
0.00/0.02	o 84335
0.00/0.02	o 83982
0.00/0.02	o 83522
0.00/0.02	o 82514
0.00/0.03	o 80106
0.00/0.03	o 76575
0.00/0.04	o 72886
7.04/0.98	o 72367
7.90/1.01	o 72233
11.82/1.58	o 71477
14.22/1.85	o 70487
16.69/2.18	o 70254
24.67/5.51	o 69065
24.67/11.92	o 68681
155.30/19.58	o 68136
156.90/19.73	o 67914
263.94/33.13	o 67801
349.46/43.85	o 67514
2012.44/252.01	
2012.44/252.01	c *** INTERRUPTED ***
2012.44/252.01	c call to solver        : 22
2012.44/252.01	c
2012.44/252.01	c restarts              : 199368      
2012.44/252.01	c conflicts             : 2109493      (1048 /sec)
2012.44/252.01	c decisions             : 12571808     (6248 /sec)
2012.44/252.01	c propagations          : 528670957   (262757 /sec)
2012.44/252.01	c root propagations     : 1633        
2012.44/252.01	c filter calls          : 157113211      (78088 /sec)
2012.44/252.01	c useless filter calls  : 117028477      (74 %)
2012.44/252.01	c Memory used           : 605.72 MB
2012.44/252.01	c Best bound time (wc)  : 43.8469 s
2012.44/252.01	c CPU time              : 2012.01 s
2012.44/252.01	c real time             : 252.007 s
2012.44/252.01	
2012.44/252.01	s SATISFIABLE
2012.44/252.01	c Best value found: 67514
2012.44/252.01	
2012.44/252.01	
2012.44/252.01	v <instantiation type='solution' cost='67514'>
2012.44/252.01	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[0][5] d[0][6] d[0][7] d[0][8] d[0][9] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[1][5] d[1][6] d[1][7] d[1][8] d[1][9] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[2][5] d[2][6] d[2][7] d[2][8] d[2][9] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[3][5] d[3][6] d[3][7] d[3][8] d[3][9] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] d[4][5] d[4][6] d[4][7] d[4][8] d[4][9] d[5][0] d[5][1] d[5][2] d[5][3] d[5][4] d[5][5] d[5][6] d[5][7] d[5][8] d[5][9] d[6][0] d[6][1] d[6][2] d[6][3] d[6][4] d[6][5] d[6][6] d[6][7] d[6][8] d[6][9] d[7][0] d[7][1] d[7][2] d[7][3] d[7][4] d[7][5] d[7][6] d[7][7] d[7][8] d[7][9] d[8][0] d[8][1] d[8][2] d[8][3] d[8][4] d[8][5] d[8][6] d[8][7] d[8][8] d[8][9] d[9][0] d[9][1] d[9][2] d[9][3] d[9][4] d[9][5] d[9][6] d[9][7] d[9][8] d[9][9] x[0] x[1] x[2] x[3] x[4] x[5] x[6] x[7] x[8] x[9] </list>
2012.44/252.01	v <values>* 10 61 76 21 45 82 12 57 0 * * 25 41 4 56 82 95 6 21 * * * 18 36 86 35 84 18 79 * * * * 39 69 91 1 59 40 * * * * * 91 26 0 36 89 * * * * * * 26 9 56 44 * * * * * * * 35 11 6 * * * * * * * * 85 63 * * * * * * * * * 75 * * * * * * * * * * 8 0 7 5 9 4 3 2 6 1 </values>
2012.44/252.01	v </instantiation>
2012.44/252.01

Verifier Data 

OK	67514

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15313 MiB free)
  memory of node 1: 16384 MiB (14259 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398701-1568608300/watcher-4398701-1568608300 -o /tmp/evaluation-result-4398701-1568608300/solver-4398701-1568608300 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node102-1568597211-7653 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4398701-1568608300.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=9294, runsolver pid=9291

[startup+0.100717 s]*
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279192/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=6856 CPUtime=0.75 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 2016 0 0 0 75 0 0 0 20 0 9 0 437081393 635138048 1714 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1714 853 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=8317482817917895235 CPUtime=0.09 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 15 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899200167096 5037823 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=4342489072520795239 CPUtime=0.08 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 19 0 0 0 8 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899191774480 5157544 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=139664806884992 CPUtime=0.09 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899183381776 5039536 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=0 CPUtime=0.09 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 9 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899174989072 5157544 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=0 CPUtime=0.09 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899166596368 5037865 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=0 CPUtime=0.09 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 13 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899158203664 5396392 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=-1 CPUtime=0.09 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 14 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899149810960 5039193 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=0 CPUtime=0.09 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 9 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899141418256 5038872 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 0.75 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 6856 KiB

[startup+0.21072 s]*
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279192/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=6856 CPUtime=1.63 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 2016 0 0 0 162 1 0 0 20 0 9 0 437081393 635138048 1714 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1714 853 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=8316850467074736180 CPUtime=0.2 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 15 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899200167096 5250272 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=2809213 CPUtime=0.18 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 19 0 0 0 18 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899191774480 5155807 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=139664806894276 CPUtime=0.2 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899183381776 5039038 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=-1 CPUtime=0.19 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 9 0 0 0 19 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899174989072 5186256 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=0 CPUtime=0.2 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899166596368 5158028 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=0 CPUtime=0.2 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 13 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899158203664 5250301 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=-1 CPUtime=0.2 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 14 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899149810960 5039617 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=0 CPUtime=0.2 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 20 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899141418256 5394333 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 1.63 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 6856 KiB

[startup+0.310717 s]*
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279192/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=6856 CPUtime=2.41 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 2016 0 0 0 240 1 0 0 20 0 9 0 437081393 635138048 1714 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1714 853 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=8317482817917895235 CPUtime=0.3 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 15 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899200167096 5250287 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=4126316290023845779 CPUtime=0.27 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 19 0 0 0 27 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899191774480 5039650 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=0 CPUtime=0.3 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899183381776 5250307 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=6944656592455097440 CPUtime=0.3 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 9 0 0 0 29 1 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899174989072 5038788 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=6656426216303648864 CPUtime=0.3 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899166596368 5250287 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=0 CPUtime=0.3 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 13 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899158203664 5009388 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=0 CPUtime=0.3 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 14 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899149810960 5250224 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=0 CPUtime=0.3 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 30 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899141418256 5157976 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 2.41 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 6856 KiB

[startup+0.700715 s]
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30278912/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=6856 CPUtime=5.44 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 2016 0 0 0 541 3 0 0 20 0 9 0 437081393 635138048 1714 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1714 853 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=-7035114785800479027 CPUtime=0.68 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 15 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899200167096 5250272 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=1764 CPUtime=0.63 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 19 0 0 0 63 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899191774480 5158023 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=111632 CPUtime=0.68 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899183381776 5186269 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=808 CPUtime=0.67 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 9 0 0 0 65 2 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899174989072 5035240 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=1804 CPUtime=0.68 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899166596368 5009032 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=916 CPUtime=0.68 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 13 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899158203664 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=-7175204567652784766 CPUtime=0.68 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 14 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899149810960 5250284 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=3054156605268465310 CPUtime=0.68 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 11 0 0 0 68 0 0 0 20 0 9 0 437081394 635138048 1714 33554432000 4194304 6211092 140736426742544 139899141418256 5038872 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 5.44 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 6856 KiB

[startup+1.50072 s]
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279444/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7272 CPUtime=11.82 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 2932 0 0 0 1178 4 0 0 20 0 9 0 437081393 635138048 1818 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1818 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=1804 CPUtime=1.48 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 113 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899200167096 5035252 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=916 CPUtime=1.41 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 148 0 0 0 140 1 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899191774480 5250301 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=-7175204567652784766 CPUtime=1.48 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 93 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899183381776 5396756 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=0 CPUtime=1.48 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 138 0 0 0 145 3 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899174989072 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=6656426216303648864 CPUtime=1.48 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 153 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899166596368 5156128 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=7598811100138176585 CPUtime=1.48 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 179 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899158203664 5250287 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=2809602 CPUtime=1.48 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 72 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899149810960 5250453 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=3832625066852745248 CPUtime=1.48 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 123 0 0 0 148 0 0 0 20 0 9 0 437081394 635138048 1818 33554432000 4194304 6211092 140736426742544 139899141418256 5158106 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 11.82 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7272 KiB

[startup+3.11072 s]
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279940/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7276 CPUtime=24.67 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 3601 0 0 0 2459 8 0 0 20 0 9 0 437081393 635138048 1819 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1819 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=7272 CPUtime=3.09 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 203 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899200167184 5079714 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=168 CPUtime=2.99 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 226 0 0 0 294 5 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899191774480 5250287 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=624 CPUtime=3.09 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 186 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899183381776 5156224 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=78 CPUtime=3.09 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 216 0 0 0 306 3 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899174989072 5037858 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=73 CPUtime=3.09 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 267 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899166596368 5158020 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=78 CPUtime=3.09 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 274 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899158203664 5250287 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=161 CPUtime=3.09 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 109 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899149810960 5392078 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=2809127 CPUtime=3.09 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 207 0 0 0 309 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899141418256 5250272 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 24.67 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7276 KiB

[startup+12.0277 s]
/proc/loadavg: 1.58 3.54 6.44 9/202 9303
/proc/meminfo: memFree=30279940/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7276 CPUtime=95.92 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 6774 0 0 0 9559 33 0 0 20 0 9 0 437081393 635138048 1819 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1819 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=0 CPUtime=12.01 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 525 0 0 0 1201 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899200167184 5250450 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=-3253322038155611931 CPUtime=11.88 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 643 0 0 0 1174 14 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899191774480 5250461 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=-7035114785800479027 CPUtime=12.01 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 573 0 0 0 1201 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899183381776 5207504 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=1564 CPUtime=12.01 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 694 0 0 0 1198 3 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899174989072 5250293 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0

################
# More data... #
################

/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 772 0 0 0 2548 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899183381776 5158100 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=7276 CPUtime=25.45 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 903 0 0 0 2542 3 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899174989072 5250251 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=7276 CPUtime=25.37 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 781 0 0 0 2514 23 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899166596368 5250287 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=8556 CPUtime=25.45 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 940 0 0 0 2545 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899158203664 5156136 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=7276 CPUtime=25.45 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 713 0 0 0 2545 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899149810960 5157976 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7276 CPUtime=25.48 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 813 0 0 0 2548 0 0 0 20 0 9 0 437081394 635138048 1819 33554432000 4194304 6211092 140736426742544 139899141418256 5039038 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 203.23 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7276 KiB

[startup+51.1007 s]
/proc/loadavg: 5.70 4.40 6.58 9/200 9309
/proc/meminfo: memFree=31474552/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7284 CPUtime=407.71 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 10028 0 0 0 40719 52 0 0 20 0 9 0 437081393 635138048 1821 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1821 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=2900 CPUtime=51.07 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 926 0 0 0 5107 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899200167184 5193748 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=7284 CPUtime=50.31 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 1116 0 0 0 5006 25 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899191774480 5156224 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=7276 CPUtime=51.08 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 1036 0 0 0 5108 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899183381776 5250289 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=7276 CPUtime=51.05 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 1102 0 0 0 5102 3 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899174989072 5039185 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=7276 CPUtime=50.97 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 951 0 0 0 5074 23 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899166596368 5250463 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=7284 CPUtime=51.05 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 1107 0 0 0 5105 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899158203664 5380267 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=7284 CPUtime=51.06 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 877 0 0 0 5106 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899149810960 5250287 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7284 CPUtime=51.07 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 1000 0 0 0 5107 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899141418256 5193754 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 407.71 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7284 KiB

[startup+102.301 s]
/proc/loadavg: 7.00 4.96 6.66 9/200 9312
/proc/meminfo: memFree=31476184/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7284 CPUtime=816.69 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 10742 0 0 0 81616 53 0 0 20 0 9 0 437081393 635138048 1821 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1821 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=7284 CPUtime=102.26 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 985 0 0 0 10226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899200167184 5250287 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=7284 CPUtime=100.89 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 1197 0 0 0 10064 25 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899191774480 5250289 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=7284 CPUtime=102.28 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 1114 0 0 0 10228 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899183381776 5193744 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=7284 CPUtime=102.24 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 1209 0 0 0 10221 3 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899174989072 5157544 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=7284 CPUtime=102.17 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 1045 0 0 0 10194 23 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899166596368 5193744 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=0 CPUtime=102.25 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 1201 0 0 0 10225 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899158203664 5250287 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=7284 CPUtime=102.26 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 980 0 0 0 10226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899149810960 5157976 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7284 CPUtime=102.27 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 1098 0 0 0 10227 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899141418256 5039149 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 816.69 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7284 KiB

[startup+162.301 s]
/proc/loadavg: 7.70 5.53 6.75 9/200 9315
/proc/meminfo: memFree=31474592/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7284 CPUtime=1295.96 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 12808 0 0 0 129543 53 0 0 20 0 9 0 437081393 635138048 1821 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1821 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=7284 CPUtime=162.26 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 1205 0 0 0 16226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899200167184 5082367 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=3632 CPUtime=160.17 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 1486 0 0 0 15992 25 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899191774480 5193744 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=7284 CPUtime=162.27 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 1382 0 0 0 16227 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899183381776 5250307 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=0 CPUtime=162.24 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 1502 0 0 0 16221 3 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899174989072 5392078 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=7284 CPUtime=162.17 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 1264 0 0 0 16194 23 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899166596368 5396545 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=279329372773648 CPUtime=162.26 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 1439 0 0 0 16226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899158203664 5409453 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=6386616370352 CPUtime=162.26 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 1255 0 0 0 16226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899149810960 5155800 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7284 CPUtime=162.26 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 1362 0 0 0 16226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899141418256 5250241 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 1295.96 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7284 KiB

[startup+222.301 s]
/proc/loadavg: 7.89 5.98 6.82 9/200 9320
/proc/meminfo: memFree=31474804/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7284 CPUtime=1775.2 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 13505 0 0 0 177467 53 0 0 20 0 9 0 437081393 635138048 1821 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1821 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=7284 CPUtime=222.26 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 1283 0 0 0 22226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899200167184 5409461 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=7284 CPUtime=219.42 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 1589 0 0 0 21917 25 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899191774480 5079743 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=7284 CPUtime=222.27 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 1482 0 0 0 22227 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899183381776 5250272 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=7284 CPUtime=222.23 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 1613 0 0 0 22220 3 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899174989072 5155804 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=7284 CPUtime=222.17 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 1309 0 0 0 22194 23 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899166596368 5009258 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=7284 CPUtime=222.26 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 1528 0 0 0 22226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899158203664 5380197 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=7284 CPUtime=222.27 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 1347 0 0 0 22227 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899149810960 5158023 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7284 CPUtime=222.26 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 1441 0 0 0 22226 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899141418256 5037823 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 1775.2 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7284 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]
/proc/loadavg: 8.07 6.20 6.87 9/199 9320
/proc/meminfo: memFree=31474792/32770624 swapFree=66998864/67108860
[pid=9294] ppid=9291 vsize=620252 memory=7284 CPUtime=2012.44 cores=0-7
/proc/9294/stat : 9294 (cosoco) S 9291 9294 7626 0 -1 1077944320 14188 0 0 0 201191 53 0 0 20 0 9 0 437081393 635138048 1821 33554432000 4194304 6211092 140736426742544 140736426740800 139899223310071 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
/proc/9294/statm: 155063 1821 864 493 0 148368 0
[pid=9294/tid=9296] ppid=9291 vsize=620252 memory=3632 CPUtime=251.96 cores=0-7
/proc/9294/task/9296/stat : 9296 (cosoco) R 9291 9294 7626 0 -1 4202560 1361 0 0 0 25196 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899200167184 5158028 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9297] ppid=9291 vsize=620252 memory=29108 CPUtime=248.75 cores=0-7
/proc/9294/task/9297/stat : 9297 (cosoco) R 9291 9294 7626 0 -1 4202560 1684 0 0 0 24850 25 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899191774480 5250301 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9298] ppid=9291 vsize=620252 memory=7284 CPUtime=251.97 cores=0-7
/proc/9294/task/9298/stat : 9298 (cosoco) R 9291 9294 7626 0 -1 4202560 1587 0 0 0 25197 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899183381776 5035232 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9299] ppid=9291 vsize=620252 memory=1604 CPUtime=251.93 cores=0-7
/proc/9294/task/9299/stat : 9299 (cosoco) R 9291 9294 7626 0 -1 4202560 1693 0 0 0 25190 3 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899174989072 5158023 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9300] ppid=9291 vsize=620252 memory=1980 CPUtime=251.87 cores=0-7
/proc/9294/task/9300/stat : 9300 (cosoco) R 9291 9294 7626 0 -1 4202560 1363 0 0 0 25164 23 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899166596368 5035344 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9301] ppid=9291 vsize=620252 memory=7284 CPUtime=251.96 cores=0-7
/proc/9294/task/9301/stat : 9301 (cosoco) R 9291 9294 7626 0 -1 4202560 1621 0 0 0 25196 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899158203664 5039026 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9302] ppid=9291 vsize=620252 memory=3632 CPUtime=251.97 cores=0-7
/proc/9294/task/9302/stat : 9302 (cosoco) R 9291 9294 7626 0 -1 4202560 1423 0 0 0 25197 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899149810960 5250272 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
[pid=9294/tid=9303] ppid=9291 vsize=620252 memory=7284 CPUtime=251.96 cores=0-7
/proc/9294/task/9303/stat : 9303 (cosoco) R 9291 9294 7626 0 -1 4202560 1543 0 0 0 25196 0 0 0 20 0 9 0 437081394 635138048 1821 33554432000 4194304 6211092 140736426742544 139899141418256 5193754 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14168064 140736426746902 140736426746994 140736426746994 140736426749902 0
Current children cumulated CPU time: 2012.44 s
Current children cumulated vsize: 620252 KiB
Current children cumulated memory: 7284 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.014 s]
# the end of solver process 9294 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2012.02 s, system=0.533813 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.014
CPU time (s): 2012.55
CPU user time (s): 2012.02
CPU system time (s): 0.533813
CPU usage (%): 798.587
Max. virtual memory (cumulated for all children) (KiB): 620252
Max. memory (cumulated for all children) (KiB): 7284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2012.02
system time used= 0.533813
maximum resident set size= 7504
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14234
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 52
involuntary context switches= 18068


# summary of solver processes directly reported to runsolver:
#   pid: 9294
#   total CPU time (s): 2012.55
#   total CPU user time (s): 2012.02
#   total CPU system time (s): 0.533813

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.04057 second user time and 1.95773 second system time

The end

Launcher Data 

Begin job on node102 at 2019-09-16 06:30:54
IDJOB=4398701
IDBENCH=123062
IDSOLVER=2852
FILE ID=node102/4398701-1568608300
RUNJOBID= node102-1568597211-7653
PBS_JOBID= 21703406
Free space on /tmp= 58752 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/QuadraticAssignment/QuadraticAssignment-m1-s1/QuadraticAssignment-tai10a.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398701-1568608300/watcher-4398701-1568608300 -o /tmp/evaluation-result-4398701-1568608300/solver-4398701-1568608300 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node102-1568597211-7653 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4398701-1568608300.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b58690ea851c8aad9573a552336d280c
RANDOM SEED=480205647

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30282812 kB
MemAvailable:   31895168 kB
Buffers:          131012 kB
Cached:          1772020 kB
SwapCached:         7660 kB
Active:           378840 kB
Inactive:        1536956 kB
Active(anon):       8272 kB
Inactive(anon):    46564 kB
Active(file):     370568 kB
Inactive(file):  1490392 kB
Unevictable:      110384 kB
Mlocked:          110384 kB
SwapTotal:      67108860 kB
SwapFree:       66998864 kB
Dirty:           1080308 kB
Writeback:         77788 kB
AnonPages:        114884 kB
Mapped:            41588 kB
Shmem:             33456 kB
Slab:             163432 kB
SReclaimable:     134460 kB
SUnreclaim:        28972 kB
KernelStack:        3440 kB
PageTables:         5744 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     509424 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 59324 MiB
End job on node102 at 2019-09-16 06:35:06