Trace number 4398323

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)326 20125.6 2520.02

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-05-05-9.xml
MD5SUMb1b903d633c720775ef1eb29649a113f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark326
Best CPU time to get the best result obtained on this benchmark36.2839
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of constraints90
Number of domains7
Minimum domain size5
Maximum domain size426
Distribution of domain sizes[{"size":5,"count":50},{"size":426,"count":55}]
Minimum variable degree2
Maximum variable degree6
Distribution of variable degrees[{"degree":2,"count":30},{"degree":3,"count":50},{"degree":6,"count":25}]
Minimum constraint arity1
Maximum constraint arity7
Distribution of constraint arities[{"arity":1,"count":5},{"arity":2,"count":25},{"arity":3,"count":25},{"arity":5,"count":10},{"arity":7,"count":25}]
Number of extensional constraints25
Number of intensional constraints30
Distribution of constraint types[{"type":"extension","count":25},{"type":"intension","count":30},{"type":"allDifferent","count":5},{"type":"noOverlap","count":5},{"type":"element","count":25}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.10	c
0.00/0.10	c This is cosoco 2.00 --  
0.00/0.10	c
0.00/0.10	c command line: cosoco -model -nbcores=8 HOME/instance-4398323-1568597252.xml 
0.00/0.10	c enable optimization
0.00/0.10	c ========================================[ Problem Statistics ]===========================================
0.00/0.10	c |                                                                                                       
0.00/0.10	c |  Parse time        :         0.01 s 
0.00/0.10	c |
0.00/0.10	c |               Variables: 105
0.00/0.10	c |            Domain Sizes: 5..426
0.00/0.10	c |
0.00/0.10	c |             Constraints: 136
0.00/0.10	c |                   Arity: 1..7  -- Unary: 5  -- Binary: 75  -- Ternary: 25
0.00/0.10	c | 
0.00/0.10	c |                   Types: 
0.00/0.10	c |                          All Different: 5
0.00/0.10	c |                          Disjunctive: 50
0.00/0.10	c |                          Element Variable: 25
0.00/0.10	c |                          Extension: 25  (nb tuples: 5..5) -- (shared: 160)
0.00/0.10	c |                          Max constant: 1
0.00/0.10	c |                          Sum: 25
0.00/0.10	c |                          Unary: 5
0.00/0.10	c |                          
0.00/0.10	c |               Objective: Minimize Max constant
0.00/0.10	
0.00/0.10	c =========================================================================================================
0.00/0.10	c Parallel mode: Portfolio
0.00/0.10	c [pFactory][Group N°0] created (threads:8).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.10	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.10	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.10	c [pFactory][Group N°0] task 7 launched on thread 0.
0.00/0.10	c [pFactory][Group N°0] task 6 launched on thread 2.
0.00/0.10	c [pFactory][Group N°0] task 5 launched on thread 1.
0.00/0.10	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.10	c [pFactory][Group N°0] task 3 launched on thread 7.
0.00/0.10	c [pFactory][Group N°0] task 2 launched on thread 5.
0.00/0.10	c [pFactory][Group N°0] task 1 launched on thread 3.
0.00/0.10	c [pFactory][Group N°0] task 0 launched on thread 4.
0.00/0.10	o 425
0.67/0.17	o 422
0.67/0.19	o 403
1.53/0.27	o 402
1.53/0.30	o 396
2.33/0.32	o 379
2.33/0.35	o 377
2.33/0.36	o 373
3.11/0.42	o 369
3.90/0.60	o 368
6.96/0.96	o 367
8.62/1.14	o 366
10.95/1.41	o 360
11.75/1.54	o 359
20.53/2.61	o 358
30.92/4.00	o 355
42.09/5.40	o 353
56.54/7.17	o 352
72.52/9.16	o 351
75.64/9.59	o 350
93.22/11.76	o 349
94.02/11.86	o 346
146.73/18.44	o 345
149.93/18.86	o 344
153.12/19.20	o 340
157.93/19.87	o 335
530.93/66.59	o 334
534.12/66.99	o 333
587.63/73.66	o 332
947.84/118.76	o 331
2698.53/337.97	o 330
3520.37/440.89	o 328
5560.19/696.26	o 327
7104.55/889.71	o 326
20125.51/2520.02	
20125.51/2520.02	c *** INTERRUPTED ***
20125.51/2520.02	c call to solver        : 19
20125.51/2520.02	c
20125.51/2520.02	c restarts              : 841004      
20125.51/2520.02	c conflicts             : 4991041      (248 /sec)
20125.51/2520.02	c decisions             : 27021020     (1343 /sec)
20125.51/2520.02	c propagations          : 8341417987  (414470 /sec)
20125.51/2520.02	c root propagations     : 5116        
20125.51/2520.02	c filter calls          : 702587827      (34910 /sec)
20125.51/2520.02	c useless filter calls  : 474348492      (67 %)
20125.51/2520.02	c Memory used           : 605.97 MB
20125.51/2520.02	c Best bound time (wc)  : 889.705 s
20125.51/2520.02	c CPU time              : 20125.5 s
20125.51/2520.02	c real time             : 2520.01 s
20125.51/2520.02	
20125.51/2520.02	s SATISFIABLE
20125.51/2520.02	c Best value found: 326
20125.51/2520.02	
20125.51/2520.02	
20125.51/2520.02	v <instantiation type='solution' cost='326'>
20125.51/2520.02	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] e[0] e[1] e[2] e[3] e[4] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] </list>
20125.51/2520.02	v <values>90 87 17 59 36 14 93 56 32 99 44 40 59 97 45 49 81 67 50 30 53 74 76 25 91 322 324 326 320 326 14 112 208 225 286 0 14 127 186 225 4 54 105 183 281 0 49 164 231 290 0 53 130 206 235 14 286 112 208 225 0 127 14 225 186 105 183 281 4 54 164 0 231 49 290 235 53 206 130 0 0 2 3 4 1 0 2 1 4 3 3 4 0 1 2 1 3 0 2 4 4 1 3 2 0 </values>
20125.51/2520.02	v </instantiation>
20125.51/2520.02

Verifier Data 

OK	326

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15387 MiB free)
  memory of node 1: 16384 MiB (13413 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398323-1568597252/watcher-4398323-1568597252 -o /tmp/evaluation-result-4398323-1568597252/solver-4398323-1568597252 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node145-1568597210-21314 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398323-1568597252.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=21331, runsolver pid=21328
Current StackSize limit: 8192 KiB


[startup+0.100543 s]*
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29482376/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=624124 memory=13352 CPUtime=0.67 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 4035 0 0 0 66 1 0 0 20 0 9 0 435661674 639102976 3338 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 156031 3338 891 493 0 149336 0
[pid=21331/tid=21333] ppid=21328 vsize=624124 memory=1398722017469774279 CPUtime=0.08 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 261 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492502182928 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=624124 memory=4872558142750483522 CPUtime=0.08 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492493790224 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=624124 memory=139913782654592 CPUtime=0.07 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 7 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492485397520 5167462 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=624124 memory=0 CPUtime=0.08 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492477004816 5157976 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=624124 memory=0 CPUtime=0.08 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492468612224 5393989 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=624124 memory=0 CPUtime=0.08 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 252 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492460219408 5390056 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=624124 memory=-1 CPUtime=0.08 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492451826720 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=624124 memory=0 CPUtime=0.08 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 8 0 0 0 20 0 9 0 435661676 639102976 3338 33554432000 4194304 6211092 140735135403328 140492443434256 5397461 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 624124 KiB
Current children cumulated memory: 13352 KiB

[startup+0.210542 s]*
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29482376/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=622576 memory=13192 CPUtime=1.53 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 4035 0 0 0 152 1 0 0 20 0 9 0 435661674 637517824 3298 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155644 3298 891 493 0 148949 0
[pid=21331/tid=21333] ppid=21328 vsize=622576 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 261 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492502183184 5167507 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=622576 memory=9230 CPUtime=0.19 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492493790536 5389823 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=622576 memory=288370289934366336 CPUtime=0.17 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 17 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492485397520 5167521 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=622576 memory=-1 CPUtime=0.19 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492477004816 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=622576 memory=0 CPUtime=0.19 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492468612112 5167559 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=622576 memory=0 CPUtime=0.19 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 252 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492460219408 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=622576 memory=-1 CPUtime=0.19 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492451826720 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=622576 memory=0 CPUtime=0.19 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 19 0 0 0 20 0 9 0 435661676 637517824 3298 33554432000 4194304 6211092 140735135403328 140492443434256 5193696 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 1.53 s
Current children cumulated vsize: 622576 KiB
Current children cumulated memory: 13192 KiB

[startup+0.311537 s]*
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29482376/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=621028 memory=12992 CPUtime=2.33 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 4035 0 0 0 232 1 0 0 20 0 9 0 435661674 635932672 3248 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155257 3248 892 493 0 148562 0
[pid=21331/tid=21333] ppid=21328 vsize=621028 memory=1398722017469774279 CPUtime=0.29 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 261 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492502183184 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=621028 memory=4872558044660077418 CPUtime=0.29 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492493790480 5193699 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=621028 memory=0 CPUtime=0.26 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 26 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492485397776 5186228 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=621028 memory=6944656592455097440 CPUtime=0.29 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492477004816 5393984 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=621028 memory=6656426216303648864 CPUtime=0.29 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492468612424 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=621028 memory=0 CPUtime=0.29 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 252 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492460219408 5046873 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=621028 memory=0 CPUtime=0.29 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492451826720 5167518 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=621028 memory=0 CPUtime=0.29 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 29 0 0 0 20 0 9 0 435661676 635932672 3248 33554432000 4194304 6211092 140735135403328 140492443434256 5393970 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 2.33 s
Current children cumulated vsize: 621028 KiB
Current children cumulated memory: 12992 KiB

[startup+0.700543 s]
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29482376/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12732 CPUtime=5.36 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 4035 0 0 0 535 1 0 0 20 0 9 0 435661674 635404288 3183 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3183 892 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=6935054825532540783 CPUtime=0.67 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 261 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492502183184 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=1760 CPUtime=0.67 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492493790224 5167904 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=111636 CPUtime=0.62 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 62 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492485397776 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=804 CPUtime=0.67 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492477004816 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=4104 CPUtime=0.67 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492468612112 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=728 CPUtime=0.67 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 252 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492460219344 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=-7175204567652784766 CPUtime=0.67 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 250 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492451826720 5102842 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=3054156605268465310 CPUtime=0.67 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 251 0 0 0 67 0 0 0 20 0 9 0 435661676 635404288 3183 33554432000 4194304 6211092 140735135403328 140492443434256 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 5.36 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12732 KiB

[startup+1.50054 s]
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29481848/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12740 CPUtime=11.75 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 5501 0 0 0 1174 1 0 0 20 0 9 0 435661674 635404288 3185 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3185 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=4104 CPUtime=1.47 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 411 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492502182928 5167504 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=728 CPUtime=1.47 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 500 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492493790224 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=-7175204567652784766 CPUtime=1.41 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 431 0 0 0 141 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492485397632 5193703 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=0 CPUtime=1.47 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 519 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492477004816 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=6944656592455097440 CPUtime=1.47 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 423 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492468612112 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=7598811100138176585 CPUtime=1.47 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 425 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492460219064 5393970 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=15026 CPUtime=1.47 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 382 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492451826960 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=288230376154758126 CPUtime=1.47 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 390 0 0 0 147 0 0 0 20 0 9 0 435661676 635404288 3185 33554432000 4194304 6211092 140735135403328 140492443434112 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 11.75 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12740 KiB

[startup+3.10954 s]
/proc/loadavg: 0.92 1.01 1.30 9/200 21340
/proc/meminfo: memFree=29482096/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12752 CPUtime=24.59 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 6782 0 0 0 2458 1 0 0 20 0 9 0 435661674 635404288 3188 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3188 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=56 CPUtime=3.08 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 576 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492502183040 5207585 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=0 CPUtime=3.08 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 634 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492493790480 5193696 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=-7025452035940392864 CPUtime=3 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 620 0 0 0 300 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492485397632 5393961 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=164 CPUtime=3.08 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 746 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492477004816 5393984 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=0 CPUtime=3.08 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 537 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492468612112 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=3184097920075974017 CPUtime=3.08 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 610 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492460219064 5168192 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=3472328279047814369 CPUtime=3.07 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 514 0 0 0 307 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492451826960 5390112 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=77 CPUtime=3.08 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 525 0 0 0 308 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492443434112 5102806 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 24.59 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12752 KiB

[startup+6.30054 s]
/proc/loadavg: 1.49 1.12 1.34 9/200 21340
/proc/meminfo: memFree=29483088/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12752 CPUtime=50.08 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 8289 0 0 0 5007 1 0 0 20 0 9 0 435661674 635404288 3188 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3188 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=7893295687695687954 CPUtime=6.27 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 761 0 0 0 627 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492502183184 5168216 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=139918077621887 CPUtime=6.27 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 890 0 0 0 627 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492493790480 5167538 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=12740 CPUtime=6.15 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 802 0 0 0 615 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492485397632 5390511 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=288293289671795437 CPUtime=6.27 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 979 0 0 0 627 0 0 0 20 0 9 0 435661676 635404288 3188 33554432000 4194304 6211092 140735135403328 140492477004816 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0

################
# More data... #
################

/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5360 0 0 0 225114 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5186176 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=12800 CPUtime=2260.37 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6223 0 0 0 226036 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5167538 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=12800 CPUtime=2262.06 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6325 0 0 0 226206 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=12800 CPUtime=2261.57 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5213 0 0 0 226157 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5167888 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=12800 CPUtime=2261.94 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 5726 0 0 0 226194 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5393938 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=12800 CPUtime=2246.4 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 5887 0 0 0 224639 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 18067.2 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB

[startup+2322.3 s]
/proc/loadavg: 8.14 8.24 7.69 9/199 21574
/proc/meminfo: memFree=29485676/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12800 CPUtime=18546.4 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 49426 0 0 0 1854635 9 0 0 20 0 9 0 435661674 635404288 3200 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3200 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=12800 CPUtime=2321.71 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 5447 0 0 0 232168 3 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492502183040 5167888 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=12800 CPUtime=2321.92 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 6686 0 0 0 232192 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492493790480 5193696 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=12800 CPUtime=2311.14 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5452 0 0 0 231114 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5167504 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=12800 CPUtime=2320.35 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6305 0 0 0 232034 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5167529 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=12800 CPUtime=2322.06 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6445 0 0 0 232206 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5102758 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=12800 CPUtime=2321.57 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5271 0 0 0 232157 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=776 CPUtime=2321.94 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 5815 0 0 0 232194 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5158037 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=12800 CPUtime=2305.66 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 5985 0 0 0 230565 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5167901 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 18546.4 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB

[startup+2382.3 s]
/proc/loadavg: 8.05 8.19 7.71 9/199 21577
/proc/meminfo: memFree=29485800/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12800 CPUtime=19025.7 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 50151 0 0 0 1902557 9 0 0 20 0 9 0 435661674 635404288 3200 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3200 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=12800 CPUtime=2381.71 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 5544 0 0 0 238168 3 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492502183040 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=12800 CPUtime=2381.92 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 6791 0 0 0 238192 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492493790480 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=12800 CPUtime=2371.14 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5538 0 0 0 237114 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5157096 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=12800 CPUtime=2380.34 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6396 0 0 0 238033 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=12800 CPUtime=2382.05 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6520 0 0 0 238205 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=12800 CPUtime=2381.57 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5374 0 0 0 238157 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5393970 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=12800 CPUtime=2381.93 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 5929 0 0 0 238193 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=12800 CPUtime=2364.92 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 6039 0 0 0 236491 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5102776 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 19025.7 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB

[startup+2442.3 s]
/proc/loadavg: 8.22 8.21 7.74 9/199 21582
/proc/meminfo: memFree=29484764/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12800 CPUtime=19504.9 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 50907 0 0 0 1950478 9 0 0 20 0 9 0 435661674 635404288 3200 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3200 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=12800 CPUtime=2441.7 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 5626 0 0 0 244167 3 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492502183040 5156931 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=12800 CPUtime=2441.92 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 6918 0 0 0 244192 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492493790480 5167904 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=12800 CPUtime=2431.14 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5642 0 0 0 243114 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5393938 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=12800 CPUtime=2440.33 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6507 0 0 0 244032 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=12800 CPUtime=2442.03 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6621 0 0 0 244203 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5167888 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=12800 CPUtime=2441.56 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5456 0 0 0 244156 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5397375 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=6935054825532540783 CPUtime=2441.93 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 6026 0 0 0 244193 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=2832 CPUtime=2424.17 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 6091 0 0 0 242416 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 19504.9 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB

[startup+2502.3 s]
/proc/loadavg: 8.46 8.28 7.79 9/199 21585
/proc/meminfo: memFree=29484760/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12800 CPUtime=19984.1 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 51651 0 0 0 1998400 9 0 0 20 0 9 0 435661674 635404288 3200 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3200 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=12800 CPUtime=2501.69 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 5718 0 0 0 250166 3 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492502183040 5083000 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=12800 CPUtime=2501.9 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 7031 0 0 0 250190 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492493790480 5167507 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=12800 CPUtime=2491.14 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5709 0 0 0 249114 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=12800 CPUtime=2500.32 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6617 0 0 0 250031 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5102856 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=12800 CPUtime=2502.03 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6720 0 0 0 250203 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5102698 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=776 CPUtime=2501.56 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5511 0 0 0 250156 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=12800 CPUtime=2501.92 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 6116 0 0 0 250192 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5393938 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=3612 CPUtime=2483.44 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 6209 0 0 0 248343 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5167888 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 19984.1 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.61 8.32 7.82 9/199 21587
/proc/meminfo: memFree=29484484/32770624 swapFree=66958308/67108860
[pid=21331] ppid=21328 vsize=620512 memory=12800 CPUtime=20125.5 cores=0-7
/proc/21331/stat : 21331 (cosoco) S 21328 21331 21287 0 -1 1077944320 51675 0 0 0 2012542 9 0 0 20 0 9 0 435661674 635404288 3200 33554432000 4194304 6211092 140735135403328 140735135401584 140492525326071 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
/proc/21331/statm: 155128 3200 893 493 0 148433 0
[pid=21331/tid=21333] ppid=21328 vsize=620512 memory=1398722017469774279 CPUtime=2519.4 cores=0-7
/proc/21331/task/21333/stat : 21333 (cosoco) R 21328 21331 21287 0 -1 4202560 5718 0 0 0 251937 3 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492502183040 5193696 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21334] ppid=21328 vsize=620512 memory=14012 CPUtime=2519.59 cores=0-7
/proc/21331/task/21334/stat : 21334 (cosoco) R 21328 21331 21287 0 -1 4202560 7034 0 0 0 251959 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492493790480 5393920 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21335] ppid=21328 vsize=620512 memory=14080 CPUtime=2508.73 cores=0-7
/proc/21331/task/21335/stat : 21335 (cosoco) R 21328 21331 21287 0 -1 4202560 5709 0 0 0 250873 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492485397776 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21336] ppid=21328 vsize=620512 memory=24592 CPUtime=2518.03 cores=0-7
/proc/21331/task/21336/stat : 21336 (cosoco) R 21328 21331 21287 0 -1 4202560 6617 0 0 0 251802 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492477004816 5168219 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21337] ppid=21328 vsize=620512 memory=4872558044660077418 CPUtime=2519.74 cores=0-7
/proc/21331/task/21337/stat : 21337 (cosoco) R 21328 21331 21287 0 -1 4202560 6720 0 0 0 251974 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492468612016 5168192 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21338] ppid=21328 vsize=620512 memory=6935054825532540783 CPUtime=2519.27 cores=0-7
/proc/21331/task/21338/stat : 21338 (cosoco) R 21328 21331 21287 0 -1 4202560 5532 0 0 0 251927 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492460219256 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21339] ppid=21328 vsize=620512 memory=2020 CPUtime=2519.62 cores=0-7
/proc/21331/task/21339/stat : 21339 (cosoco) R 21328 21331 21287 0 -1 4202560 6116 0 0 0 251962 0 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492451826624 5393920 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
[pid=21331/tid=21340] ppid=21328 vsize=620512 memory=1432 CPUtime=2501.04 cores=0-7
/proc/21331/task/21340/stat : 21340 (cosoco) R 21328 21331 21287 0 -1 4202560 6209 0 0 0 250103 1 0 0 20 0 9 0 435661676 635404288 3200 33554432000 4194304 6211092 140735135403328 140492443434000 5168363 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36970496 140735135405073 140735135405165 140735135405165 140735135408078 0
Current children cumulated CPU time: 20125.5 s
Current children cumulated vsize: 620512 KiB
Current children cumulated memory: 12800 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 21331 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20125.5 s, system=0.096956 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.02
CPU time (s): 20125.6
CPU user time (s): 20125.5
CPU system time (s): 0.096956
CPU usage (%): 798.629
Max. virtual memory (cumulated for all children) (KiB): 624124
Max. memory (cumulated for all children) (KiB): 13352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20125.5
system time used= 0.096956
maximum resident set size= 13420
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51731
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 521
involuntary context switches= 169131


# summary of solver processes directly reported to runsolver:
#   pid: 21331
#   total CPU time (s): 20125.6
#   total CPU user time (s): 20125.5
#   total CPU system time (s): 0.096956

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.1797 second user time and 19.7987 second system time

The end

Launcher Data 

Begin job on node145 at 2019-09-16 03:26:50
IDJOB=4398323
IDBENCH=115842
IDSOLVER=2851
FILE ID=node145/4398323-1568597252
RUNJOBID= node145-1568597210-21314
PBS_JOBID= 21703405
Free space on /tmp= 59532 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-05-05-9.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398323-1568597252/watcher-4398323-1568597252 -o /tmp/evaluation-result-4398323-1568597252/solver-4398323-1568597252 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node145-1568597210-21314 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398323-1568597252.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b1b903d633c720775ef1eb29649a113f
RANDOM SEED=1516177478

node145.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29492616 kB
MemAvailable:   31851224 kB
Buffers:          160012 kB
Cached:          2490728 kB
SwapCached:        41084 kB
Active:          1266008 kB
Inactive:        1426920 kB
Active(anon):       6112 kB
Inactive(anon):    85480 kB
Active(file):    1259896 kB
Inactive(file):  1341440 kB
Unevictable:      110680 kB
Mlocked:          110680 kB
SwapTotal:      67108860 kB
SwapFree:       66958308 kB
Dirty:              2736 kB
Writeback:             0 kB
AnonPages:        112704 kB
Mapped:            46628 kB
Shmem:             40636 kB
Slab:             174892 kB
SReclaimable:     146212 kB
SUnreclaim:        28680 kB
KernelStack:        3408 kB
PageTables:         5164 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506256 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 59528 MiB
End job on node145 at 2019-09-16 04:08:50