Trace number 4409865

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)358 2012.64 252.022

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-05-05-8.xml
MD5SUM43b2ef46cc27b455a3f22cfd7dbefeca
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark353
Best CPU time to get the best result obtained on this benchmark27.4421
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of constraints90
Number of domains7
Minimum domain size5
Maximum domain size453
Distribution of domain sizes[{"size":5,"count":50},{"size":453,"count":55}]
Minimum variable degree2
Maximum variable degree6
Distribution of variable degrees[{"degree":2,"count":30},{"degree":3,"count":50},{"degree":6,"count":25}]
Minimum constraint arity1
Maximum constraint arity7
Distribution of constraint arities[{"arity":1,"count":5},{"arity":2,"count":25},{"arity":3,"count":25},{"arity":5,"count":10},{"arity":7,"count":25}]
Number of extensional constraints25
Number of intensional constraints30
Distribution of constraint types[{"type":"extension","count":25},{"type":"intension","count":30},{"type":"allDifferent","count":5},{"type":"noOverlap","count":5},{"type":"element","count":25}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.09	c
0.00/0.09	c This is cosoco 2.00 --  
0.00/0.09	c
0.00/0.09	c command line: cosoco -model -nbcores=8 HOME/instance-4409865-1569827459.xml 
0.00/0.09	c enable optimization
0.00/0.09	c ========================================[ Problem Statistics ]===========================================
0.00/0.09	c |                                                                                                       
0.00/0.09	c |  Parse time        :         0.01 s 
0.00/0.09	c |
0.00/0.09	c |               Variables: 105
0.00/0.09	c |            Domain Sizes: 5..453
0.00/0.09	c |
0.00/0.09	c |             Constraints: 136
0.00/0.09	c |                   Arity: 1..7  -- Unary: 5  -- Binary: 75  -- Ternary: 25
0.00/0.09	c | 
0.00/0.09	c |                   Types: 
0.00/0.09	c |                          All Different: 5
0.00/0.09	c |                          Disjunctive: 50
0.00/0.09	c |                          Element Variable: 25
0.00/0.09	c |                          Extension: 25  (nb tuples: 5..5) -- (shared: 160)
0.00/0.09	c |                          Max constant: 1
0.00/0.09	c |                          Sum: 25
0.00/0.09	c |                          Unary: 5
0.00/0.09	c |                          
0.00/0.09	c |               Objective: Minimize Max constant
0.00/0.09	
0.00/0.09	c =========================================================================================================
0.00/0.09	c Parallel mode: Portfolio
0.00/0.09	c [pFactory][Group N°0] created (threads:8).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.09	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.09	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.09	c [pFactory][Group N°0] task 7 launched on thread 5.
0.00/0.09	c [pFactory][Group N°0] task 6 launched on thread 2.
0.00/0.09	c [pFactory][Group N°0] task 5 launched on thread 0.
0.00/0.09	c [pFactory][Group N°0] task 4 launched on thread 1.
0.00/0.09	c [pFactory][Group N°0] task 3 launched on thread 3.
0.00/0.09	c [pFactory][Group N°0] task 2 launched on thread 6.
0.00/0.09	c [pFactory][Group N°0] task 1 launched on thread 4.
0.00/0.09	c [pFactory][Group N°0] task 0 launched on thread 7.
0.00/0.09	o 452
0.68/0.11	o 444
1.55/0.23	o 442
1.55/0.26	o 441
2.33/0.34	o 439
3.12/0.42	o 433
3.91/0.57	o 432
4.64/0.63	o 430
4.64/0.68	o 416
5.37/0.79	o 412
6.17/0.83	o 411
6.17/0.85	o 409
9.36/1.23	o 406
10.16/1.35	o 405
12.56/1.62	o 403
16.62/2.14	o 399
17.35/2.23	o 398
18.15/2.32	o 397
21.35/2.76	o 396
23.80/3.01	o 395
26.13/3.32	o 394
30.12/3.86	o 393
30.92/3.97	o 392
31.78/4.07	o 391
38.11/4.85	o 390
40.57/5.18	o 389
45.30/5.71	o 386
50.09/6.32	o 380
50.09/6.37	o 378
74.85/9.43	o 376
78.05/9.83	o 374
79.70/10.02	o 372
109.99/13.81	o 371
117.18/14.77	o 370
125.97/15.89	o 369
128.43/16.19	o 368
149.93/18.82	o 367
149.93/18.88	o 364
150.73/18.96	o 361
229.01/28.73	o 360
237.00/29.70	o 359
598.00/74.91	o 358
2012.53/252.02	
2012.53/252.02	c *** INTERRUPTED ***
2012.53/252.02	c call to solver        : 17
2012.53/252.02	c
2012.53/252.02	c restarts              : 52502       
2012.53/252.02	c conflicts             : 460241       (229 /sec)
2012.53/252.02	c decisions             : 1937701      (963 /sec)
2012.53/252.02	c propagations          : 765566501   (380386 /sec)
2012.53/252.02	c root propagations     : 5842        
2012.53/252.02	c filter calls          : 57799284       (28719 /sec)
2012.53/252.02	c useless filter calls  : 38286260       (66 %)
2012.53/252.02	c Memory used           : 606.10 MB
2012.53/252.02	c Best bound time (wc)  : 74.9098 s
2012.53/252.02	c CPU time              : 2012.61 s
2012.53/252.02	c real time             : 252.015 s
2012.53/252.02	
2012.53/252.02	s SATISFIABLE
2012.53/252.02	c Best value found: 358
2012.53/252.02	
2012.53/252.02	
2012.53/252.02	v <instantiation type='solution' cost='358'>
2012.53/252.02	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] e[0] e[1] e[2] e[3] e[4] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] </list>
2012.53/252.02	v <values>22 83 35 38 90 23 73 68 84 93 34 41 38 77 94 59 67 55 72 96 93 16 49 90 89 355 358 309 349 354 0 34 138 175 265 0 23 100 181 265 0 59 100 138 215 0 59 126 181 253 0 96 126 175 265 0 138 34 175 265 23 265 181 0 100 138 100 0 215 59 253 181 126 59 0 96 0 265 126 175 0 2 1 3 4 3 0 4 2 1 2 4 1 0 3 4 3 2 1 0 1 0 3 4 2 </values>
2012.53/252.02	v </instantiation>
2012.53/252.02

Verifier Data 

OK	358

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15401 MiB free)
  memory of node 1: 16384 MiB (15304 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409865-1569827459/watcher-4409865-1569827459 -o /tmp/evaluation-result-4409865-1569827459/solver-4409865-1569827459 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node116-1569816239-988 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4409865-1569827459.xml 

running on 8 cores: 0-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2551, runsolver pid=2548
Current StackSize limit: 8192 KiB


[startup+0.100187 s]*
/proc/loadavg: 8.67 8.36 7.88 9/200 2560
/proc/meminfo: memFree=31433828/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=623740 memory=14308 CPUtime=0.68 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 4200 0 0 0 68 0 0 0 20 0 9 0 558687461 638709760 3577 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155935 3577 864 493 0 149240 0
[pid=2551/tid=2553] ppid=2548 vsize=623740 memory=1398722017469774279 CPUtime=0.08 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458555767824 5393952 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=623740 memory=4342489072520795241 CPUtime=0.08 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 269 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458547375376 5168395 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=623740 memory=139853667034752 CPUtime=0.08 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458538982416 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=623740 memory=0 CPUtime=0.08 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458530589712 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=623740 memory=0 CPUtime=0.08 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458522197120 5394043 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=623740 memory=0 CPUtime=0.08 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 277 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458513804208 5167536 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=623740 memory=-1 CPUtime=0.08 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 8 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458505411712 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=623740 memory=0 CPUtime=0.07 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 7 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458497018896 140458562869727 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 623740 KiB
Current children cumulated memory: 14308 KiB

[startup+0.211184 s]*
/proc/loadavg: 8.67 8.36 7.88 9/200 2560
/proc/meminfo: memFree=31433828/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=623740 memory=14308 CPUtime=1.55 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 4200 0 0 0 155 0 0 0 20 0 9 0 558687461 638709760 3577 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155935 3577 864 493 0 149240 0
[pid=2551/tid=2553] ppid=2548 vsize=623740 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458555767824 5168251 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=623740 memory=9431 CPUtime=0.19 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 269 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458547375376 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=623740 memory=4122963448221460128 CPUtime=0.19 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458538982416 5167233 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=623740 memory=-1 CPUtime=0.19 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458530589712 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=623740 memory=0 CPUtime=0.19 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458522197120 5193742 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=623740 memory=0 CPUtime=0.19 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 277 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458513804208 5193740 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=623740 memory=-1 CPUtime=0.19 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 19 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458505411856 5167933 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=623740 memory=0 CPUtime=0.17 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 17 0 0 0 20 0 9 0 558687463 638709760 3577 33554432000 4194304 6211132 140732385874544 140458497018896 5393952 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 1.55 s
Current children cumulated vsize: 623740 KiB
Current children cumulated memory: 14308 KiB

[startup+0.310184 s]*
/proc/loadavg: 8.67 8.36 7.88 9/200 2560
/proc/meminfo: memFree=31433828/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=621676 memory=13184 CPUtime=2.33 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 4200 0 0 0 233 0 0 0 20 0 9 0 558687461 636596224 3296 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155419 3296 864 493 0 148724 0
[pid=2551/tid=2553] ppid=2548 vsize=621676 memory=1398722017469774279 CPUtime=0.29 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458555768080 5156370 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=621676 memory=4126316290023845779 CPUtime=0.29 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 269 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458547375376 5397248 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=621676 memory=0 CPUtime=0.29 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458538982728 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=621676 memory=6944656592455097440 CPUtime=0.29 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458530589712 5167602 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=621676 memory=6656426216303648864 CPUtime=0.29 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458522197120 5156963 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=621676 memory=0 CPUtime=0.29 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 277 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458513804240 5186216 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=621676 memory=0 CPUtime=0.29 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 29 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458505411712 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=621676 memory=0 CPUtime=0.26 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 26 0 0 0 20 0 9 0 558687463 636596224 3296 33554432000 4194304 6211132 140732385874544 140458497018896 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 2.33 s
Current children cumulated vsize: 621676 KiB
Current children cumulated memory: 13184 KiB

[startup+0.701184 s]
/proc/loadavg: 8.67 8.36 7.88 9/200 2560
/proc/meminfo: memFree=31433828/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12576 CPUtime=5.37 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 4200 0 0 0 537 0 0 0 20 0 9 0 558687461 635539456 3144 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3144 864 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=8392 CPUtime=0.67 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458555768080 5193740 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=14008 CPUtime=0.67 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 269 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458547375136 5186278 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=6508 CPUtime=0.67 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 268 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458538982728 5393997 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=14068 CPUtime=0.67 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458530589552 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=2120 CPUtime=0.67 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458522197024 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=496 CPUtime=0.67 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 277 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458513804304 5166878 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=1556 CPUtime=0.67 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 67 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458505411616 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=1804 CPUtime=0.62 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 267 0 0 0 62 0 0 0 20 0 9 0 558687463 635539456 3144 33554432000 4194304 6211132 140732385874544 140458497019008 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 5.37 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12576 KiB

[startup+1.50419 s]
/proc/loadavg: 8.67 8.36 7.88 9/200 2560
/proc/meminfo: memFree=31433704/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12580 CPUtime=11.79 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 5774 0 0 0 1178 1 0 0 20 0 9 0 558687461 635539456 3145 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3145 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=0 CPUtime=1.47 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 407 0 0 0 147 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458555767824 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=6656426216303648864 CPUtime=1.48 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 462 0 0 0 148 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458547375376 5393952 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=6655300316396806240 CPUtime=1.48 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 368 0 0 0 148 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458538982728 5166739 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=6537 CPUtime=1.47 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 491 0 0 0 147 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458530589824 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=279707061246624 CPUtime=1.47 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 423 0 0 0 147 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458522197008 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=288230617509003574 CPUtime=1.48 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 479 0 0 0 148 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458513804304 5166761 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=15818902244427829 CPUtime=1.47 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 676 0 0 0 147 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458505411600 5394002 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=6935659245870276672 CPUtime=1.41 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 418 0 0 0 141 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458497019152 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 11.79 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12580 KiB

[startup+3.11118 s]
/proc/loadavg: 8.61 8.35 7.89 9/200 2560
/proc/meminfo: memFree=31433704/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12580 CPUtime=24.61 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 7150 0 0 0 2460 1 0 0 20 0 9 0 558687461 635539456 3145 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3145 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=33 CPUtime=3.08 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 598 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458555767824 5167920 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=139857962002047 CPUtime=3.08 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 636 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458547375376 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=7013344222260849752 CPUtime=3.08 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 580 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458538982672 5102332 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=7597685182856913236 CPUtime=3.08 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 654 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458530589824 5167553 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=6537 CPUtime=3.08 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 570 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458522196928 5168248 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=279707061246624 CPUtime=3.08 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 678 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458513804560 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=288230617509003574 CPUtime=3.08 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 802 0 0 0 308 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458505411600 5389855 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=15818902244427829 CPUtime=2.99 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 582 0 0 0 299 0 0 0 20 0 9 0 558687463 635539456 3145 33554432000 4194304 6211132 140732385874544 140458497019152 5082617 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 24.61 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12580 KiB

[startup+6.30119 s]
/proc/loadavg: 8.61 8.35 7.89 9/200 2560
/proc/meminfo: memFree=31433548/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12588 CPUtime=50.09 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 9069 0 0 0 5008 1 0 0 20 0 9 0 558687461 635539456 3147 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3147 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=55 CPUtime=6.27 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 856 0 0 0 627 0 0 0 20 0 9 0 558687463 635539456 3147 33554432000 4194304 6211132 140732385874544 140458555768080 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=12580 CPUtime=6.27 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 889 0 0 0 627 0 0 0 20 0 9 0 558687463 635539456 3147 33554432000 4194304 6211132 140732385874544 140458547375376 5393997 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=139857962002047 CPUtime=6.27 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 873 0 0 0 627 0 0 0 20 0 9 0 558687463 635539456 3147 33554432000 4194304 6211132 140732385874544 140458538982072 5409485 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=2044 CPUtime=6.27 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 817 0 0 0 627 0 0 0 20 0 9 0 558687463 635539456 3147 33554432000 4194304 6211132 140732385874544 140458530589712 5168257 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0

################
# More data... #
################

/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 1396 0 0 0 2547 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458538982672 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=12608 CPUtime=25.48 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1249 0 0 0 2548 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458530589824 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=2208 CPUtime=25.47 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1213 0 0 0 2547 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458522197008 5393997 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=0 CPUtime=25.47 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 1412 0 0 0 2547 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458513803960 5393983 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=6360846566568 CPUtime=25.47 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 1521 0 0 0 2547 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458505411600 5167920 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=984 CPUtime=25.1 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1201 0 0 0 2510 0 0 0 20 0 9 0 558687463 635539456 3160 33554432000 4194304 6211132 140732385874544 140458497019008 5158025 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 203.47 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12640 KiB

[startup+51.1102 s]
/proc/loadavg: 8.29 8.30 7.89 9/200 2563
/proc/meminfo: memFree=31434024/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12644 CPUtime=407.97 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 13713 0 0 0 40795 2 0 0 20 0 9 0 558687461 635539456 3161 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3161 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=12644 CPUtime=51.06 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 1431 0 0 0 5106 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458555767760 5102815 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=5087 CPUtime=51.08 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 1512 0 0 0 5108 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458547375376 5167095 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=3612 CPUtime=51.07 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 1508 0 0 0 5107 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458538982672 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=279707061003264 CPUtime=51.08 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1330 0 0 0 5108 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458530589824 5167561 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=0 CPUtime=51.07 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1290 0 0 0 5107 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458522197008 5167960 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=279707060883872 CPUtime=51.07 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 1560 0 0 0 5107 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458513803960 5394002 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=55 CPUtime=51.08 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 1681 0 0 0 5108 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458505411600 5168248 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=2257 CPUtime=50.38 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1351 0 0 0 5038 0 0 0 20 0 9 0 558687463 635539456 3161 33554432000 4194304 6211132 140732385874544 140458497019008 5167579 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 407.97 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12644 KiB

[startup+102.301 s]
/proc/loadavg: 8.20 8.27 7.90 9/200 2566
/proc/meminfo: memFree=31434032/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12696 CPUtime=816.82 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 16374 0 0 0 81680 2 0 0 20 0 9 0 558687461 635539456 3174 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3174 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=164 CPUtime=102.25 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 1704 0 0 0 10225 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458555767760 5193731 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=984 CPUtime=102.27 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 1929 0 0 0 10227 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458547375376 5102734 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=2044 CPUtime=102.27 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 1884 0 0 0 10227 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458538982072 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=12696 CPUtime=102.28 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1610 0 0 0 10228 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458530589824 5168251 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=12696 CPUtime=102.26 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1622 0 0 0 10226 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458522197008 5102352 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=1368 CPUtime=102.25 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 1900 0 0 0 10225 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458513804560 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=1056 CPUtime=102.27 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 2045 0 0 0 10227 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458505411600 5167561 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=0 CPUtime=100.91 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1630 0 0 0 10091 0 0 0 20 0 9 0 558687463 635539456 3174 33554432000 4194304 6211132 140732385874544 140458497019008 5168251 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 816.82 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12696 KiB

[startup+162.301 s]
/proc/loadavg: 8.07 8.22 7.91 9/200 2569
/proc/meminfo: memFree=31435088/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12716 CPUtime=1296.04 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 17463 0 0 0 129602 2 0 0 20 0 9 0 558687461 635539456 3179 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3179 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=12696 CPUtime=162.25 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 1839 0 0 0 16225 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458555767760 5148987 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=2832 CPUtime=162.27 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 2066 0 0 0 16227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458547375376 5389864 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=12716 CPUtime=162.27 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 2033 0 0 0 16227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458538982072 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=14008 CPUtime=162.27 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1727 0 0 0 16227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458530589712 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=12716 CPUtime=162.26 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1770 0 0 0 16226 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458522197008 5393970 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=12716 CPUtime=162.25 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 2022 0 0 0 16225 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458513804152 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=12716 CPUtime=162.27 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 2202 0 0 0 16227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458505411600 5168251 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=12716 CPUtime=160.14 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1754 0 0 0 16014 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458497019008 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 1296.04 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12716 KiB

[startup+222.301 s]
/proc/loadavg: 8.03 8.18 7.91 9/200 2574
/proc/meminfo: memFree=31434816/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12716 CPUtime=1775.25 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 17494 0 0 0 177523 2 0 0 20 0 9 0 558687461 635539456 3179 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3179 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=12716 CPUtime=222.24 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 1843 0 0 0 22224 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458555767760 5168224 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=12716 CPUtime=222.26 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 2072 0 0 0 22226 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458547375376 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=12716 CPUtime=222.27 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 2036 0 0 0 22227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458538982072 5168251 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=12716 CPUtime=222.27 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1729 0 0 0 22227 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458530589712 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=12716 CPUtime=222.25 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1774 0 0 0 22225 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458522197120 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=12716 CPUtime=222.24 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 2027 0 0 0 22224 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458513804152 5193742 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=12716 CPUtime=222.28 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 2206 0 0 0 22228 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458505411600 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=12716 CPUtime=219.38 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1757 0 0 0 21938 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458497019008 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 1775.25 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12716 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]*
/proc/loadavg: 8.02 8.16 7.91 9/200 2574
/proc/meminfo: memFree=31434948/32770688 swapFree=67001808/67108860
[pid=2551] ppid=2548 vsize=620644 memory=12716 CPUtime=2012.53 cores=0-7
/proc/2551/stat : 2551 (cosoco) S 2548 2551 961 0 -1 1077944320 18310 0 0 0 201251 2 0 0 20 0 9 0 558687461 635539456 3179 33554432000 4194304 6211132 140732385874544 140732385872800 140458578910967 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
/proc/2551/statm: 155161 3179 865 493 0 148466 0
[pid=2551/tid=2553] ppid=2548 vsize=620644 memory=1398722017469774279 CPUtime=251.95 cores=0-7
/proc/2551/task/2553/stat : 2553 (cosoco) R 2548 2551 961 0 -1 4202560 1956 0 0 0 25195 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458555767760 5390181 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2554] ppid=2548 vsize=620644 memory=4126316290023845779 CPUtime=251.97 cores=0-7
/proc/2551/task/2554/stat : 2554 (cosoco) R 2548 2551 961 0 -1 4202560 2179 0 0 0 25197 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458547375376 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2555] ppid=2548 vsize=620644 memory=6276 CPUtime=251.97 cores=0-7
/proc/2551/task/2555/stat : 2555 (cosoco) R 2548 2551 961 0 -1 4202560 2141 0 0 0 25197 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458538982072 5389855 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2556] ppid=2548 vsize=620644 memory=780 CPUtime=251.98 cores=0-7
/proc/2551/task/2556/stat : 2556 (cosoco) R 2548 2551 961 0 -1 4202560 1821 0 0 0 25198 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458530589712 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2557] ppid=2548 vsize=620644 memory=3936 CPUtime=251.95 cores=0-7
/proc/2551/task/2557/stat : 2557 (cosoco) R 2548 2551 961 0 -1 4202560 1889 0 0 0 25195 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458522197120 5102898 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2558] ppid=2548 vsize=620644 memory=1088 CPUtime=251.95 cores=0-7
/proc/2551/task/2558/stat : 2558 (cosoco) R 2548 2551 961 0 -1 4202560 2143 0 0 0 25195 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458513804152 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2559] ppid=2548 vsize=620644 memory=2832 CPUtime=251.99 cores=0-7
/proc/2551/task/2559/stat : 2559 (cosoco) R 2548 2551 961 0 -1 4202560 2277 0 0 0 25199 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458505411600 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
[pid=2551/tid=2560] ppid=2548 vsize=620644 memory=1564 CPUtime=248.71 cores=0-7
/proc/2551/task/2560/stat : 2560 (cosoco) R 2548 2551 961 0 -1 4202560 1854 0 0 0 24871 0 0 0 20 0 9 0 558687463 635539456 3179 33554432000 4194304 6211132 140732385874544 140458497019008 5168395 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21819392 140732385883158 140732385883250 140732385883250 140732385886158 0
Current children cumulated CPU time: 2012.53 s
Current children cumulated vsize: 620644 KiB
Current children cumulated memory: 12716 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.022 s]
# the end of solver process 2551 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2012.61 s, system=0.027987 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.022
CPU time (s): 2012.64
CPU user time (s): 2012.61
CPU system time (s): 0.027987
CPU usage (%): 798.596
Max. virtual memory (cumulated for all children) (KiB): 623740
Max. memory (cumulated for all children) (KiB): 14308

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2012.61
system time used= 0.027987
maximum resident set size= 14912
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18362
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 418
involuntary context switches= 16822


# summary of solver processes directly reported to runsolver:
#   pid: 2551
#   total CPU time (s): 2012.64
#   total CPU user time (s): 2012.61
#   total CPU system time (s): 0.027987

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.0529 second user time and 2.23609 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-30 09:10:17
IDJOB=4409865
IDBENCH=115815
IDSOLVER=2878
FILE ID=node116/4409865-1569827459
RUNJOBID= node116-1569816239-988
PBS_JOBID= 21705903
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-05-05-8.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409865-1569827459/watcher-4409865-1569827459 -o /tmp/evaluation-result-4409865-1569827459/solver-4409865-1569827459 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node116-1569816239-988 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4409865-1569827459.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 43b2ef46cc27b455a3f22cfd7dbefeca
RANDOM SEED=1587648698

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        31443160 kB
MemAvailable:   31854552 kB
Buffers:          204932 kB
Cached:           526496 kB
SwapCached:         3336 kB
Active:           380632 kB
Inactive:         357532 kB
Active(anon):      24436 kB
Inactive(anon):    63244 kB
Active(file):     356196 kB
Inactive(file):   294288 kB
Unevictable:      109448 kB
Mlocked:          109448 kB
SwapTotal:      67108860 kB
SwapFree:       67001808 kB
Dirty:              2868 kB
Writeback:             0 kB
AnonPages:        120932 kB
Mapped:            26404 kB
Shmem:             72424 kB
Slab:             183240 kB
SReclaimable:     153488 kB
SUnreclaim:        29752 kB
KernelStack:        3728 kB
PageTables:         5504 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     539236 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     75776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 62028 MiB
End job on node116 at 2019-09-30 09:14:29