Trace number 4409586

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)301 20126.3 2520.02

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-05-05-0.xml
MD5SUMda64694dd3ca715594c36c32a8b555a8
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark300
Best CPU time to get the best result obtained on this benchmark25.2154
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of constraints90
Number of domains7
Minimum domain size5
Maximum domain size400
Distribution of domain sizes[{"size":5,"count":50},{"size":400,"count":55}]
Minimum variable degree2
Maximum variable degree6
Distribution of variable degrees[{"degree":2,"count":30},{"degree":3,"count":50},{"degree":6,"count":25}]
Minimum constraint arity1
Maximum constraint arity7
Distribution of constraint arities[{"arity":1,"count":5},{"arity":2,"count":25},{"arity":3,"count":25},{"arity":5,"count":10},{"arity":7,"count":25}]
Number of extensional constraints25
Number of intensional constraints30
Distribution of constraint types[{"type":"extension","count":25},{"type":"intension","count":30},{"type":"allDifferent","count":5},{"type":"noOverlap","count":5},{"type":"element","count":25}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.09	c
0.00/0.09	c This is cosoco 2.00 --  
0.00/0.09	c
0.00/0.09	c command line: cosoco -model -nbcores=8 HOME/instance-4409586-1569816984.xml 
0.00/0.09	c enable optimization
0.00/0.09	c ========================================[ Problem Statistics ]===========================================
0.00/0.09	c |                                                                                                       
0.00/0.09	c |  Parse time        :         0.01 s 
0.00/0.09	c |
0.00/0.09	c |               Variables: 105
0.00/0.09	c |            Domain Sizes: 5..400
0.00/0.09	c |
0.00/0.09	c |             Constraints: 136
0.00/0.09	c |                   Arity: 1..7  -- Unary: 5  -- Binary: 75  -- Ternary: 25
0.00/0.09	c | 
0.00/0.09	c |                   Types: 
0.00/0.09	c |                          All Different: 5
0.00/0.09	c |                          Disjunctive: 50
0.00/0.09	c |                          Element Variable: 25
0.00/0.09	c |                          Extension: 25  (nb tuples: 5..5) -- (shared: 160)
0.00/0.09	c |                          Max constant: 1
0.00/0.09	c |                          Sum: 25
0.00/0.09	c |                          Unary: 5
0.00/0.09	c |                          
0.00/0.09	c |               Objective: Minimize Max constant
0.00/0.09	
0.00/0.09	c =========================================================================================================
0.00/0.09	c Parallel mode: Portfolio
0.00/0.09	c [pFactory][Group N°0] created (threads:8).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.09	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.09	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.09	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.09	c [pFactory][Group N°0] task 7 launched on thread 1.
0.00/0.09	c [pFactory][Group N°0] task 6 launched on thread 0.
0.00/0.09	c [pFactory][Group N°0] task 5 launched on thread 2.
0.00/0.09	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.09	c [pFactory][Group N°0] task 3 launched on thread 7.
0.00/0.09	c [pFactory][Group N°0] task 2 launched on thread 5.
0.00/0.09	c [pFactory][Group N°0] task 1 launched on thread 3.
0.00/0.09	c [pFactory][Group N°0] task 0 launched on thread 4.
0.00/0.09	o 398
0.00/0.10	o 397
0.70/0.11	o 395
0.70/0.13	o 389
0.70/0.14	o 380
0.70/0.18	o 379
2.35/0.38	o 378
3.14/0.47	o 372
3.93/0.51	o 356
3.93/0.53	o 346
3.93/0.58	o 340
4.66/0.69	o 338
5.39/0.76	o 337
7.85/1.03	o 334
10.17/1.30	o 332
13.37/1.77	o 331
15.83/2.10	o 330
16.63/2.11	o 328
20.56/2.66	o 326
26.94/3.41	o 320
28.54/3.65	o 316
36.53/4.66	o 312
42.12/5.35	o 311
77.27/9.78	o 305
344.87/43.21	o 303
664.35/83.29	o 302
3006.02/376.47	o 301
20126.25/2520.01	
20126.25/2520.01	c *** INTERRUPTED ***
20126.25/2520.01	c call to solver        : 11
20126.25/2520.01	c
20126.25/2520.01	c restarts              : 630516      
20126.25/2520.01	c conflicts             : 8404152      (418 /sec)
20126.25/2520.01	c decisions             : 29654559     (1473 /sec)
20126.25/2520.01	c propagations          : 9246360788  (459417 /sec)
20126.25/2520.01	c root propagations     : 3445        
20126.25/2520.01	c filter calls          : 861081009      (42784 /sec)
20126.25/2520.01	c useless filter calls  : 586231587      (68 %)
20126.25/2520.01	c Memory used           : 605.84 MB
20126.25/2520.01	c Best bound time (wc)  : 376.468 s
20126.25/2520.01	c CPU time              : 20126.3 s
20126.25/2520.01	c real time             : 2520.01 s
20126.25/2520.01	
20126.25/2520.01	s SATISFIABLE
20126.25/2520.01	c Best value found: 301
20126.25/2520.01	
20126.25/2520.01	
20126.25/2520.01	v <instantiation type='solution' cost='301'>
20126.25/2520.01	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] e[0] e[1] e[2] e[3] e[4] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] </list>
20126.25/2520.02	v <values>44 31 66 64 85 7 68 14 69 18 1 70 74 90 60 54 76 98 13 45 10 15 91 45 80 301 276 301 301 295 0 44 76 151 216 0 75 158 187 258 0 1 73 151 241 9 67 143 243 256 0 20 50 142 215 151 76 44 216 0 0 187 75 158 258 73 1 241 0 151 9 256 143 67 243 215 142 0 20 50 4 2 1 0 3 0 2 3 1 4 3 1 0 4 2 0 3 2 4 1 2 3 4 1 0 </values>
20126.25/2520.02	v </instantiation>
20126.25/2520.02

Verifier Data 

OK	301

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15271 MiB free)
  memory of node 1: 16384 MiB (15599 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409586-1569816984/watcher-4409586-1569816984 -o /tmp/evaluation-result-4409586-1569816984/solver-4409586-1569816984 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node106-1569813297-28257 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409586-1569816984.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28274, runsolver pid=28271
Current StackSize limit: 8192 KiB


[startup+0.10048 s]*
/proc/loadavg: 1.09 1.12 1.50 9/198 28283
/proc/meminfo: memFree=31604020/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=622200 memory=11164 CPUtime=0.7 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 3174 0 0 0 70 0 0 0 20 0 9 0 557952048 637132800 2791 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155550 2791 900 493 0 148855 0
[pid=28274/tid=28276] ppid=28271 vsize=622200 memory=576460756329955530 CPUtime=0.08 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046343523344 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 153 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046335130640 5046864 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=622200 memory=288370424536123008 CPUtime=0.08 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046326737936 5166864 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046318345232 5166910 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046309952528 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=622200 memory=0 CPUtime=0.07 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 7 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046301559824 5149706 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=622200 memory=-1 CPUtime=0.08 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 143 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046293167376 5409396 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 8 0 0 0 20 0 9 0 557952050 637132800 2791 33554432000 4194304 6211132 140721281634304 140046284774024 5167539 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 622200 KiB
Current children cumulated memory: 11164 KiB

[startup+0.210481 s]*
/proc/loadavg: 1.64 1.23 1.53 10/198 28283
/proc/meminfo: memFree=31604020/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620900 memory=10524 CPUtime=1.57 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 3174 0 0 0 157 0 0 0 20 0 9 0 557952048 635801600 2631 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155225 2631 901 493 0 148530 0
[pid=28274/tid=28276] ppid=28271 vsize=620900 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046343523344 5167550 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620900 memory=2670123 CPUtime=0.19 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 153 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046335130752 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620900 memory=140048384438141 CPUtime=0.19 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046326738192 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620900 memory=-1 CPUtime=0.19 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046318345248 5168368 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620900 memory=0 CPUtime=0.19 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046309952840 5167920 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620900 memory=0 CPUtime=0.17 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 17 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046301559824 5155920 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620900 memory=-1 CPUtime=0.19 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 143 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046293167136 5167081 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620900 memory=0 CPUtime=0.19 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 19 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046284774416 5167924 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 1.57 s
Current children cumulated vsize: 620900 KiB
Current children cumulated memory: 10524 KiB

[startup+0.30948 s]*
/proc/loadavg: 1.64 1.23 1.53 9/198 28283
/proc/meminfo: memFree=31604020/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620900 memory=10524 CPUtime=2.35 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 3174 0 0 0 235 0 0 0 20 0 9 0 557952048 635801600 2631 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155225 2631 901 493 0 148530 0
[pid=28274/tid=28276] ppid=28271 vsize=620900 memory=8317482817917895235 CPUtime=0.29 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046343523344 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620900 memory=0 CPUtime=0.29 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 153 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046335130752 5148711 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620900 memory=0 CPUtime=0.29 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046326738192 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620900 memory=6944656592455359580 CPUtime=0.29 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046318345248 5102734 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620900 memory=0 CPUtime=0.29 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046309952528 5186231 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620900 memory=0 CPUtime=0.26 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 26 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046301559824 5168401 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620900 memory=0 CPUtime=0.29 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 143 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046293167136 5168251 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620900 memory=0 CPUtime=0.29 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 29 0 0 0 20 0 9 0 557952050 635801600 2631 33554432000 4194304 6211132 140721281634304 140046284774416 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 2.35 s
Current children cumulated vsize: 620900 KiB
Current children cumulated memory: 10524 KiB

[startup+0.700479 s]
/proc/loadavg: 1.64 1.23 1.53 9/198 28283
/proc/meminfo: memFree=31603648/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10272 CPUtime=5.39 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 3178 0 0 0 539 0 0 0 20 0 9 0 557952048 635269120 2568 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2568 901 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=9588 CPUtime=0.67 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046343523600 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=1548 CPUtime=0.67 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 155 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046335130896 5167561 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=628 CPUtime=0.67 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046326738192 5157392 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=1056 CPUtime=0.67 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 148 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046318345248 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=1724 CPUtime=0.67 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046309952640 5393952 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=500 CPUtime=0.63 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 63 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046301559824 5186290 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=928 CPUtime=0.67 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 145 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046293167376 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=1728 CPUtime=0.67 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 147 0 0 0 67 0 0 0 20 0 9 0 557952050 635269120 2568 33554432000 4194304 6211132 140721281634304 140046284774432 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 5.39 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10272 KiB

[startup+1.50048 s]
/proc/loadavg: 1.64 1.23 1.53 9/198 28283
/proc/meminfo: memFree=31603648/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10304 CPUtime=11.77 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 4546 0 0 0 1177 0 0 0 20 0 9 0 557952048 635269120 2576 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2576 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=2670038 CPUtime=1.47 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 301 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046343523600 5393952 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=2671448 CPUtime=1.47 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 318 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046335130296 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=0 CPUtime=1.47 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 279 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046326738192 5168251 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=8243114992657236051 CPUtime=1.47 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 333 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046318345488 5390520 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=288284493629096805 CPUtime=1.47 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 304 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046309952640 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=7668332116360981073 CPUtime=1.41 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 389 0 0 0 141 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046301559824 5167582 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=280096561100256 CPUtime=1.47 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 357 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046293167136 5393983 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=3540031169472369929 CPUtime=1.47 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 271 0 0 0 147 0 0 0 20 0 9 0 557952050 635269120 2576 33554432000 4194304 6211132 140721281634304 140046284774528 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 11.77 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10304 KiB

[startup+3.10948 s]
/proc/loadavg: 1.64 1.23 1.53 9/198 28283
/proc/meminfo: memFree=31604108/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10308 CPUtime=24.62 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 5697 0 0 0 2462 0 0 0 20 0 9 0 557952048 635269120 2577 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2577 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=10304 CPUtime=3.08 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 408 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046343523600 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=2832 CPUtime=3.08 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 478 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046335130296 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10304 CPUtime=3.08 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 412 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046326738192 5167295 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=2670038 CPUtime=3.08 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 530 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046318345488 5167561 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=2671448 CPUtime=3.08 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 413 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046309952640 5102695 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=280 CPUtime=3 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 527 0 0 0 300 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046301559824 5394002 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=287 CPUtime=3.08 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 500 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046293167376 5389476 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=287 CPUtime=3.08 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 435 0 0 0 308 0 0 0 20 0 9 0 557952050 635269120 2577 33554432000 4194304 6211132 140721281634304 140046284774416 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 24.62 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10308 KiB

[startup+6.30048 s]
/proc/loadavg: 2.15 1.34 1.57 9/198 28283
/proc/meminfo: memFree=31604204/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10344 CPUtime=50.11 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 7270 0 0 0 5010 1 0 0 20 0 9 0 557952048 635269120 2586 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2586 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=140052679378559 CPUtime=6.27 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 624 0 0 0 627 0 0 0 20 0 9 0 557952050 635269120 2586 33554432000 4194304 6211132 140721281634304 140046343523456 5167943 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=56 CPUtime=6.27 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 696 0 0 0 627 0 0 0 20 0 9 0 557952050 635269120 2586 33554432000 4194304 6211132 140721281634304 140046335130296 5186331 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10308 CPUtime=6.27 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 596 0 0 0 627 0 0 0 20 0 9 0 557952050 635269120 2586 33554432000 4194304 6211132 140721281634304 140046326738192 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=0 CPUtime=6.27 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 700 0 0 0 627 0 0 0 20 0 9 0 557952050 635269120 2586 33554432000 4194304 6211132 140721281634304 140046318345136 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0

################
# More data... #
################

/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 6843 0 0 0 226202 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=10492 CPUtime=2262.04 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7322 0 0 0 226204 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=10492 CPUtime=2261.66 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7450 0 0 0 226165 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5393997 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=10492 CPUtime=2246.45 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7298 0 0 0 224645 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=10492 CPUtime=2261.99 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7545 0 0 0 226199 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5394033 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=1128 CPUtime=2261.98 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6326 0 0 0 226198 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5186260 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 18068 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB

[startup+2322.3 s]
/proc/loadavg: 8.06 8.22 7.69 9/200 28461
/proc/meminfo: memFree=31602164/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10492 CPUtime=18547.2 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 59191 0 0 0 1854717 5 0 0 20 0 9 0 557952048 635269120 2623 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2623 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=10492 CPUtime=2322.02 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 7613 0 0 0 232202 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046343523344 5193765 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=10492 CPUtime=2309.26 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 6260 0 0 0 230926 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046335130312 5393952 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10492 CPUtime=2322.01 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 6950 0 0 0 232201 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5186271 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=10492 CPUtime=2322.03 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7401 0 0 0 232203 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5193742 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=10492 CPUtime=2321.65 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7530 0 0 0 232164 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=10492 CPUtime=2306.22 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7389 0 0 0 230622 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5149964 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=10492 CPUtime=2321.98 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7633 0 0 0 232198 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5166878 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=10492 CPUtime=2321.97 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6421 0 0 0 232197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5102871 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 18547.2 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB

[startup+2382.3 s]
/proc/loadavg: 8.06 8.20 7.71 9/199 28464
/proc/meminfo: memFree=31601876/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10492 CPUtime=19026.4 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 59879 0 0 0 1902637 5 0 0 20 0 9 0 557952048 635269120 2623 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2623 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=10492 CPUtime=2382 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 7704 0 0 0 238200 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046343523344 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=10492 CPUtime=2368.88 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 6353 0 0 0 236888 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046335130312 5158055 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10492 CPUtime=2382 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 7063 0 0 0 238200 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5168224 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=10492 CPUtime=2382.02 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7478 0 0 0 238202 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5394016 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=10492 CPUtime=2381.64 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7607 0 0 0 238163 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5394016 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=10492 CPUtime=2365.85 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7469 0 0 0 236585 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5394002 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=6629 CPUtime=2381.97 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7705 0 0 0 238197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=10492 CPUtime=2381.97 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6506 0 0 0 238197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 19026.4 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB

[startup+2442.3 s]
/proc/loadavg: 8.25 8.24 7.75 9/198 28468
/proc/meminfo: memFree=31601432/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10492 CPUtime=19505.6 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 60565 0 0 0 1950557 5 0 0 20 0 9 0 557952048 635269120 2623 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2623 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=10492 CPUtime=2441.98 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 7779 0 0 0 244198 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046343523344 5157957 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=10492 CPUtime=2428.26 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 6448 0 0 0 242826 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046335130312 5393952 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10492 CPUtime=2442 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 7174 0 0 0 244200 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5167591 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=10492 CPUtime=2442.01 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7555 0 0 0 244201 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=772 CPUtime=2441.63 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7680 0 0 0 244162 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5168257 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=10492 CPUtime=2425.71 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7565 0 0 0 242571 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=10492 CPUtime=2441.96 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7798 0 0 0 244196 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=1911427 CPUtime=2441.97 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6572 0 0 0 244197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 19505.6 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB

[startup+2502.3 s]
/proc/loadavg: 8.26 8.25 7.79 9/199 28473
/proc/meminfo: memFree=31601304/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10492 CPUtime=19984.8 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 61249 0 0 0 1998476 5 0 0 20 0 9 0 557952048 635269120 2623 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2623 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=10492 CPUtime=2501.97 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 7860 0 0 0 250197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046343523344 5082224 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=10492 CPUtime=2488.25 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 6569 0 0 0 248825 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046335130312 5389855 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=10492 CPUtime=2501.99 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 7261 0 0 0 250199 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5102842 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=10492 CPUtime=2502.01 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7631 0 0 0 250201 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5167553 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=10492 CPUtime=2501.61 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7764 0 0 0 250160 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=10492 CPUtime=2484.97 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7639 0 0 0 248497 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=10492 CPUtime=2501.96 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7891 0 0 0 250196 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5166868 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=10492 CPUtime=2501.97 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6640 0 0 0 250197 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5393997 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 19984.8 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.20 8.24 7.79 9/198 28473
/proc/meminfo: memFree=31601940/32770624 swapFree=67000008/67108860
[pid=28274] ppid=28271 vsize=620380 memory=10492 CPUtime=20126.2 cores=0-7
/proc/28274/stat : 28274 (cosoco) S 28271 28274 28230 0 -1 1077944320 61256 0 0 0 2012620 5 0 0 20 0 9 0 557952048 635269120 2623 33554432000 4194304 6211132 140721281634304 140721281632560 140046366666487 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
/proc/28274/statm: 155095 2623 902 493 0 148400 0
[pid=28274/tid=28276] ppid=28271 vsize=620380 memory=8317482817917895235 CPUtime=2519.67 cores=0-7
/proc/28274/task/28276/stat : 28276 (cosoco) R 28271 28274 28230 0 -1 4202560 7866 0 0 0 251967 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046343523344 5168368 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28277] ppid=28271 vsize=620380 memory=1056 CPUtime=2505.96 cores=0-7
/proc/28274/task/28277/stat : 28277 (cosoco) R 28271 28274 28230 0 -1 4202560 6569 0 0 0 250596 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046335130312 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28278] ppid=28271 vsize=620380 memory=1724 CPUtime=2519.7 cores=0-7
/proc/28274/task/28278/stat : 28278 (cosoco) R 28271 28274 28230 0 -1 4202560 7261 0 0 0 251970 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046326738192 5186301 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28279] ppid=28271 vsize=620380 memory=14012 CPUtime=2519.71 cores=0-7
/proc/28274/task/28279/stat : 28279 (cosoco) R 28271 28274 28230 0 -1 4202560 7631 0 0 0 251971 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046318345152 5390144 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28280] ppid=28271 vsize=620380 memory=2116 CPUtime=2519.32 cores=0-7
/proc/28274/task/28280/stat : 28280 (cosoco) R 28271 28274 28230 0 -1 4202560 7764 0 0 0 251931 1 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046309952528 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28281] ppid=28271 vsize=620380 memory=6528 CPUtime=2502.45 cores=0-7
/proc/28274/task/28281/stat : 28281 (cosoco) R 28271 28274 28230 0 -1 4202560 7639 0 0 0 250245 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046301559824 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28282] ppid=28271 vsize=620380 memory=12024 CPUtime=2519.66 cores=0-7
/proc/28274/task/28282/stat : 28282 (cosoco) R 28271 28274 28230 0 -1 4202560 7892 0 0 0 251966 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046293166872 5166943 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
[pid=28274/tid=28283] ppid=28271 vsize=620380 memory=1556 CPUtime=2519.67 cores=0-7
/proc/28274/task/28283/stat : 28283 (cosoco) R 28271 28274 28230 0 -1 4202560 6640 0 0 0 251967 0 0 0 20 0 9 0 557952050 635269120 2623 33554432000 4194304 6211132 140721281634304 140046284774416 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36282368 140721281639441 140721281639533 140721281639533 140721281642446 0
Current children cumulated CPU time: 20126.2 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10492 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 28274 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20126.3 s, system=0.060971 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.02
CPU time (s): 20126.3
CPU user time (s): 20126.3
CPU system time (s): 0.060971
CPU usage (%): 798.658
Max. virtual memory (cumulated for all children) (KiB): 622200
Max. memory (cumulated for all children) (KiB): 11164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20126.3
system time used= 0.060971
maximum resident set size= 11296
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 61306
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 315
involuntary context switches= 152447


# summary of solver processes directly reported to runsolver:
#   pid: 28274
#   total CPU time (s): 20126.3
#   total CPU user time (s): 20126.3
#   total CPU system time (s): 0.060971

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.2229 second user time and 19.2262 second system time

The end

Launcher Data 

Begin job on node106 at 2019-09-30 05:14:57
IDJOB=4409586
IDBENCH=115827
IDSOLVER=2877
FILE ID=node106/4409586-1569816984
RUNJOBID= node106-1569813297-28257
PBS_JOBID= 21705910
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-05-05-0.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409586-1569816984/watcher-4409586-1569816984 -o /tmp/evaluation-result-4409586-1569816984/solver-4409586-1569816984 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node106-1569813297-28257 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409586-1569816984.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= da64694dd3ca715594c36c32a8b555a8
RANDOM SEED=872230748

node106.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31611740 kB
MemAvailable:   31868564 kB
Buffers:          176652 kB
Cached:           404708 kB
SwapCached:         4560 kB
Active:           271244 kB
Inactive:         318092 kB
Active(anon):      18220 kB
Inactive(anon):    66876 kB
Active(file):     253024 kB
Inactive(file):   251216 kB
Unevictable:      109332 kB
Mlocked:          109332 kB
SwapTotal:      67108860 kB
SwapFree:       67000008 kB
Dirty:              2608 kB
Writeback:             0 kB
AnonPages:        112752 kB
Mapped:            26004 kB
Shmem:             68520 kB
Slab:             165448 kB
SReclaimable:     136840 kB
SUnreclaim:        28608 kB
KernelStack:        3264 kB
PageTables:         5428 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     530224 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 62028 MiB
End job on node106 at 2019-09-30 05:56:57