Trace number 4409566

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)329 20125.4 2520.02

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-05-05-4.xml
MD5SUMa08c622730be04b0ce65f9055d76b754
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark326
Best CPU time to get the best result obtained on this benchmark26.2689
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of constraints90
Number of domains7
Minimum domain size5
Maximum domain size429
Distribution of domain sizes[{"size":5,"count":50},{"size":429,"count":55}]
Minimum variable degree2
Maximum variable degree6
Distribution of variable degrees[{"degree":2,"count":30},{"degree":3,"count":50},{"degree":6,"count":25}]
Minimum constraint arity1
Maximum constraint arity7
Distribution of constraint arities[{"arity":1,"count":5},{"arity":2,"count":25},{"arity":3,"count":25},{"arity":5,"count":10},{"arity":7,"count":25}]
Number of extensional constraints25
Number of intensional constraints30
Distribution of constraint types[{"type":"extension","count":25},{"type":"intension","count":30},{"type":"allDifferent","count":5},{"type":"noOverlap","count":5},{"type":"element","count":25}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.05	c
0.00/0.05	c This is cosoco 2.00 --  
0.00/0.05	c
0.00/0.05	c command line: cosoco -model -nbcores=8 HOME/instance-4409566-1569816725.xml 
0.00/0.05	c enable optimization
0.00/0.05	c ========================================[ Problem Statistics ]===========================================
0.00/0.05	c |                                                                                                       
0.00/0.05	c |  Parse time        :         0.01 s 
0.00/0.05	c |
0.00/0.05	c |               Variables: 105
0.00/0.05	c |            Domain Sizes: 5..429
0.00/0.05	c |
0.00/0.05	c |             Constraints: 136
0.00/0.05	c |                   Arity: 1..7  -- Unary: 5  -- Binary: 75  -- Ternary: 25
0.00/0.05	c | 
0.00/0.05	c |                   Types: 
0.00/0.05	c |                          All Different: 5
0.00/0.05	c |                          Disjunctive: 50
0.00/0.05	c |                          Element Variable: 25
0.00/0.05	c |                          Extension: 25  (nb tuples: 5..5) -- (shared: 160)
0.00/0.05	c |                          Max constant: 1
0.00/0.05	c |                          Sum: 25
0.00/0.05	c |                          Unary: 5
0.00/0.05	c |                          
0.00/0.05	c |               Objective: Minimize Max constant
0.00/0.05	
0.00/0.05	c =========================================================================================================
0.00/0.05	c Parallel mode: Portfolio
0.00/0.05	c [pFactory][Group N°0] created (threads:8).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.05	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.05	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.05	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.05	c [pFactory][Group N°0] task 7 launched on thread 4.
0.00/0.05	c [pFactory][Group N°0] task 6 launched on thread 0.
0.00/0.05	c [pFactory][Group N°0] task 5 launched on thread 1.
0.00/0.05	c [pFactory][Group N°0] task 4 launched on thread 2.
0.00/0.05	c [pFactory][Group N°0] task 3 launched on thread 7.
0.00/0.05	c [pFactory][Group N°0] task 2 launched on thread 3.
0.00/0.05	c [pFactory][Group N°0] task 1 launched on thread 5.
0.00/0.05	c [pFactory][Group N°0] task 0 launched on thread 6.
0.00/0.05	o 415
0.00/0.10	o 414
0.69/0.16	o 407
0.69/0.17	o 405
0.69/0.21	o 404
1.56/0.30	o 403
2.34/0.37	o 399
3.13/0.46	o 397
3.92/0.56	o 388
5.38/0.70	o 387
5.38/0.72	o 385
5.38/0.75	o 379
5.38/0.79	o 365
6.98/0.99	o 364
10.16/1.40	o 363
11.76/1.60	o 361
18.15/2.31	o 358
25.34/3.22	o 350
37.32/4.73	o 348
60.48/7.64	o 346
65.27/8.25	o 343
105.21/13.26	o 340
444.64/55.78	o 339
758.57/95.07	o 338
768.08/96.25	o 337
1697.69/212.61	o 333
3172.77/397.34	o 332
3175.17/397.68	o 331
3179.22/398.17	o 330
3182.35/398.53	o 329
20125.34/2520.02	
20125.34/2520.02	c *** INTERRUPTED ***
20125.34/2520.02	c call to solver        : 18
20125.34/2520.02	c
20125.34/2520.02	c restarts              : 669529      
20125.34/2520.02	c conflicts             : 6614426      (329 /sec)
20125.34/2520.02	c decisions             : 30241437     (1503 /sec)
20125.34/2520.02	c propagations          : 8798021163  (437161 /sec)
20125.34/2520.02	c root propagations     : 5571        
20125.34/2520.02	c filter calls          : 738117441      (36676 /sec)
20125.34/2520.02	c useless filter calls  : 494874205      (67 %)
20125.34/2520.02	c Memory used           : 605.97 MB
20125.34/2520.02	c Best bound time (wc)  : 398.53 s
20125.34/2520.02	c CPU time              : 20125.3 s
20125.34/2520.02	c real time             : 2520.02 s
20125.34/2520.02	
20125.34/2520.02	s SATISFIABLE
20125.34/2520.02	c Best value found: 329
20125.34/2520.02	
20125.34/2520.02	
20125.34/2520.02	v <instantiation type='solution' cost='329'>
20125.34/2520.02	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] e[0] e[1] e[2] e[3] e[4] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] </list>
20125.34/2520.02	v <values>58 60 73 52 78 92 33 48 46 52 80 59 63 31 86 2 56 5 92 85 75 28 91 49 78 322 303 319 329 329 0 58 119 192 244 2 103 139 194 251 0 80 139 202 233 0 2 80 136 244 0 75 103 202 251 0 192 244 58 119 103 139 194 251 2 233 80 0 139 202 136 244 80 2 0 75 0 103 202 251 0 3 4 1 2 4 0 1 2 3 2 1 3 4 0 4 3 2 0 1 1 0 2 3 4 </values>
20125.34/2520.02	v </instantiation>
20125.34/2520.02

Verifier Data 

OK	329

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15300 MiB free)
  memory of node 1: 16384 MiB (15599 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409566-1569816725/watcher-4409566-1569816725 -o /tmp/evaluation-result-4409566-1569816725/solver-4409566-1569816725 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569816665-22934 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409566-1569816725.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22951, runsolver pid=22948
Current StackSize limit: 8192 KiB


[startup+0.100985 s]*
/proc/loadavg: 2.00 2.01 1.97 9/199 22960
/proc/meminfo: memFree=31631712/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=623604 memory=13704 CPUtime=0.69 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 4117 0 0 0 68 1 0 0 20 0 9 0 557925521 638570496 3426 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155901 3426 900 493 0 149206 0
[pid=22951/tid=22953] ppid=22948 vsize=623604 memory=576460756329955530 CPUtime=0.08 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 266 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627847957520 5394016 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=623604 memory=0 CPUtime=0.08 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 258 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627839564816 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=623604 memory=139806006978765 CPUtime=0.08 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 260 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627831172368 5158021 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=623604 memory=0 CPUtime=0.07 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 260 0 0 0 7 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627822779408 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=623604 memory=0 CPUtime=0.08 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 265 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627814386704 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=623604 memory=0 CPUtime=0.08 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627805994000 5394002 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=623604 memory=-1 CPUtime=0.08 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627797601296 5158055 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=623604 memory=0 CPUtime=0.08 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 8 0 0 0 20 0 9 0 557925523 638570496 3426 33554432000 4194304 6211132 140736041100416 140627789208848 5158008 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 623604 KiB
Current children cumulated memory: 13704 KiB

[startup+0.210998 s]*
/proc/loadavg: 2.00 2.01 1.97 9/199 22960
/proc/meminfo: memFree=31630600/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=622056 memory=13136 CPUtime=1.56 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 4124 0 0 0 155 1 0 0 20 0 9 0 557925521 636985344 3284 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155514 3284 901 493 0 148819 0
[pid=22951/tid=22953] ppid=22948 vsize=622056 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 267 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627847957776 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=622056 memory=9432 CPUtime=0.19 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 259 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627839564816 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=622056 memory=4120987552408880800 CPUtime=0.19 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627831172368 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=622056 memory=-1 CPUtime=0.17 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 260 0 0 0 17 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627822779520 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=622056 memory=0 CPUtime=0.19 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 266 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627814386704 5393997 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=622056 memory=0 CPUtime=0.19 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627805994000 5167933 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=622056 memory=-1 CPUtime=0.19 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627797601296 5390037 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=622056 memory=0 CPUtime=0.19 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 19 0 0 0 20 0 9 0 557925523 636985344 3284 33554432000 4194304 6211132 140736041100416 140627789208848 5167561 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 1.56 s
Current children cumulated vsize: 622056 KiB
Current children cumulated memory: 13136 KiB

[startup+0.309988 s]*
/proc/loadavg: 2.00 2.01 1.97 9/199 22960
/proc/meminfo: memFree=31630600/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=621540 memory=13072 CPUtime=2.34 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 4124 0 0 0 233 1 0 0 20 0 9 0 557925521 636456960 3268 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155385 3268 901 493 0 148690 0
[pid=22951/tid=22953] ppid=22948 vsize=621540 memory=1398722017469774279 CPUtime=0.29 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 267 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627847957536 5167536 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 259 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627839564816 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627831172368 5393952 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=621540 memory=6944656592455097440 CPUtime=0.26 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 260 0 0 0 26 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627822779520 5102776 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 266 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627814386704 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627805994000 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627797601296 5393983 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=621540 memory=0 CPUtime=0.29 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 29 0 0 0 20 0 9 0 557925523 636456960 3268 33554432000 4194304 6211132 140736041100416 140627789208848 5168224 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 2.34 s
Current children cumulated vsize: 621540 KiB
Current children cumulated memory: 13072 KiB

[startup+0.700984 s]
/proc/loadavg: 2.48 2.11 2.00 9/199 22960
/proc/meminfo: memFree=31630860/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12724 CPUtime=5.38 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 4124 0 0 0 537 1 0 0 20 0 9 0 557925521 635400192 3181 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3181 901 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=1548 CPUtime=0.67 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 267 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627847957632 5158032 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=8564 CPUtime=0.67 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 259 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627839564816 5168395 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=1712 CPUtime=0.67 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 261 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627831172048 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=1112 CPUtime=0.62 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 260 0 0 0 62 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627822779720 5168251 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=1004 CPUtime=0.67 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 266 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627814386640 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=1560 CPUtime=0.67 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627805994000 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=932 CPUtime=0.67 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627797601296 5102856 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=3768 CPUtime=0.67 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 262 0 0 0 67 0 0 0 20 0 9 0 557925523 635400192 3181 33554432000 4194304 6211132 140736041100416 140627789208608 5186313 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 5.38 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12724 KiB

[startup+1.50099 s]
/proc/loadavg: 2.48 2.11 2.00 9/199 22960
/proc/meminfo: memFree=31630860/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12744 CPUtime=11.76 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 5027 0 0 0 1174 2 0 0 20 0 9 0 557925521 635400192 3186 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3186 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=9319 CPUtime=1.47 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 380 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627847957176 5397493 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=23472 CPUtime=1.47 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 371 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627839565072 5389970 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=0 CPUtime=1.47 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 422 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627831172368 5393993 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=8243114992657236051 CPUtime=1.41 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 379 0 0 0 141 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627822779344 5167539 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=288292194505458544 CPUtime=1.47 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 354 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627814386704 5167949 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=7596563668010819922 CPUtime=1.47 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 364 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627805994000 5393970 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=279611766666720 CPUtime=1.47 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 374 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627797601552 5102842 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=3540028715200484102 CPUtime=1.47 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 358 0 0 0 147 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627789208704 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 11.76 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12744 KiB

[startup+3.10998 s]
/proc/loadavg: 2.48 2.11 2.00 9/199 22960
/proc/meminfo: memFree=31632132/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12744 CPUtime=24.61 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 5790 0 0 0 2459 2 0 0 20 0 9 0 557925521 635400192 3186 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3186 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=12744 CPUtime=3.08 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 476 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627847957176 5168392 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=1060 CPUtime=3.08 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 411 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627839565072 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=12744 CPUtime=3.08 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 537 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627831172368 5393952 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=9319 CPUtime=3 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 503 0 0 0 300 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627822779344 5168392 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=23472 CPUtime=3.08 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 448 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627814386704 5102809 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=287 CPUtime=3.08 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 421 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627805994112 5102776 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=287 CPUtime=3.08 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 506 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627797601296 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=287 CPUtime=3.08 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 463 0 0 0 308 0 0 0 20 0 9 0 557925523 635400192 3186 33554432000 4194304 6211132 140736041100416 140627789208848 5167613 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 24.61 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12744 KiB

[startup+6.30099 s]
/proc/loadavg: 3.01 2.23 2.04 9/199 22960
/proc/meminfo: memFree=31632380/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12752 CPUtime=50.1 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 6847 0 0 0 5008 2 0 0 20 0 9 0 557925521 635400192 3188 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3188 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=139810297562751 CPUtime=6.27 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 626 0 0 0 627 0 0 0 20 0 9 0 557925523 635400192 3188 33554432000 4194304 6211132 140736041100416 140627847957176 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=56 CPUtime=6.27 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 515 0 0 0 627 0 0 0 20 0 9 0 557925523 635400192 3188 33554432000 4194304 6211132 140736041100416 140627839565072 5168395 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=12744 CPUtime=6.27 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 693 0 0 0 627 0 0 0 20 0 9 0 557925523 635400192 3188 33554432000 4194304 6211132 140736041100416 140627831172112 5393997 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=0 CPUtime=6.15 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 637 0 0 0 615 0 0 0 20 0 9 0 557925523 635400192 3188 33554432000 4194304 6211132 140736041100416 140627822779344 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0

################
# More data... #
################

/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6158 0 0 0 226189 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12836 CPUtime=2259.63 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 5693 0 0 0 225963 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=12836 CPUtime=2262.03 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5583 0 0 0 226203 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=12836 CPUtime=2261.89 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5314 0 0 0 226189 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5394021 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=12836 CPUtime=2261.91 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6246 0 0 0 226191 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=12836 CPUtime=2236.26 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 5785 0 0 0 223625 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 18067.2 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB

[startup+2322.3 s]
/proc/loadavg: 8.02 8.16 7.70 9/199 23125
/proc/meminfo: memFree=31635364/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12836 CPUtime=18546.4 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 48912 0 0 0 1854634 8 0 0 20 0 9 0 557925521 635400192 3209 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3209 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=12836 CPUtime=2321.75 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 5778 0 0 0 232175 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627847957368 5167933 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=12836 CPUtime=2321.76 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 5738 0 0 0 232175 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627839564784 5393997 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=3504 CPUtime=2321.88 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6241 0 0 0 232188 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5156975 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12836 CPUtime=2319.63 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 5836 0 0 0 231963 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5167946 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=12836 CPUtime=2322.02 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5707 0 0 0 232202 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=0 CPUtime=2321.89 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5380 0 0 0 232188 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5207536 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=12836 CPUtime=2321.9 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6337 0 0 0 232190 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=12836 CPUtime=2295.49 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 5870 0 0 0 229548 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 18546.4 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB

[startup+2382.3 s]
/proc/loadavg: 8.24 8.19 7.74 9/200 23138
/proc/meminfo: memFree=31634972/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12836 CPUtime=19025.6 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 49631 0 0 0 1902548 8 0 0 20 0 9 0 557925521 635400192 3209 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3209 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=12836 CPUtime=2381.73 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 5876 0 0 0 238173 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627847957368 5167602 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=12836 CPUtime=2381.73 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 5818 0 0 0 238172 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627839564784 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=12836 CPUtime=2381.87 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6346 0 0 0 238187 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5393997 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12836 CPUtime=2379.62 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 5919 0 0 0 237962 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5168392 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=12836 CPUtime=2382 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5772 0 0 0 238200 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5167960 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=12836 CPUtime=2381.88 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5459 0 0 0 238187 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=12836 CPUtime=2381.89 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6451 0 0 0 238189 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5168368 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=3504 CPUtime=2354.74 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 5965 0 0 0 235473 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5393952 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 19025.6 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB

[startup+2442.3 s]
/proc/loadavg: 8.09 8.16 7.76 9/200 23141
/proc/meminfo: memFree=31633944/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12836 CPUtime=19504.7 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 50382 0 0 0 1950466 8 0 0 20 0 9 0 557925521 635400192 3209 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3209 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.72 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 5971 0 0 0 244172 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627847957368 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.73 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 5926 0 0 0 244172 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627839564784 5102734 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.86 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6423 0 0 0 244186 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12836 CPUtime=2439.61 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 5994 0 0 0 243961 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.99 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5846 0 0 0 244199 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.87 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5545 0 0 0 244186 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5168401 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=12836 CPUtime=2441.88 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6585 0 0 0 244188 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5102815 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=12836 CPUtime=2413.97 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 6067 0 0 0 241396 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 19504.7 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB

[startup+2502.3 s]
/proc/loadavg: 8.39 8.22 7.81 9/200 23144
/proc/meminfo: memFree=31635024/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12836 CPUtime=19983.9 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 51150 0 0 0 1998384 8 0 0 20 0 9 0 557925521 635400192 3209 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3209 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=1004 CPUtime=2501.7 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 6064 0 0 0 250170 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627847957368 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=12836 CPUtime=2501.71 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 6008 0 0 0 250170 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627839564784 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=12836 CPUtime=2501.85 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6574 0 0 0 250185 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12836 CPUtime=2499.61 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 6083 0 0 0 249961 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5166864 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=12836 CPUtime=2501.99 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5920 0 0 0 250199 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5168368 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=12836 CPUtime=2501.86 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5656 0 0 0 250185 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=12836 CPUtime=2501.87 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6692 0 0 0 250187 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5156968 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=6935054825532540783 CPUtime=2473.22 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 6128 0 0 0 247321 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5167591 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 19983.9 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.53 8.26 7.82 9/200 23146
/proc/meminfo: memFree=31634656/32770624 swapFree=66999256/67108860
[pid=22951] ppid=22948 vsize=620508 memory=12836 CPUtime=20125.3 cores=0-7
/proc/22951/stat : 22951 (cosoco) S 22948 22951 22907 0 -1 1077944320 51165 0 0 0 2012526 8 0 0 20 0 9 0 557925521 635400192 3209 33554432000 4194304 6211132 140736041100416 140736041098672 140627871100663 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
/proc/22951/statm: 155127 3209 902 493 0 148432 0
[pid=22951/tid=22953] ppid=22948 vsize=620508 memory=1398722017469774279 CPUtime=2519.41 cores=0-7
/proc/22951/task/22953/stat : 22953 (cosoco) R 22948 22951 22907 0 -1 4202560 6073 0 0 0 251941 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627847957368 5193786 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22954] ppid=22948 vsize=620508 memory=12024 CPUtime=2519.41 cores=0-7
/proc/22951/task/22954/stat : 22954 (cosoco) R 22948 22951 22907 0 -1 4202560 6010 0 0 0 251940 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627839564784 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22955] ppid=22948 vsize=620508 memory=6935054825532540783 CPUtime=2519.55 cores=0-7
/proc/22951/task/22955/stat : 22955 (cosoco) R 22948 22951 22907 0 -1 4202560 6576 0 0 0 251955 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627831172112 5393997 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22956] ppid=22948 vsize=620508 memory=12024 CPUtime=2517.32 cores=0-7
/proc/22951/task/22956/stat : 22956 (cosoco) R 22948 22951 22907 0 -1 4202560 6083 0 0 0 251732 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627822779520 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22957] ppid=22948 vsize=620508 memory=500 CPUtime=2519.7 cores=0-7
/proc/22951/task/22957/stat : 22957 (cosoco) R 22948 22951 22907 0 -1 4202560 5920 0 0 0 251970 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627814386816 5393952 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22958] ppid=22948 vsize=620508 memory=1560 CPUtime=2519.57 cores=0-7
/proc/22951/task/22958/stat : 22958 (cosoco) R 22948 22951 22907 0 -1 4202560 5656 0 0 0 251956 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627805994000 5193742 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22959] ppid=22948 vsize=620508 memory=932 CPUtime=2519.58 cores=0-7
/proc/22951/task/22959/stat : 22959 (cosoco) R 22948 22951 22907 0 -1 4202560 6693 0 0 0 251958 0 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627797601408 5158008 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
[pid=22951/tid=22960] ppid=22948 vsize=620508 memory=3908 CPUtime=2490.7 cores=0-7
/proc/22951/task/22960/stat : 22960 (cosoco) R 22948 22951 22907 0 -1 4202560 6129 0 0 0 249069 1 0 0 20 0 9 0 557925523 635400192 3209 33554432000 4194304 6211132 140736041100416 140627789208704 5167606 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 32194560 140736041104401 140736041104493 140736041104493 140736041107406 0
Current children cumulated CPU time: 20125.3 s
Current children cumulated vsize: 620508 KiB
Current children cumulated memory: 12836 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 22951 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20125.3 s, system=0.082957 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.02
CPU time (s): 20125.4
CPU user time (s): 20125.3
CPU system time (s): 0.082957
CPU usage (%): 798.621
Max. virtual memory (cumulated for all children) (KiB): 623604
Max. memory (cumulated for all children) (KiB): 13704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20125.3
system time used= 0.082957
maximum resident set size= 13808
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51217
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 535
involuntary context switches= 166414


# summary of solver processes directly reported to runsolver:
#   pid: 22951
#   total CPU time (s): 20125.4
#   total CPU user time (s): 20125.3
#   total CPU system time (s): 0.082957

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.9775 second user time and 20.1646 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-30 06:11:06
IDJOB=4409566
IDBENCH=115816
IDSOLVER=2877
FILE ID=node103/4409566-1569816725
RUNJOBID= node103-1569816665-22934
PBS_JOBID= 21705909
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-05-05-4.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409566-1569816725/watcher-4409566-1569816725 -o /tmp/evaluation-result-4409566-1569816725/solver-4409566-1569816725 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569816665-22934 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409566-1569816725.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a08c622730be04b0ce65f9055d76b754
RANDOM SEED=193851676

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31641636 kB
MemAvailable:   31870192 kB
Buffers:          172640 kB
Cached:           400872 kB
SwapCached:         7000 kB
Active:           329740 kB
Inactive:         256820 kB
Active(anon):      20932 kB
Inactive(anon):    74504 kB
Active(file):     308808 kB
Inactive(file):   182316 kB
Unevictable:      107704 kB
Mlocked:          107704 kB
SwapTotal:      67108860 kB
SwapFree:       66999256 kB
Dirty:              2736 kB
Writeback:             0 kB
AnonPages:        115816 kB
Mapped:            25940 kB
Shmem:             73656 kB
Slab:             135420 kB
SReclaimable:     106532 kB
SUnreclaim:        28888 kB
KernelStack:        3296 kB
PageTables:         5832 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538216 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 62028 MiB
End job on node103 at 2019-09-30 06:53:06