Trace number 4398326

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)301 20129.6 2520.02

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-05-05-0.xml
MD5SUMda64694dd3ca715594c36c32a8b555a8
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark300
Best CPU time to get the best result obtained on this benchmark25.2154
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of constraints90
Number of domains7
Minimum domain size5
Maximum domain size400
Distribution of domain sizes[{"size":5,"count":50},{"size":400,"count":55}]
Minimum variable degree2
Maximum variable degree6
Distribution of variable degrees[{"degree":2,"count":30},{"degree":3,"count":50},{"degree":6,"count":25}]
Minimum constraint arity1
Maximum constraint arity7
Distribution of constraint arities[{"arity":1,"count":5},{"arity":2,"count":25},{"arity":3,"count":25},{"arity":5,"count":10},{"arity":7,"count":25}]
Number of extensional constraints25
Number of intensional constraints30
Distribution of constraint types[{"type":"extension","count":25},{"type":"intension","count":30},{"type":"allDifferent","count":5},{"type":"noOverlap","count":5},{"type":"element","count":25}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.07	c
0.00/0.07	c This is cosoco 2.00 --  
0.00/0.07	c
0.00/0.07	c command line: cosoco -model -nbcores=8 HOME/instance-4398326-1568596977.xml 
0.00/0.07	c enable optimization
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.01 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 105
0.00/0.07	c |            Domain Sizes: 5..400
0.00/0.07	c |
0.00/0.07	c |             Constraints: 136
0.00/0.07	c |                   Arity: 1..7  -- Unary: 5  -- Binary: 75  -- Ternary: 25
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          All Different: 5
0.00/0.07	c |                          Disjunctive: 50
0.00/0.07	c |                          Element Variable: 25
0.00/0.07	c |                          Extension: 25  (nb tuples: 5..5) -- (shared: 160)
0.00/0.07	c |                          Max constant: 1
0.00/0.07	c |                          Sum: 25
0.00/0.07	c |                          Unary: 5
0.00/0.07	c |                          
0.00/0.07	c |               Objective: Minimize Max constant
0.00/0.07	
0.00/0.07	c =========================================================================================================
0.00/0.07	c Parallel mode: Portfolio
0.00/0.07	c [pFactory][Group N°0] created (threads:8).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.07	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.07	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.07	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.07	c [pFactory][Group N°0] task 7 launched on thread 1.
0.00/0.07	c [pFactory][Group N°0] task 6 launched on thread 2.
0.00/0.07	c [pFactory][Group N°0] task 5 launched on thread 0.
0.00/0.07	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.07	c [pFactory][Group N°0] task 3 launched on thread 4.
0.00/0.07	c [pFactory][Group N°0] task 2 launched on thread 3.
0.00/0.07	c [pFactory][Group N°0] task 1 launched on thread 5.
0.00/0.07	c [pFactory][Group N°0] task 0 launched on thread 7.
0.00/0.07	o 397
0.71/0.13	o 389
0.71/0.16	o 388
0.71/0.19	o 367
1.57/0.26	o 366
2.36/0.37	o 362
2.36/0.40	o 361
3.94/0.54	o 360
4.67/0.65	o 358
4.67/0.69	o 352
6.20/0.81	o 350
6.20/0.83	o 343
8.66/1.11	o 339
8.66/1.15	o 337
9.38/1.22	o 336
11.78/1.52	o 334
13.38/1.72	o 333
14.97/1.96	o 329
18.17/2.38	o 324
20.57/2.62	o 321
25.35/3.28	o 316
33.34/4.20	o 314
41.33/5.29	o 308
46.13/5.87	o 307
110.84/13.96	o 306
205.90/25.87	o 305
1890.58/236.76	o 304
3750.15/469.56	o 303
4989.89/624.73	o 302
17854.54/2235.25	o 301
20129.51/2520.02	
20129.51/2520.02	c *** INTERRUPTED ***
20129.51/2520.02	c call to solver        : 16
20129.51/2520.02	c
20129.51/2520.02	c restarts              : 901952      
20129.51/2520.02	c conflicts             : 6149519      (305 /sec)
20129.51/2520.02	c decisions             : 34616424     (1720 /sec)
20129.51/2520.02	c propagations          : 8377725582  (416191 /sec)
20129.51/2520.02	c root propagations     : 3445        
20129.51/2520.02	c filter calls          : 822911117      (40881 /sec)
20129.51/2520.02	c useless filter calls  : 565001335      (68 %)
20129.51/2520.02	c Memory used           : 605.84 MB
20129.51/2520.02	c Best bound time (wc)  : 2235.25 s
20129.51/2520.02	c CPU time              : 20129.5 s
20129.51/2520.02	c real time             : 2520.01 s
20129.51/2520.02	
20129.51/2520.02	s SATISFIABLE
20129.51/2520.02	c Best value found: 301
20129.51/2520.02	
20129.51/2520.02	
20129.51/2520.02	v <instantiation type='solution' cost='301'>
20129.51/2520.02	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] e[0] e[1] e[2] e[3] e[4] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] </list>
20129.51/2520.02	v <values>44 66 85 31 64 14 69 18 7 68 60 1 90 74 70 54 98 13 45 76 45 15 80 10 91 296 300 295 301 289 0 45 111 196 232 0 111 180 225 232 0 60 61 151 225 0 60 158 180 225 0 45 60 158 198 232 45 196 111 0 225 111 232 0 180 151 225 0 60 61 0 180 60 225 158 60 0 158 45 198 4 1 3 2 0 3 1 4 0 2 2 3 4 0 1 0 2 4 1 3 1 3 0 2 4 </values>
20129.51/2520.02	v </instantiation>
20129.51/2520.02

Verifier Data 

OK	301

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14897 MiB free)
  memory of node 1: 16384 MiB (15298 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398326-1568596977/watcher-4398326-1568596977 -o /tmp/evaluation-result-4398326-1568596977/solver-4398326-1568596977 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node146-1568596936-27641 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398326-1568596977.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27658, runsolver pid=27655

[startup+0.100877 s]*
/proc/loadavg: 0.92 1.13 1.51 10/199 27667
/proc/meminfo: memFree=30913764/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=622200 memory=11108 CPUtime=0.71 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 3176 0 0 0 71 0 0 0 20 0 9 0 435611661 637132800 2777 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155550 2777 872 493 0 148855 0
[pid=27658/tid=27660] ppid=27655 vsize=622200 memory=4134692831991786133 CPUtime=0.08 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895670971408 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=622200 memory=4872558044660077418 CPUtime=0.08 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 152 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895662578704 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=622200 memory=140095176689280 CPUtime=0.08 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895654186256 5193710 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895645793296 5008971 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=622200 memory=0 CPUtime=0.07 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 7 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895637400488 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895629007888 5102815 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=622200 memory=-1 CPUtime=0.08 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 146 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895620615296 5156901 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=622200 memory=0 CPUtime=0.08 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 8 0 0 0 20 0 9 0 435611663 637132800 2777 33554432000 4194304 6211092 140723832204352 139895612222480 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 0.71 s
Current children cumulated vsize: 622200 KiB
Current children cumulated memory: 11108 KiB

[startup+0.210876 s]*
/proc/loadavg: 0.92 1.13 1.51 9/199 27667
/proc/meminfo: memFree=30913632/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=621160 memory=10596 CPUtime=1.57 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 3176 0 0 0 157 0 0 0 20 0 9 0 435611661 636067840 2649 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155290 2649 872 493 0 148595 0
[pid=27658/tid=27660] ppid=27655 vsize=621160 memory=6935054825532540783 CPUtime=0.19 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895670971520 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=621160 memory=4872558142750484027 CPUtime=0.19 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 152 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895662578960 5167521 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=621160 memory=140095176689280 CPUtime=0.19 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895654186256 5157356 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=621160 memory=0 CPUtime=0.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895645793312 5157989 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=621160 memory=0 CPUtime=0.17 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 17 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895637400704 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=621160 memory=0 CPUtime=0.19 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895629007904 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=621160 memory=-1 CPUtime=0.19 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 146 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895620615296 5102871 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=621160 memory=0 CPUtime=0.19 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 19 0 0 0 20 0 9 0 435611663 636067840 2649 33554432000 4194304 6211092 140723832204352 139895612222496 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 1.57 s
Current children cumulated vsize: 621160 KiB
Current children cumulated memory: 10596 KiB

[startup+0.309877 s]*
/proc/loadavg: 0.92 1.13 1.51 9/199 27667
/proc/meminfo: memFree=30913632/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=620640 memory=10344 CPUtime=2.36 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 3176 0 0 0 236 0 0 0 20 0 9 0 435611661 635535360 2586 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155160 2586 873 493 0 148465 0
[pid=27658/tid=27660] ppid=27655 vsize=620640 memory=6935054825532540783 CPUtime=0.29 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895670971520 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620640 memory=-1 CPUtime=0.29 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 152 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895662578960 5389851 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620640 memory=140095176689282 CPUtime=0.29 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895654186256 5193696 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620640 memory=-1 CPUtime=0.29 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895645793312 5168219 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620640 memory=0 CPUtime=0.26 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 26 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895637400848 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620640 memory=0 CPUtime=0.29 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895629007904 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620640 memory=2208 CPUtime=0.29 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 146 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895620615296 5193731 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620640 memory=0 CPUtime=0.29 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 29 0 0 0 20 0 9 0 435611663 635535360 2586 33554432000 4194304 6211092 140723832204352 139895612222496 5156949 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 2.36 s
Current children cumulated vsize: 620640 KiB
Current children cumulated memory: 10344 KiB

[startup+0.700877 s]
/proc/loadavg: 0.92 1.13 1.51 9/199 27667
/proc/meminfo: memFree=30913632/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10216 CPUtime=5.4 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 3176 0 0 0 540 0 0 0 20 0 9 0 435611661 635269120 2554 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2554 873 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=0 CPUtime=0.67 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895670971408 5102734 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=0 CPUtime=0.67 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 152 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895662578960 5393965 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=0 CPUtime=0.67 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895654186256 5166895 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=0 CPUtime=0.67 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895645793312 5102675 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=580 CPUtime=0.63 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 63 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895637400592 5168360 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=1696 CPUtime=0.67 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 147 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895629007904 5186269 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=3436 CPUtime=0.67 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 146 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895620615200 5393920 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=7548 CPUtime=0.67 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 148 0 0 0 67 0 0 0 20 0 9 0 435611663 635269120 2554 33554432000 4194304 6211092 140723832204352 139895612222496 5168216 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 5.4 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10216 KiB

[startup+1.50088 s]
/proc/loadavg: 0.92 1.13 1.51 9/199 27667
/proc/meminfo: memFree=30913632/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10236 CPUtime=11.78 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 4526 0 0 0 1178 0 0 0 20 0 9 0 435611661 635269120 2559 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2559 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=6655300316396806240 CPUtime=1.47 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 267 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895670971408 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=6944656592455097440 CPUtime=1.47 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 307 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895662578960 5389823 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=6655300316396806240 CPUtime=1.47 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 295 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895654186000 5193696 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=280190110529824 CPUtime=1.47 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 390 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895645793296 5193710 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=258870563887126 CPUtime=1.42 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 285 0 0 0 142 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895637400592 5393965 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=258870563887127 CPUtime=1.48 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 328 0 0 0 148 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895629007904 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=258870563887128 CPUtime=1.47 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 361 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895620615440 5186289 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=140099471656575 CPUtime=1.47 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 300 0 0 0 147 0 0 0 20 0 9 0 435611663 635269120 2559 33554432000 4194304 6211092 140723832204352 139895612222592 5393951 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 11.78 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10236 KiB

[startup+3.10988 s]
/proc/loadavg: 0.92 1.13 1.51 9/200 27669
/proc/meminfo: memFree=30913260/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10248 CPUtime=24.63 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 5761 0 0 0 2462 1 0 0 20 0 9 0 435611661 635269120 2562 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2562 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=10236 CPUtime=3.08 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 370 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895670971664 5393920 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=10216 CPUtime=3.08 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 461 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895662578360 5393920 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=0 CPUtime=3.08 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 499 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895654186000 5397230 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=8740 CPUtime=3.08 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 491 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895645793296 5102783 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=0 CPUtime=3 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 463 0 0 0 300 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895637400848 5168360 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=0 CPUtime=3.08 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 514 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895629007904 5168216 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=-8458152057954495884 CPUtime=3.08 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 514 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895620615440 5394011 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=3054156605368933524 CPUtime=3.08 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 456 0 0 0 308 0 0 0 20 0 9 0 435611663 635269120 2562 33554432000 4194304 6211092 140723832204352 139895612222592 5167538 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 24.63 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10248 KiB

[startup+6.30088 s]
/proc/loadavg: 1.41 1.23 1.54 9/200 27669
/proc/meminfo: memFree=30913404/32770624 swapFree=67001232/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10280 CPUtime=50.12 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 7192 0 0 0 5011 1 0 0 20 0 9 0 435611661 635269120 2570 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2570 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=56 CPUtime=6.27 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 516 0 0 0 627 0 0 0 20 0 9 0 435611663 635269120 2570 33554432000 4194304 6211092 140723832204352 139895670971664 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=0 CPUtime=6.27 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 649 0 0 0 627 0 0 0 20 0 9 0 435611663 635269120 2570 33554432000 4194304 6211092 140723832204352 139895662578960 5102854 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=7144996226033137458 CPUtime=6.27 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 676 0 0 0 627 0 0 0 20 0 9 0 435611663 635269120 2570 33554432000 4194304 6211092 140723832204352 139895654186000 5102802 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10248 CPUtime=6.27 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 731 0 0 0 627 0 0 0 20 0 9 0 435611663 635269120 2570 33554432000 4194304 6211092 140723832204352 139895645793408 5193696 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0

################
# More data... #
################

/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5543 0 0 0 226219 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5156928 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10396 CPUtime=2262.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 5781 0 0 0 226218 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=10396 CPUtime=2254.21 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5322 0 0 0 225421 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5156931 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=10396 CPUtime=2262.39 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 5852 0 0 0 226239 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5167917 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=3616 CPUtime=2262.33 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 5783 0 0 0 226233 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=3616 CPUtime=2244.51 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 5706 0 0 0 224449 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 18071 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB

[startup+2322.3 s]
/proc/loadavg: 8.22 8.23 7.68 9/200 27845
/proc/meminfo: memFree=30913392/32770624 swapFree=67001236/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10396 CPUtime=18550.3 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 47760 0 0 0 1855020 6 0 0 20 0 9 0 435611661 635269120 2599 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2599 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=10396 CPUtime=2320.75 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 5385 0 0 0 232075 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895670971064 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=10396 CPUtime=2322.36 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 5850 0 0 0 232236 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895662578624 5193696 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=10396 CPUtime=2322.18 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5638 0 0 0 232218 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5390056 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10396 CPUtime=2322.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 5839 0 0 0 232218 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=10396 CPUtime=2313.48 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5432 0 0 0 231348 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5102734 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=10396 CPUtime=2322.37 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 5946 0 0 0 232237 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5409453 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=10396 CPUtime=2322.34 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 5877 0 0 0 232234 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=23212 CPUtime=2304.51 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 5800 0 0 0 230449 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5397429 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 18550.3 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB

[startup+2382.3 s]
/proc/loadavg: 8.50 8.29 7.73 9/201 27870
/proc/meminfo: memFree=30913256/32770624 swapFree=67001240/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10396 CPUtime=19029.5 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 48413 0 0 0 1902944 6 0 0 20 0 9 0 435611661 635269120 2599 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2599 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=10396 CPUtime=2380.75 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 5465 0 0 0 238075 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895670971064 5393951 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=10396 CPUtime=2382.36 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 5920 0 0 0 238236 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895662578624 5168336 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=10396 CPUtime=2382.19 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5707 0 0 0 238219 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5156908 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10396 CPUtime=2382.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 5890 0 0 0 238218 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5393984 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=808 CPUtime=2372.73 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5529 0 0 0 237273 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5186176 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=10396 CPUtime=2382.37 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 6047 0 0 0 238237 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5167504 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=10396 CPUtime=2382.34 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 5966 0 0 0 238234 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5390488 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=10396 CPUtime=2364.5 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 5896 0 0 0 236448 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5167888 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 19029.5 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB

[startup+2442.3 s]
/proc/loadavg: 8.68 8.38 7.80 9/201 27875
/proc/meminfo: memFree=30912224/32770624 swapFree=67001240/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10396 CPUtime=19508.8 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 49167 0 0 0 1950870 7 0 0 20 0 9 0 435611661 635269120 2599 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2599 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=3616 CPUtime=2440.75 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 5569 0 0 0 244075 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895670971064 5102851 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=10396 CPUtime=2442.36 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 6035 0 0 0 244236 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895662578624 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=10396 CPUtime=2442.19 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5816 0 0 0 244219 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5193696 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10396 CPUtime=2442.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 5948 0 0 0 244218 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=10396 CPUtime=2431.99 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5636 0 0 0 243199 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5166745 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=10396 CPUtime=2442.37 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 6129 0 0 0 244237 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5168336 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=10396 CPUtime=2442.34 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 6043 0 0 0 244234 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=10396 CPUtime=2424.5 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 5998 0 0 0 242448 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 19508.8 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB

[startup+2502.3 s]
/proc/loadavg: 8.50 8.38 7.84 9/201 27878
/proc/meminfo: memFree=30912572/32770624 swapFree=67001240/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10396 CPUtime=19988.1 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 49198 0 0 0 1998798 7 0 0 20 0 9 0 435611661 635269120 2599 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2599 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=6935054825532540783 CPUtime=2500.75 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 5570 0 0 0 250075 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895670971064 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=10396 CPUtime=2502.35 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 6048 0 0 0 250235 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895662578624 5167529 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=10396 CPUtime=2502.2 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5823 0 0 0 250220 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5102815 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=10396 CPUtime=2502.19 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 5948 0 0 0 250218 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5193696 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=10396 CPUtime=2491.26 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5636 0 0 0 249126 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5102815 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=10396 CPUtime=2502.36 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 6129 0 0 0 250236 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5393945 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=10396 CPUtime=2502.34 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 6045 0 0 0 250234 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=10396 CPUtime=2484.5 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 6006 0 0 0 248448 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 19988.1 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.42 8.38 7.85 9/201 27879
/proc/meminfo: memFree=30912676/32770624 swapFree=67001240/67108860
[pid=27658] ppid=27655 vsize=620380 memory=10396 CPUtime=20129.5 cores=0-7
/proc/27658/stat : 27658 (cosoco) S 27655 27658 27614 0 -1 1077944320 49859 0 0 0 2012944 7 0 0 20 0 9 0 435611661 635269120 2599 33554432000 4194304 6211092 140723832204352 140723832202608 139895694114551 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
/proc/27658/statm: 155095 2599 874 493 0 148400 0
[pid=27658/tid=27660] ppid=27655 vsize=620380 memory=6935054825532540783 CPUtime=2518.46 cores=0-7
/proc/27658/task/27660/stat : 27660 (cosoco) R 27655 27658 27614 0 -1 4202560 5652 0 0 0 251846 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895670971064 5393965 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27661] ppid=27655 vsize=620380 memory=4872558044660077418 CPUtime=2520.06 cores=0-7
/proc/27658/task/27661/stat : 27661 (cosoco) R 27655 27658 27614 0 -1 4202560 6137 0 0 0 252006 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895662578624 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27662] ppid=27655 vsize=620380 memory=808 CPUtime=2519.9 cores=0-7
/proc/27658/task/27662/stat : 27662 (cosoco) R 27655 27658 27614 0 -1 4202560 5902 0 0 0 251990 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895654185512 5389938 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27663] ppid=27655 vsize=620380 memory=1720 CPUtime=2519.9 cores=0-7
/proc/27658/task/27663/stat : 27663 (cosoco) R 27655 27658 27614 0 -1 4202560 6051 0 0 0 251989 1 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895645793296 5167547 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27664] ppid=27655 vsize=620380 memory=4096 CPUtime=2508.75 cores=0-7
/proc/27658/task/27664/stat : 27664 (cosoco) R 27655 27658 27614 0 -1 4202560 5696 0 0 0 250875 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895637400848 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27665] ppid=27655 vsize=620380 memory=1808 CPUtime=2520.07 cores=0-7
/proc/27658/task/27665/stat : 27665 (cosoco) R 27655 27658 27614 0 -1 4202560 6178 0 0 0 252007 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895629007544 5193710 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27666] ppid=27655 vsize=620380 memory=912 CPUtime=2520.05 cores=0-7
/proc/27658/task/27666/stat : 27666 (cosoco) R 27655 27658 27614 0 -1 4202560 6133 0 0 0 252005 0 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895620614856 5193708 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
[pid=27658/tid=27667] ppid=27655 vsize=620380 memory=6935054825532540783 CPUtime=2502.22 cores=0-7
/proc/27658/task/27667/stat : 27667 (cosoco) R 27655 27658 27614 0 -1 4202560 6117 0 0 0 250220 2 0 0 20 0 9 0 435611663 635269120 2599 33554432000 4194304 6211092 140723832204352 139895612222592 5168369 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 22609920 140723832210449 140723832210541 140723832210541 140723832213454 0
Current children cumulated CPU time: 20129.5 s
Current children cumulated vsize: 620380 KiB
Current children cumulated memory: 10396 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 27658 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20129.5 s, system=0.071976 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.02
CPU time (s): 20129.6
CPU user time (s): 20129.5
CPU system time (s): 0.071976
CPU usage (%): 798.787
Max. virtual memory (cumulated for all children) (KiB): 622200
Max. memory (cumulated for all children) (KiB): 11108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20129.5
system time used= 0.071976
maximum resident set size= 11236
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49916
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 317
involuntary context switches= 166851


# summary of solver processes directly reported to runsolver:
#   pid: 27658
#   total CPU time (s): 20129.6
#   total CPU user time (s): 20129.5
#   total CPU system time (s): 0.071976

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.1709 second user time and 19.0151 second system time

The end

Launcher Data 

Begin job on node146 at 2019-09-16 03:22:16
IDJOB=4398326
IDBENCH=115827
IDSOLVER=2851
FILE ID=node146/4398326-1568596977
RUNJOBID= node146-1568596936-27641
PBS_JOBID= 21703402
Free space on /tmp= 59028 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-05-05-0.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398326-1568596977/watcher-4398326-1568596977 -o /tmp/evaluation-result-4398326-1568596977/solver-4398326-1568596977 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node146-1568596936-27641 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398326-1568596977.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= da64694dd3ca715594c36c32a8b555a8
RANDOM SEED=325347030

node146.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30920300 kB
MemAvailable:   31872272 kB
Buffers:          213428 kB
Cached:          1009860 kB
SwapCached:         4372 kB
Active:           579312 kB
Inactive:         648604 kB
Active(anon):      21764 kB
Inactive(anon):    30136 kB
Active(file):     557548 kB
Inactive(file):   618468 kB
Unevictable:      111220 kB
Mlocked:          111220 kB
SwapTotal:      67108860 kB
SwapFree:       67001232 kB
Dirty:              2788 kB
Writeback:             0 kB
AnonPages:        262288 kB
Mapped:            44572 kB
Shmem:             38752 kB
Slab:             213524 kB
SReclaimable:     183580 kB
SUnreclaim:        29944 kB
KernelStack:        3648 kB
PageTables:         5688 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506868 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    217088 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      109952 kB
DirectMap2M:    33435648 kB

Free space on /tmp at the end= 59028 MiB
End job on node146 at 2019-09-16 04:04:16