Trace number 4398385

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)511 20124.2 2520.03

General information on the benchmark

NameScheduling/Scheduling-os-taillard/
Taillard-os-07-07-8.xml
MD5SUM3801e67c429176a130b0cb7922d17a7f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark458
Best CPU time to get the best result obtained on this benchmark29.0983
Satisfiable
(Un)Satisfiability was proved
Number of variables203
Number of constraints168
Number of domains9
Minimum domain size6
Maximum domain size560
Distribution of domain sizes[{"size":6,"count":7},{"size":7,"count":91},{"size":560,"count":105}]
Minimum variable degree2
Maximum variable degree8
Distribution of variable degrees[{"degree":2,"count":56},{"degree":3,"count":98},{"degree":8,"count":49}]
Minimum constraint arity1
Maximum constraint arity9
Distribution of constraint arities[{"arity":1,"count":7},{"arity":2,"count":49},{"arity":3,"count":49},{"arity":7,"count":14},{"arity":9,"count":49}]
Number of extensional constraints49
Number of intensional constraints56
Distribution of constraint types[{"type":"extension","count":49},{"type":"intension","count":56},{"type":"allDifferent","count":7},{"type":"noOverlap","count":7},{"type":"element","count":49}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

8.44/1.19	c
8.44/1.19	c This is cosoco 2.00 --  
8.44/1.19	c
8.44/1.19	c command line: cosoco -model -nbcores=8 HOME/instance-4398385-1568597319.xml 
8.44/1.19	c enable optimization
8.44/1.19	c ========================================[ Problem Statistics ]===========================================
8.44/1.19	c |                                                                                                       
8.44/1.19	c |  Parse time        :         0.03 s 
8.44/1.19	c |
8.44/1.19	c |               Variables: 203
8.44/1.19	c |            Domain Sizes: 6..560
8.44/1.19	c |
8.44/1.19	c |             Constraints: 309
8.44/1.19	c |                   Arity: 1..9  -- Unary: 7  -- Binary: 196  -- Ternary: 49
8.44/1.19	c | 
8.44/1.19	c |                   Types: 
8.44/1.19	c |                          All Different: 7
8.44/1.19	c |                          Disjunctive: 147
8.44/1.19	c |                          Element Variable: 49
8.44/1.19	c |                          Extension: 49  (nb tuples: 7..7) -- (shared: 336)
8.44/1.19	c |                          Max constant: 1
8.44/1.19	c |                          Sum: 49
8.44/1.19	c |                          Unary: 7
8.44/1.19	c |                          
8.44/1.19	c |               Objective: Minimize Max constant
8.44/1.19	
8.44/1.19	c =========================================================================================================
8.44/1.19	c Parallel mode: Portfolio
8.44/1.19	c [pFactory][Group N°0] created (threads:8).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
8.44/1.19	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
8.44/1.19	c [pFactory][Group N°0] concurrent mode: enabled.
8.44/1.19	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
8.44/1.19	c [pFactory][Group N°0] task 7 launched on thread 0.
8.44/1.19	c [pFactory][Group N°0] task 6 launched on thread 2.
8.44/1.19	c [pFactory][Group N°0] task 5 launched on thread 1.
8.44/1.19	c [pFactory][Group N°0] task 4 launched on thread 4.
8.44/1.19	c [pFactory][Group N°0] task 3 launched on thread 5.
8.44/1.19	c [pFactory][Group N°0] task 2 launched on thread 3.
8.44/1.19	c [pFactory][Group N°0] task 1 launched on thread 7.
8.44/1.19	c [pFactory][Group N°0] task 0 launched on thread 6.
8.44/1.19	o 556
11.57/1.55	o 554
50.69/6.44	o 539
52.29/6.62	o 533
93.83/11.84	o 532
152.19/19.18	o 531
180.87/22.71	o 530
612.07/76.76	o 529
1278.87/160.29	o 525
1345.96/168.70	o 520
1973.65/247.27	o 516
2280.30/285.66	o 515
2380.19/298.16	o 514
2399.28/300.51	o 513
5601.58/701.60	o 512
11376.18/1424.62	o 511
20124.04/2520.02	
20124.04/2520.02	c *** INTERRUPTED ***
20124.04/2520.02	c call to solver        : 14
20124.04/2520.02	c
20124.04/2520.02	c restarts              : 326800      
20124.04/2520.02	c conflicts             : 2032644      (101 /sec)
20124.04/2520.02	c decisions             : 10370717     (515 /sec)
20124.04/2520.02	c propagations          : 6042490337  (300262 /sec)
20124.04/2520.02	c root propagations     : 10341       
20124.04/2520.02	c filter calls          : 758629474      (37698 /sec)
20124.04/2520.02	c useless filter calls  : 578863254      (76 %)
20124.04/2520.02	c Memory used           : 611.52 MB
20124.04/2520.02	c Best bound time (wc)  : 1424.61 s
20124.04/2520.02	c CPU time              : 20124 s
20124.04/2520.02	c real time             : 2520.02 s
20124.04/2520.02	
20124.04/2520.02	s SATISFIABLE
20124.04/2520.02	c Best value found: 511
20124.04/2520.02	
20124.04/2520.02	
20124.04/2520.02	v <instantiation type='solution' cost='511'>
20124.04/2520.02	v <list>d[0][0] d[0][1] d[0][2] d[0][3] d[0][4] d[0][5] d[0][6] d[1][0] d[1][1] d[1][2] d[1][3] d[1][4] d[1][5] d[1][6] d[2][0] d[2][1] d[2][2] d[2][3] d[2][4] d[2][5] d[2][6] d[3][0] d[3][1] d[3][2] d[3][3] d[3][4] d[3][5] d[3][6] d[4][0] d[4][1] d[4][2] d[4][3] d[4][4] d[4][5] d[4][6] d[5][0] d[5][1] d[5][2] d[5][3] d[5][4] d[5][5] d[5][6] d[6][0] d[6][1] d[6][2] d[6][3] d[6][4] d[6][5] d[6][6] e[0] e[1] e[2] e[3] e[4] e[5] e[6] s[0][0] s[0][1] s[0][2] s[0][3] s[0][4] s[0][5] s[0][6] s[1][0] s[1][1] s[1][2] s[1][3] s[1][4] s[1][5] s[1][6] s[2][0] s[2][1] s[2][2] s[2][3] s[2][4] s[2][5] s[2][6] s[3][0] s[3][1] s[3][2] s[3][3] s[3][4] s[3][5] s[3][6] s[4][0] s[4][1] s[4][2] s[4][3] s[4][4] s[4][5] s[4][6] s[5][0] s[5][1] s[5][2] s[5][3] s[5][4] s[5][5] s[5][6] s[6][0] s[6][1] s[6][2] s[6][3] s[6][4] s[6][5] s[6][6] sd[0][0] sd[0][1] sd[0][2] sd[0][3] sd[0][4] sd[0][5] sd[0][6] sd[1][0] sd[1][1] sd[1][2] sd[1][3] sd[1][4] sd[1][5] sd[1][6] sd[2][0] sd[2][1] sd[2][2] sd[2][3] sd[2][4] sd[2][5] sd[2][6] sd[3][0] sd[3][1] sd[3][2] sd[3][3] sd[3][4] sd[3][5] sd[3][6] sd[4][0] sd[4][1] sd[4][2] sd[4][3] sd[4][4] sd[4][5] sd[4][6] sd[5][0] sd[5][1] sd[5][2] sd[5][3] sd[5][4] sd[5][5] sd[5][6] sd[6][0] sd[6][1] sd[6][2] sd[6][3] sd[6][4] sd[6][5] sd[6][6] w[0][0] w[0][1] w[0][2] w[0][3] w[0][4] w[0][5] w[0][6] w[1][0] w[1][1] w[1][2] w[1][3] w[1][4] w[1][5] w[1][6] w[2][0] w[2][1] w[2][2] w[2][3] w[2][4] w[2][5] w[2][6] w[3][0] w[3][1] w[3][2] w[3][3] w[3][4] w[3][5] w[3][6] w[4][0] w[4][1] w[4][2] w[4][3] w[4][4] w[4][5] w[4][6] w[5][0] w[5][1] w[5][2] w[5][3] w[5][4] w[5][5] w[5][6] w[6][0] w[6][1] w[6][2] w[6][3] w[6][4] w[6][5] w[6][6] </list>
20124.04/2520.02	v <values>43 31 72 71 32 32 67 41 66 60 47 13 72 35 23 44 15 6 73 94 46 42 69 50 90 92 20 95 86 37 75 68 13 93 51 47 89 65 62 27 63 82 93 86 31 62 64 92 17 511 511 460 511 511 494 511 5 70 101 173 380 412 444 7 48 133 272 359 372 476 0 114 158 193 199 278 414 39 81 150 200 290 382 416 23 113 163 238 306 319 460 59 106 195 260 322 349 412 13 109 213 244 338 402 494 380 444 412 5 173 101 70 359 372 476 48 7 272 133 414 278 0 114 158 199 193 200 150 290 416 81 39 382 460 113 23 163 306 319 238 106 59 195 260 349 412 322 13 213 109 338 244 494 402 3 6 5 4 0 2 1 4 3 6 5 0 1 2 2 3 4 6 5 1 0 5 4 1 0 2 6 3 2 1 3 6 4 5 0 1 0 2 3 6 4 5 0 2 1 4 3 6 5 </values>
20124.04/2520.02	v </instantiation>
20124.04/2520.02

Verifier Data 

OK	511

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13968 MiB free)
  memory of node 1: 16384 MiB (14337 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398385-1568597319/watcher-4398385-1568597319 -o /tmp/evaluation-result-4398385-1568597319/solver-4398385-1568597319 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node120-1324111741-488 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398385-1568597319.xml 

running on 8 cores: 0-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=506, runsolver pid=502
Current StackSize limit: 8192 KiB


[startup+0.100351 s]*
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963736/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=634412 memory=25336 CPUtime=0.46 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 7449 0 0 0 45 1 0 0 20 0 9 0 435738184 649637888 6334 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 158603 6334 890 493 0 151908 0
[pid=506/tid=508] ppid=502 vsize=634412 memory=8318255677412212789 CPUtime=0.04 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 507 0 0 0 4 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821189532688 5046873 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=634412 memory=339 CPUtime=0.06 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 6 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821181139592 5082784 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=634412 memory=140534035637832 CPUtime=0.06 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 508 0 0 0 6 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821172747280 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=634412 memory=-1 CPUtime=0.05 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 5 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821164354456 5193710 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=634412 memory=0 CPUtime=0.05 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 5 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821155961872 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=634412 memory=0 CPUtime=0.05 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 5 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821147569168 5103053 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=634412 memory=-1 CPUtime=0.04 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 4 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821139176576 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=634412 memory=0 CPUtime=0.05 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 504 0 0 0 5 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821130783568 5155551 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 0.46 s
Current children cumulated vsize: 634412 KiB
Current children cumulated memory: 25336 KiB

[startup+0.21135 s]*
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963736/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=634412 memory=25336 CPUtime=1.33 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 7449 0 0 0 132 1 0 0 20 0 9 0 435738184 649637888 6334 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 158603 6334 890 493 0 151908 0
[pid=506/tid=508] ppid=502 vsize=634412 memory=8318255677412212789 CPUtime=0.16 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 507 0 0 0 16 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821189532688 5168369 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=634412 memory=339 CPUtime=0.17 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 17 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821181139984 5102851 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=634412 memory=140534035637832 CPUtime=0.17 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 508 0 0 0 17 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821172747280 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=634412 memory=-1 CPUtime=0.16 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 16 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821164354576 5393920 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=634412 memory=0 CPUtime=0.16 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 16 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821155961872 5167529 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=634412 memory=0 CPUtime=0.16 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 16 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821147569168 5186224 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=634412 memory=-1 CPUtime=0.14 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 14 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821139176576 5393965 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=634412 memory=0 CPUtime=0.17 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 504 0 0 0 17 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821130783568 5393938 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 1.33 s
Current children cumulated vsize: 634412 KiB
Current children cumulated memory: 25336 KiB

[startup+0.311349 s]*
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963736/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=634412 memory=25336 CPUtime=2.12 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 7450 0 0 0 211 1 0 0 20 0 9 0 435738184 649637888 6334 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 158603 6334 890 493 0 151908 0
[pid=506/tid=508] ppid=502 vsize=634412 memory=1398722017469774279 CPUtime=0.26 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 507 0 0 0 26 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821189532688 5167901 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=634412 memory=4126316290023845779 CPUtime=0.27 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 27 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821181139984 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=634412 memory=0 CPUtime=0.27 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 509 0 0 0 27 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821172746952 5167923 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=634412 memory=6944656592455097440 CPUtime=0.26 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 26 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821164354576 5393938 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=634412 memory=6656426216303648864 CPUtime=0.26 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 26 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821155961872 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=634412 memory=0 CPUtime=0.26 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 26 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821147569168 5393951 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=634412 memory=0 CPUtime=0.23 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 23 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821139176576 5166672 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=634412 memory=0 CPUtime=0.27 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 504 0 0 0 27 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821130783568 5393965 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 2.12 s
Current children cumulated vsize: 634412 KiB
Current children cumulated memory: 25336 KiB

[startup+0.701347 s]
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963736/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=634412 memory=25336 CPUtime=5.18 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 7459 0 0 0 517 1 0 0 20 0 9 0 435738184 649637888 6334 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 158603 6334 890 493 0 151908 0
[pid=506/tid=508] ppid=502 vsize=634412 memory=25336 CPUtime=0.64 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 507 0 0 0 64 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821189532688 5393965 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=634412 memory=1432 CPUtime=0.65 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 65 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821181139984 5393920 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=634412 memory=776 CPUtime=0.65 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 518 0 0 0 65 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821172746696 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=634412 memory=660 CPUtime=0.64 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 64 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821164354576 5393984 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=634412 memory=1556 CPUtime=0.64 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 64 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821155961872 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=634412 memory=1176 CPUtime=0.64 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 500 0 0 0 64 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821147569168 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=634412 memory=980 CPUtime=0.59 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 501 0 0 0 59 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821139176576 5167256 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=634412 memory=14008 CPUtime=0.65 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 504 0 0 0 65 0 0 0 20 0 9 0 435738188 649637888 6334 33554432000 4194304 6211092 140722171031904 139821130783568 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 5.18 s
Current children cumulated vsize: 634412 KiB
Current children cumulated memory: 25336 KiB

[startup+1.50135 s]
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963668/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=629272 memory=23412 CPUtime=11.57 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 10591 0 0 0 1154 3 0 0 20 0 9 0 435738184 644374528 5853 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 157318 5853 891 493 0 150623 0
[pid=506/tid=508] ppid=502 vsize=629272 memory=980 CPUtime=1.43 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 975 0 0 0 143 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821189532944 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=629272 memory=14008 CPUtime=1.45 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 1043 0 0 0 145 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821181139984 5393970 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=629272 memory=0 CPUtime=1.45 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 717 0 0 0 145 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821172746728 5390416 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=629272 memory=8243114992657236051 CPUtime=1.44 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 958 0 0 0 144 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821164354576 5393920 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=629272 memory=288292164440687406 CPUtime=1.44 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 793 0 0 0 144 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821155961872 5168219 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=629272 memory=4294969536 CPUtime=1.44 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 901 0 0 0 144 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821147569168 5193710 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=629272 memory=2244 CPUtime=1.38 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 836 0 0 0 138 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821139176776 5393951 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=629272 memory=4713745541279610410 CPUtime=1.44 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 941 0 0 0 144 0 0 0 20 0 9 0 435738188 644374528 5853 33554432000 4194304 6211092 140722171031904 139821130783872 5193708 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 11.57 s
Current children cumulated vsize: 629272 KiB
Current children cumulated memory: 23412 KiB

[startup+3.11035 s]
/proc/loadavg: 0.98 1.01 1.22 9/199 515
/proc/meminfo: memFree=28963392/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=21768 CPUtime=24.41 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 13259 0 0 0 2438 3 0 0 20 0 9 0 435738184 641216512 5442 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5442 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=21752 CPUtime=3.04 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 1250 0 0 0 304 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821189532688 5193733 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=21752 CPUtime=3.05 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 1243 0 0 0 305 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821181140296 5193696 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=164 CPUtime=3.06 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 1152 0 0 0 306 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821172746936 5167529 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=4294969536 CPUtime=3.05 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 1214 0 0 0 305 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821164354832 5167521 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=2244 CPUtime=3.05 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 1168 0 0 0 305 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821155962184 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=21752 CPUtime=3.05 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 1090 0 0 0 305 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821147569480 5167521 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=53096 CPUtime=2.96 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 1270 0 0 0 296 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821139176776 5017472 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=984 CPUtime=3.05 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 1445 0 0 0 305 0 0 0 20 0 9 0 435738188 641216512 5442 33554432000 4194304 6211092 140722171031904 139821130783664 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 24.41 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 21768 KiB

[startup+6.30135 s]
/proc/loadavg: 1.22 1.06 1.23 9/199 515
/proc/meminfo: memFree=28964776/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=21772 CPUtime=49.89 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 19266 0 0 0 4986 3 0 0 20 0 9 0 435738184 641216512 5443 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5443 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=21772 CPUtime=6.23 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 1868 0 0 0 623 0 0 0 20 0 9 0 435738188 641216512 5443 33554432000 4194304 6211092 140722171031904 139821189532688 5193696 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=140538330576511 CPUtime=6.24 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 1872 0 0 0 624 0 0 0 20 0 9 0 435738188 641216512 5443 33554432000 4194304 6211092 140722171031904 139821181140296 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=281067760165472 CPUtime=6.24 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 1791 0 0 0 624 0 0 0 20 0 9 0 435738188 641216512 5443 33554432000 4194304 6211092 140722171031904 139821172746936 5393920 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=0 CPUtime=6.24 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 1982 0 0 0 624 0 0 0 20 0 9 0 435738188 641216512 5443 33554432000 4194304 6211092 140722171031904 139821164354832 5393920 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0

################
# More data... #
################

/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 11553 0 0 0 225106 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5168192 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=22076 CPUtime=2256.36 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 11236 0 0 0 225635 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5168192 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=22076 CPUtime=2261.99 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12215 0 0 0 226199 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5167521 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=22076 CPUtime=2261.03 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 12692 0 0 0 226102 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5102758 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=22076 CPUtime=2249.36 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13065 0 0 0 224933 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5393984 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=22076 CPUtime=2262.03 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 13520 0 0 0 226202 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5103115 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 18066 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB

[startup+2322.3 s]
/proc/loadavg: 8.63 8.40 7.75 9/199 745
/proc/meminfo: memFree=28966532/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=22076 CPUtime=18545.2 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 102008 0 0 0 1854506 14 0 0 20 0 9 0 435738184 641216512 5519 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5519 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=22076 CPUtime=2322.02 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 11258 0 0 0 232201 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821189532688 5167507 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=22076 CPUtime=2322.02 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 12157 0 0 0 232202 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821181140296 5390156 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=22076 CPUtime=2311.08 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 11720 0 0 0 231106 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5168192 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=984 CPUtime=2315.56 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 11396 0 0 0 231555 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=22076 CPUtime=2321.99 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12325 0 0 0 232199 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=22076 CPUtime=2321.02 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 12859 0 0 0 232101 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5167892 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=22076 CPUtime=2309.36 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13187 0 0 0 230933 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=22076 CPUtime=2322.03 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 13679 0 0 0 232202 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5102734 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 18545.2 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB

[startup+2382.3 s]
/proc/loadavg: 8.38 8.38 7.79 9/199 751
/proc/meminfo: memFree=28966604/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=22076 CPUtime=19024.3 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 104281 0 0 0 1902420 14 0 0 20 0 9 0 435738184 641216512 5519 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5519 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=22076 CPUtime=2382.01 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 11548 0 0 0 238200 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821189532688 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=22076 CPUtime=2382.02 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 12473 0 0 0 238202 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821181140296 5393965 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=22076 CPUtime=2371.07 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 11976 0 0 0 237105 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5193696 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=22076 CPUtime=2374.77 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 11627 0 0 0 237476 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5167542 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=22076 CPUtime=2381.97 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12589 0 0 0 238197 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=22076 CPUtime=2381.02 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 13231 0 0 0 238101 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5168216 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=22076 CPUtime=2369.35 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13409 0 0 0 236932 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5207585 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=5996 CPUtime=2382.01 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 14001 0 0 0 238200 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5102815 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 19024.3 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB

[startup+2442.3 s]
/proc/loadavg: 8.14 8.31 7.80 9/199 754
/proc/meminfo: memFree=28966148/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=22076 CPUtime=19503.5 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 106490 0 0 0 1950338 14 0 0 20 0 9 0 435738184 641216512 5519 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5519 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=22076 CPUtime=2442.01 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 11859 0 0 0 244200 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821189532688 5186273 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=22076 CPUtime=2441.99 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 12778 0 0 0 244199 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821181140296 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=22076 CPUtime=2431.06 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 12198 0 0 0 243104 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5393970 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=22076 CPUtime=2434.01 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 11908 0 0 0 243399 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5193696 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=22076 CPUtime=2441.96 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12826 0 0 0 244196 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=22076 CPUtime=2441.02 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 13578 0 0 0 244101 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=22076 CPUtime=2429.35 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13638 0 0 0 242932 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5193696 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=22076 CPUtime=2442.01 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 14278 0 0 0 244200 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5193696 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 19503.5 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB

[startup+2502.3 s]
/proc/loadavg: 8.05 8.26 7.81 9/200 765
/proc/meminfo: memFree=28966492/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=22076 CPUtime=19982.7 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 107599 0 0 0 1998251 14 0 0 20 0 9 0 435738184 641216512 5519 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5519 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=22076 CPUtime=2502.01 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 12015 0 0 0 250200 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821189532688 5393920 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=22076 CPUtime=2501.99 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 12876 0 0 0 250199 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821181140296 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=22076 CPUtime=2491.04 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 12334 0 0 0 249102 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5167559 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=22076 CPUtime=2493.22 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 12027 0 0 0 249320 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5167507 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=22076 CPUtime=2501.94 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12983 0 0 0 250194 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5167574 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=22076 CPUtime=2501 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 13730 0 0 0 250099 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5167904 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=22076 CPUtime=2489.34 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13742 0 0 0 248931 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5103042 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=22076 CPUtime=2502 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 14465 0 0 0 250199 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 19982.7 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.04 8.24 7.82 9/200 768
/proc/meminfo: memFree=28967036/32770688 swapFree=66919992/67108860
[pid=506] ppid=502 vsize=626188 memory=22076 CPUtime=20124 cores=0-7
/proc/506/stat : 506 (cosoco) S 502 506 460 0 -1 1077944320 107615 0 0 0 2012390 14 0 0 20 0 9 0 435738184 641216512 5519 33554432000 4194304 6211092 140722171031904 140722171030160 139821212675831 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
/proc/506/statm: 156547 5519 892 493 0 149852 0
[pid=506/tid=508] ppid=502 vsize=626188 memory=1724 CPUtime=2519.72 cores=0-7
/proc/506/task/508/stat : 508 (cosoco) R 502 506 460 0 -1 4202560 12017 0 0 0 251971 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821189532688 5167892 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=509] ppid=502 vsize=626188 memory=1964 CPUtime=2519.7 cores=0-7
/proc/506/task/509/stat : 509 (cosoco) R 502 506 460 0 -1 4202560 12879 0 0 0 251970 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821181140296 5393970 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=510] ppid=502 vsize=626188 memory=4126316290023845779 CPUtime=2508.75 cores=0-7
/proc/506/task/510/stat : 510 (cosoco) R 502 506 460 0 -1 4202560 12334 0 0 0 250873 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821172747536 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=511] ppid=502 vsize=626188 memory=924 CPUtime=2510.68 cores=0-7
/proc/506/task/511/stat : 511 (cosoco) R 502 506 460 0 -1 4202560 12027 0 0 0 251066 2 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821164354576 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=512] ppid=502 vsize=626188 memory=1444 CPUtime=2519.65 cores=0-7
/proc/506/task/512/stat : 512 (cosoco) R 502 506 460 0 -1 4202560 12994 0 0 0 251965 0 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821155962128 5193696 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=513] ppid=502 vsize=626188 memory=1764 CPUtime=2518.71 cores=0-7
/proc/506/task/513/stat : 513 (cosoco) R 502 506 460 0 -1 4202560 13730 0 0 0 251870 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821147569424 5393984 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=514] ppid=502 vsize=626188 memory=111632 CPUtime=2507.05 cores=0-7
/proc/506/task/514/stat : 514 (cosoco) R 502 506 460 0 -1 4202560 13742 0 0 0 250702 3 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821139176464 5168363 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
[pid=506/tid=515] ppid=502 vsize=626188 memory=800 CPUtime=2519.71 cores=0-7
/proc/506/task/515/stat : 515 (cosoco) R 502 506 460 0 -1 4202560 14465 0 0 0 251970 1 0 0 20 0 9 0 435738188 641216512 5519 33554432000 4194304 6211092 140722171031904 139821130783752 5168225 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 36474880 140722171040785 140722171040877 140722171040877 140722171043790 0
Current children cumulated CPU time: 20124 s
Current children cumulated vsize: 626188 KiB
Current children cumulated memory: 22076 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 506 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20124 s, system=0.147925 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.03
CPU time (s): 20124.2
CPU user time (s): 20124
CPU system time (s): 0.147925
CPU usage (%): 798.571
Max. virtual memory (cumulated for all children) (KiB): 634412
Max. memory (cumulated for all children) (KiB): 26220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20124
system time used= 0.147925
maximum resident set size= 26220
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 107668
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1267
involuntary context switches= 179441


# summary of solver processes directly reported to runsolver:
#   pid: 506
#   total CPU time (s): 20124.2
#   total CPU user time (s): 20124
#   total CPU system time (s): 0.147925

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.016 second user time and 20.7683 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-17 09:49:01
IDJOB=4398385
IDBENCH=115852
IDSOLVER=2851
FILE ID=node120/4398385-1568597319
RUNJOBID= node120-1324111741-488
PBS_JOBID= 21703407
Free space on /tmp= 61656 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-os-taillard/Taillard-os-07-07-8.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398385-1568597319/watcher-4398385-1568597319 -o /tmp/evaluation-result-4398385-1568597319/solver-4398385-1568597319 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node120-1324111741-488 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398385-1568597319.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3801e67c429176a130b0cb7922d17a7f
RANDOM SEED=471701908

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        28985084 kB
MemAvailable:   31827888 kB
Buffers:          196456 kB
Cached:          2950972 kB
SwapCached:        77548 kB
Active:          1338448 kB
Inactive:        1890212 kB
Active(anon):       3584 kB
Inactive(anon):   127580 kB
Active(file):    1334864 kB
Inactive(file):  1762632 kB
Unevictable:      107500 kB
Mlocked:          107500 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:              2948 kB
Writeback:             0 kB
AnonPages:        112348 kB
Mapped:            50988 kB
Shmem:             41008 kB
Slab:             151240 kB
SReclaimable:     122288 kB
SUnreclaim:        28952 kB
KernelStack:        3408 kB
PageTables:         5100 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     514412 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61652 MiB
End job on node120 at 2011-12-17 10:31:01