Trace number 4398600

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)3 2011.79 252.022

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-11-011-005.xml
MD5SUM7a6a01f2d694ae1725dbabce720210ef
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark1.31481
Satisfiable
(Un)Satisfiability was proved
Number of variables122
Number of constraints67
Number of domains2
Minimum domain size2
Maximum domain size10
Distribution of domain sizes[{"size":2,"count":121},{"size":10,"count":1}]
Minimum variable degree12
Maximum variable degree56
Distribution of variable degrees[{"degree":12,"count":121},{"degree":56,"count":1}]
Minimum constraint arity11
Maximum constraint arity121
Distribution of constraint arities[{"arity":11,"count":11},{"arity":23,"count":55},{"arity":121,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":66}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

1.62/0.39	c
1.62/0.39	c This is cosoco 2.00 --  
1.62/0.39	c
1.62/0.39	c command line: cosoco -model -nbcores=8 HOME/instance-4398600-1568607926.xml 
1.62/0.39	c enable optimization
1.62/0.39	c ========================================[ Problem Statistics ]===========================================
1.62/0.39	c |                                                                                                       
1.62/0.39	c |  Parse time        :         0.12 s 
1.62/0.39	c |
1.62/0.39	c |               Variables: 122
1.62/0.39	c |            Domain Sizes: 2..10
1.62/0.39	c |
1.62/0.39	c |             Constraints: 87
1.62/0.39	c |                   Arity: 1..23  -- Unary: 1
1.62/0.39	c | 
1.62/0.39	c |                   Types: 
1.62/0.39	c |                          Intension: 56
1.62/0.39	c |                          Lex: 20
1.62/0.39	c |                          Sum: 11
1.62/0.39	c |                          
1.62/0.39	c |               Objective: Minimize Intension
1.62/0.39	
1.62/0.39	c =========================================================================================================
1.62/0.39	c Parallel mode: Portfolio
1.62/0.39	c [pFactory][Group N°0] created (threads:8).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
1.62/0.39	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
1.62/0.39	c [pFactory][Group N°0] concurrent mode: enabled.
1.62/0.39	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
1.62/0.39	c [pFactory][Group N°0] task 7 launched on thread 7.
1.62/0.39	c [pFactory][Group N°0] task 6 launched on thread 1.
1.62/0.39	c [pFactory][Group N°0] task 5 launched on thread 0.
1.62/0.39	c [pFactory][Group N°0] task 4 launched on thread 3.
1.62/0.39	c [pFactory][Group N°0] task 3 launched on thread 2.
1.62/0.39	c [pFactory][Group N°0] task 2 launched on thread 5.
1.62/0.39	c [pFactory][Group N°0] task 1 launched on thread 6.
1.62/0.39	c [pFactory][Group N°0] task 0 launched on thread 4.
1.62/0.39	o 5
3.20/0.52	o 4
24.61/3.22	o 3
2011.70/252.02	
2011.70/252.02	c *** INTERRUPTED ***
2011.70/252.02	c call to solver        : 2
2011.70/252.02	c
2011.70/252.02	c restarts              : 519         
2011.70/252.02	c conflicts             : 6068         (3 /sec)
2011.70/252.02	c decisions             : 43960        (22 /sec)
2011.70/252.02	c propagations          : 165533      (82 /sec)
2011.70/252.02	c root propagations     : 286         
2011.70/252.02	c filter calls          : 1027228        (511 /sec)
2011.70/252.02	c useless filter calls  : 972730         (94 %)
2011.70/252.02	c Memory used           : 608.12 MB
2011.70/252.02	c Best bound time (wc)  : 3.21906 s
2011.70/252.02	c CPU time              : 2011.74 s
2011.70/252.02	c real time             : 252.015 s
2011.70/252.02	
2011.70/252.02	s SATISFIABLE
2011.70/252.02	c Best value found: 3
2011.70/252.02	
2011.70/252.02	
2011.70/252.02	v <instantiation type='solution' cost='3'>
2011.70/252.02	v <list>x[0][0] x[0][10] x[0][1] x[0][2] x[0][3] x[0][4] x[0][5] x[0][6] x[0][7] x[0][8] x[0][9] x[10][0] x[10][10] x[10][1] x[10][2] x[10][3] x[10][4] x[10][5] x[10][6] x[10][7] x[10][8] x[10][9] x[1][0] x[1][10] x[1][1] x[1][2] x[1][3] x[1][4] x[1][5] x[1][6] x[1][7] x[1][8] x[1][9] x[2][0] x[2][10] x[2][1] x[2][2] x[2][3] x[2][4] x[2][5] x[2][6] x[2][7] x[2][8] x[2][9] x[3][0] x[3][10] x[3][1] x[3][2] x[3][3] x[3][4] x[3][5] x[3][6] x[3][7] x[3][8] x[3][9] x[4][0] x[4][10] x[4][1] x[4][2] x[4][3] x[4][4] x[4][5] x[4][6] x[4][7] x[4][8] x[4][9] x[5][0] x[5][10] x[5][1] x[5][2] x[5][3] x[5][4] x[5][5] x[5][6] x[5][7] x[5][8] x[5][9] x[6][0] x[6][10] x[6][1] x[6][2] x[6][3] x[6][4] x[6][5] x[6][6] x[6][7] x[6][8] x[6][9] x[7][0] x[7][10] x[7][1] x[7][2] x[7][3] x[7][4] x[7][5] x[7][6] x[7][7] x[7][8] x[7][9] x[8][0] x[8][10] x[8][1] x[8][2] x[8][3] x[8][4] x[8][5] x[8][6] x[8][7] x[8][8] x[8][9] x[9][0] x[9][10] x[9][1] x[9][2] x[9][3] x[9][4] x[9][5] x[9][6] x[9][7] x[9][8] x[9][9] z </list>
2011.70/252.02	v <values>0 1 0 0 0 0 0 1 1 1 1 1 0 0 1 0 1 0 0 0 1 1 0 1 0 1 1 1 1 0 0 0 0 0 1 1 0 0 1 1 0 0 0 1 0 1 1 0 1 0 0 0 1 1 0 0 0 1 0 1 0 1 0 0 1 1 0 1 1 1 0 0 0 1 1 0 0 0 0 1 1 0 1 1 0 1 0 0 1 0 0 0 0 1 1 0 1 0 1 1 0 0 0 1 0 0 1 1 0 1 1 0 0 0 1 1 0 0 1 1 0 3 </values>
2011.70/252.02	v </instantiation>
2011.70/252.02

Verifier Data 

OK	3

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14026 MiB free)
  memory of node 1: 16384 MiB (15506 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398600-1568607926/watcher-4398600-1568607926 -o /tmp/evaluation-result-4398600-1568607926/solver-4398600-1568607926 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node150-1568597343-23918 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4398600-1568607926.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=25406, runsolver pid=25403
Current StackSize limit: 8192 KiB


[startup+0.100139 s]*
/proc/loadavg: 8.25 8.33 8.15 2/193 25407
/proc/meminfo: memFree=30237668/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=31800 memory=8124 CPUtime=0.1 cores=0-7
/proc/25406/stat : 25406 (cosoco) R 25403 25406 23891 0 -1 4202496 2241 0 0 0 10 0 0 0 20 0 1 0 437065177 32563200 2031 33554432000 4194304 6211092 140722613748208 140722613744744 140578420603877 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 7950 2031 849 493 0 1255 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31800 KiB
Current children cumulated memory: 8124 KiB

[startup+0.210291 s]*
/proc/loadavg: 8.25 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30235212/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=10732 CPUtime=0.83 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 3188 0 0 0 83 0 0 0 20 0 9 0 437065177 637652992 2683 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 2683 880 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=8316850467074736180 CPUtime=0.09 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 88 0 0 0 9 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578413501096 5452161 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=13898 CPUtime=0.09 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 60 0 0 0 9 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578405108752 5439828 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=3547068120806700704 CPUtime=0.09 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 58 0 0 0 9 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578396715448 140578421528112 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=-1 CPUtime=0.09 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 75 0 0 0 9 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578388323936 5446643 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=0 CPUtime=0.08 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 92 0 0 0 8 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578379930280 5164759 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=0 CPUtime=0.09 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 58 0 0 0 9 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578371537576 5455658 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=-1 CPUtime=0.08 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 92 0 0 0 8 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578363144872 5069024 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=0 CPUtime=0.08 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 98 0 0 0 8 0 0 0 20 0 9 0 437065189 637652992 2683 33554432000 4194304 6211092 140722613748208 140578354752104 140578421530015 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 0.83 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 10732 KiB

[startup+0.310289 s]*
/proc/loadavg: 8.25 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30234840/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=11512 CPUtime=1.62 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 3286 0 0 0 162 0 0 0 20 0 9 0 437065177 637652992 2878 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 2878 881 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=6935054825532540783 CPUtime=0.19 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578413501096 5164809 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 74 0 0 0 19 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578405108752 5443000 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 85 0 0 0 19 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578396715448 5454188 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 84 0 0 0 19 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578388323936 5456310 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=0 CPUtime=0.18 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 94 0 0 0 18 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578379930280 140578430548824 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578371537576 5446614 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=0 CPUtime=0.18 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 94 0 0 0 18 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578363144888 5451500 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=0 CPUtime=0.17 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 100 0 0 0 17 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578354752184 5452234 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 1.62 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 11512 KiB

[startup+0.701299 s]
/proc/loadavg: 8.25 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30234096/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=11512 CPUtime=4.65 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 3456 0 0 0 465 0 0 0 20 0 9 0 437065177 637652992 2878 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 2878 881 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=1612 CPUtime=0.57 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 116 0 0 0 57 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578413501032 140578430548824 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=1224 CPUtime=0.57 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 112 0 0 0 57 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578405108744 140578421530061 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=3824 CPUtime=0.57 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 107 0 0 0 57 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578396715688 5441131 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=1384 CPUtime=0.57 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 112 0 0 0 57 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578388322984 4982624 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=15080 CPUtime=0.56 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 109 0 0 0 56 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578379930216 5446260 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=140151037081215 CPUtime=0.57 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 103 0 0 0 57 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578371537512 5452207 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=4639382061002810730 CPUtime=0.56 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 109 0 0 0 56 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578363144872 5456310 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=4643330398634797931 CPUtime=0.53 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 121 0 0 0 53 0 0 0 20 0 9 0 437065189 637652992 2878 33554432000 4194304 6211092 140722613748208 140578354752168 140578430548814 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 4.65 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 11512 KiB

[startup+1.5013 s]
/proc/loadavg: 8.25 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30234208/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13140 CPUtime=11.04 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 5805 0 0 0 1103 1 0 0 20 0 9 0 437065177 637652992 3285 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3285 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=0 CPUtime=1.37 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 398 0 0 0 137 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578413501096 140578421524384 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=-6519613052471072158 CPUtime=1.36 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 377 0 0 0 136 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578405108136 5451482 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=0 CPUtime=1.37 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 277 0 0 0 137 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578396715688 140578421524401 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=3617431392748653753 CPUtime=1.37 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 440 0 0 0 137 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578388322744 5446185 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=-7737643479190322274 CPUtime=1.35 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 427 0 0 0 135 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578379930040 5065987 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=140144782868481 CPUtime=1.37 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 483 0 0 0 137 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578371537320 5164901 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=140149077836191 CPUtime=1.36 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 398 0 0 0 136 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578363144808 5164809 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=140149077836213 CPUtime=1.32 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 438 0 0 0 132 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578354752168 5440624 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 11.04 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13140 KiB

[startup+3.1103 s]
/proc/loadavg: 8.23 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30234616/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13140 CPUtime=23.89 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 5863 0 0 0 2388 1 0 0 20 0 9 0 437065177 637652992 3285 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3285 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=0 CPUtime=2.98 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 399 0 0 0 298 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578413500840 5451521 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=2865 CPUtime=2.97 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 381 0 0 0 297 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578405108392 5451572 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=13140 CPUtime=2.98 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 299 0 0 0 298 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578396715624 5478689 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=15080 CPUtime=2.98 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 451 0 0 0 298 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578388322744 5451482 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=12504 CPUtime=2.96 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 439 0 0 0 296 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578379930072 5451591 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=2676 CPUtime=2.98 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 485 0 0 0 298 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578371537576 5164745 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=280293189740376 CPUtime=2.97 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 400 0 0 0 297 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578363144872 5455650 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=111293004516074 CPUtime=2.91 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 442 0 0 0 291 0 0 0 20 0 9 0 437065189 637652992 3285 33554432000 4194304 6211092 140722613748208 140578354752168 5443096 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 23.89 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13140 KiB

[startup+6.3013 s]
/proc/loadavg: 8.23 8.33 8.15 9/201 25415
/proc/meminfo: memFree=30234744/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13336 CPUtime=49.38 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 12692 0 0 0 4936 2 0 0 20 0 9 0 437065177 637652992 3334 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3334 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=13284 CPUtime=6.17 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 1205 0 0 0 617 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578413501096 5446279 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=13794 CPUtime=6.16 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 1245 0 0 0 616 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578405108328 5453912 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=13328 CPUtime=6.17 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 1137 0 0 0 617 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578396715624 140578430548800 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=2676 CPUtime=6.17 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 1411 0 0 0 617 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578388322920 5442993 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=0 CPUtime=6.15 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 1350 0 0 0 615 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578379930072 140578421524384 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=13854 CPUtime=6.17 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 1114 0 0 0 617 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578371537576 5452234 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=4120 CPUtime=6.16 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 1200 0 0 0 616 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578363144808 5478701 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=30732 CPUtime=6.05 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 1463 0 0 0 605 0 0 0 20 0 9 0 437065189 637652992 3334 33554432000 4194304 6211092 140722613748208 140578354751912 5440620 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 49.38 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13336 KiB

[startup+12.7013 s]
/proc/loadavg: 8.21 8.32 8.15 9/201 25415
/proc/meminfo: memFree=30233536/32770624 swapFree=67026168/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13368 CPUtime=100.49 cores=0-7

################
# More data... #
################

/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 1846 0 0 0 2536 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578396715624 5442993 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=13412 CPUtime=25.37 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 2387 0 0 0 2537 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578388322920 5451507 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=249249837139588 CPUtime=25.35 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 2494 0 0 0 2535 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578379930040 5441090 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=13412 CPUtime=25.36 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 2282 0 0 0 2536 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578371537320 5164745 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=7739828946531871335 CPUtime=25.35 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 1946 0 0 0 2535 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578363144616 5446226 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=6446745912524 CPUtime=25.02 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 2323 0 0 0 2502 0 0 0 20 0 9 0 437065189 637652992 3354 33554432000 4194304 6211092 140722613748208 140578354751912 5446279 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 202.71 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13416 KiB

[startup+51.1103 s]
/proc/loadavg: 8.11 8.28 8.14 9/199 25419
/proc/meminfo: memFree=30234664/32770624 swapFree=67026172/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13428 CPUtime=407.23 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 25090 0 0 0 40720 3 0 0 20 0 9 0 437065177 637652992 3357 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3357 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=0 CPUtime=50.97 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 2711 0 0 0 5097 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578413500856 5164749 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=13428 CPUtime=50.96 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 2751 0 0 0 5096 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578405108136 140578421527386 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=4120 CPUtime=50.97 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 2369 0 0 0 5097 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578396715432 5446649 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=56 CPUtime=50.97 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 3061 0 0 0 5097 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578388322728 5072412 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=0 CPUtime=50.96 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 3151 0 0 0 5096 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578379930040 5443112 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=1296 CPUtime=50.96 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 2869 0 0 0 5096 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578371537320 5478686 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=13428 CPUtime=50.96 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 2600 0 0 0 5096 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578363144616 5451482 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=6944656425123485561 CPUtime=50.3 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 3011 0 0 0 5030 0 0 0 20 0 9 0 437065189 637652992 3357 33554432000 4194304 6211092 140722613748208 140578354751912 5446267 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 407.23 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13428 KiB

[startup+102.301 s]
/proc/loadavg: 8.05 8.24 8.13 9/199 25422
/proc/meminfo: memFree=30234988/32770624 swapFree=67026172/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13436 CPUtime=816.08 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 29972 0 0 0 81604 4 0 0 20 0 9 0 437065177 637652992 3359 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3359 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=13436 CPUtime=102.15 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 3205 0 0 0 10215 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578413500840 5443096 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=0 CPUtime=102.14 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 3392 0 0 0 10214 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578405108328 5476810 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=0 CPUtime=102.14 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 3015 0 0 0 10214 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578396715624 5451500 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=280293189816544 CPUtime=102.16 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 3675 0 0 0 10216 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578388322728 140578421528126 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=56 CPUtime=102.13 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 3812 0 0 0 10213 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578379930040 5442964 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=280293189702080 CPUtime=102.15 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 3427 0 0 0 10215 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578371537320 5456310 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=2184 CPUtime=102.15 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 3181 0 0 0 10215 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578363144616 5451576 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=1844 CPUtime=100.86 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 3698 0 0 0 10086 0 0 0 20 0 9 0 437065189 637652992 3359 33554432000 4194304 6211092 140722613748208 140578354752104 140578421524401 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 816.08 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13436 KiB

[startup+162.301 s]
/proc/loadavg: 8.49 8.32 8.17 9/199 25427
/proc/meminfo: memFree=30235228/32770624 swapFree=67026172/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13456 CPUtime=1295.25 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 32432 0 0 0 129521 4 0 0 20 0 9 0 437065177 637652992 3364 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3364 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=13456 CPUtime=162.14 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 3446 0 0 0 16214 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578413500840 5451536 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=13456 CPUtime=162.12 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 3778 0 0 0 16212 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578405108152 140578430548820 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=13456 CPUtime=162.14 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 3285 0 0 0 16214 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578396715624 5446185 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=13432 CPUtime=162.13 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 4012 0 0 0 16213 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578388322728 140578421528140 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=4120 CPUtime=162.13 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 4097 0 0 0 16213 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578379930040 140578430548840 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=13436 CPUtime=162.14 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 3743 0 0 0 16214 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578371537320 140578430548879 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=13456 CPUtime=162.14 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 3537 0 0 0 16214 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578363144616 5451601 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=13456 CPUtime=160.11 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 3967 0 0 0 16011 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578354752104 5443042 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 1295.25 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13456 KiB

[startup+222.301 s]
/proc/loadavg: 8.68 8.40 8.20 9/199 25431
/proc/meminfo: memFree=30234624/32770624 swapFree=67026172/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13456 CPUtime=1774.43 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 34872 0 0 0 177439 4 0 0 20 0 9 0 437065177 637652992 3364 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3364 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=13456 CPUtime=222.14 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 3761 0 0 0 22214 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578413500840 140578421524387 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=13456 CPUtime=222.11 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 4110 0 0 0 22211 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578405108152 5164805 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=13456 CPUtime=222.12 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 3548 0 0 0 22212 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578396715624 5446279 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=13456 CPUtime=222.13 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 4290 0 0 0 22213 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578388322728 5443111 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=13456 CPUtime=222.12 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 4406 0 0 0 22212 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578379930040 5454176 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=2676 CPUtime=222.12 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 4049 0 0 0 22212 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578371537320 5446260 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=13456 CPUtime=222.13 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 3913 0 0 0 22213 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578363144616 140578421530035 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=13456 CPUtime=219.37 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 4228 0 0 0 21937 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578354752104 140578430548874 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 1774.43 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13456 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]*
/proc/loadavg: 8.46 8.38 8.20 9/199 25433
/proc/meminfo: memFree=30234720/32770624 swapFree=67026172/67108860
[pid=25406] ppid=25403 vsize=622708 memory=13456 CPUtime=2011.7 cores=0-7
/proc/25406/stat : 25406 (cosoco) S 25403 25406 23891 0 -1 1077944320 37312 0 0 0 201165 5 0 0 20 0 9 0 437065177 637652992 3364 33554432000 4194304 6211092 140722613748208 140722613746464 140578436644599 0 0 4096 8405026 18446744073709551615 0 0 17 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
/proc/25406/statm: 155677 3364 882 493 0 148982 0
[pid=25406/tid=25408] ppid=25403 vsize=622708 memory=6935054825532540783 CPUtime=251.84 cores=0-7
/proc/25406/task/25408/stat : 25408 (cosoco) R 25403 25406 23891 0 -1 4202560 4063 0 0 0 25184 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578413500840 5452161 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25409] ppid=25403 vsize=622708 memory=6935054825532540783 CPUtime=251.81 cores=0-7
/proc/25406/task/25409/stat : 25409 (cosoco) R 25403 25406 23891 0 -1 4202560 4453 0 0 0 25181 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578405108152 5454176 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25410] ppid=25403 vsize=622708 memory=30748 CPUtime=251.82 cores=0-7
/proc/25406/task/25410/stat : 25410 (cosoco) R 25403 25406 23891 0 -1 4202560 3966 0 0 0 25182 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578396715624 140578421524401 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25411] ppid=25403 vsize=622708 memory=1296 CPUtime=251.83 cores=0-7
/proc/25406/task/25411/stat : 25411 (cosoco) R 25403 25406 23891 0 -1 4202560 4497 0 0 0 25183 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578388322728 5451482 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25412] ppid=25403 vsize=622708 memory=2184 CPUtime=251.83 cores=0-7
/proc/25406/task/25412/stat : 25412 (cosoco) R 25403 25406 23891 0 -1 4202560 4722 0 0 0 25183 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578379930040 140578430548806 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25413] ppid=25403 vsize=622708 memory=13456 CPUtime=251.83 cores=0-7
/proc/25406/task/25413/stat : 25413 (cosoco) R 25403 25406 23891 0 -1 4202560 4279 0 0 0 25183 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578371537320 5441090 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25414] ppid=25403 vsize=622708 memory=1572 CPUtime=251.83 cores=0-7
/proc/25406/task/25414/stat : 25414 (cosoco) R 25403 25406 23891 0 -1 4202560 4245 0 0 0 25183 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578363144616 5440580 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
[pid=25406/tid=25415] ppid=25403 vsize=622708 memory=872 CPUtime=248.7 cores=0-7
/proc/25406/task/25415/stat : 25415 (cosoco) R 25403 25406 23891 0 -1 4202560 4520 0 0 0 24870 0 0 0 20 0 9 0 437065189 637652992 3364 33554432000 4194304 6211092 140722613748208 140578354752104 5454188 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 20623360 140722613752854 140722613752946 140722613752946 140722613755854 0
Current children cumulated CPU time: 2011.7 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13456 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.022 s]
# the end of solver process 25406 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2011.74 s, system=0.052973 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.022
CPU time (s): 2011.79
CPU user time (s): 2011.74
CPU system time (s): 0.052973
CPU usage (%): 798.261
Max. virtual memory (cumulated for all children) (KiB): 622708
Max. memory (cumulated for all children) (KiB): 13456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2011.74
system time used= 0.052973
maximum resident set size= 13700
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37363
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 66
involuntary context switches= 16628


# summary of solver processes directly reported to runsolver:
#   pid: 25406
#   total CPU time (s): 2011.79
#   total CPU user time (s): 2011.74
#   total CPU system time (s): 0.052973

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.14505 second user time and 1.98042 second system time

The end

Launcher Data 

Begin job on node150 at 2019-09-16 06:24:46
IDJOB=4398600
IDBENCH=122977
IDSOLVER=2852
FILE ID=node150/4398600-1568607926
RUNJOBID= node150-1568597343-23918
PBS_JOBID= 21703409
Free space on /tmp= 59368 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-11-011-005.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398600-1568607926/watcher-4398600-1568607926 -o /tmp/evaluation-result-4398600-1568607926/solver-4398600-1568607926 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node150-1568597343-23918 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4398600-1568607926.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7a6a01f2d694ae1725dbabce720210ef
RANDOM SEED=117966969

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30242436 kB
MemAvailable:   31839988 kB
Buffers:          189592 kB
Cached:          1668984 kB
SwapCached:        11740 kB
Active:           825548 kB
Inactive:        1077768 kB
Active(anon):       4868 kB
Inactive(anon):    78292 kB
Active(file):     820680 kB
Inactive(file):   999476 kB
Unevictable:      109652 kB
Mlocked:          109652 kB
SwapTotal:      67108860 kB
SwapFree:       67026168 kB
Dirty:              2652 kB
Writeback:             0 kB
AnonPages:        161872 kB
Mapped:            44608 kB
Shmem:             29656 kB
Slab:             215728 kB
SReclaimable:     186460 kB
SUnreclaim:        29268 kB
KernelStack:        3296 kB
PageTables:         5052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505924 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     86016 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       99712 kB
DirectMap2M:    33445888 kB

Free space on /tmp at the end= 59368 MiB
End job on node150 at 2019-09-16 06:28:58