Trace number 4409938

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)93 2012.68 252.022

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n15/
TravellingSalesman-15-30-00.xml
MD5SUM0f9f8d62bc132272af22ef8ddad99d7d
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark93
Best CPU time to get the best result obtained on this benchmark108.124
Satisfiable
(Un)Satisfiability was proved
Number of variables30
Number of constraints16
Number of domains2
Minimum domain size15
Maximum domain size31
Distribution of domain sizes[{"size":15,"count":15},{"size":31,"count":15}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":15},{"degree":3,"count":15}]
Minimum constraint arity3
Maximum constraint arity15
Distribution of constraint arities[{"arity":3,"count":15},{"arity":15,"count":1}]
Number of extensional constraints15
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":15},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -model -nbcores=8 HOME/instance-4409938-1569829922.xml 
0.00/0.01	c enable optimization
0.00/0.01	c ========================================[ Problem Statistics ]===========================================
0.00/0.01	c |                                                                                                       
0.00/0.01	c |  Parse time        :         0.00 s 
0.00/0.01	c |
0.00/0.01	c |               Variables: 30
0.00/0.01	c |            Domain Sizes: 15..31
0.00/0.01	c |
0.00/0.01	c |             Constraints: 17
0.00/0.01	c |                   Arity: 3..15  -- Ternary: 15
0.00/0.01	c | 
0.00/0.01	c |                   Types: 
0.00/0.01	c |                          All Different: 1
0.00/0.01	c |                          Extension: 15  (nb tuples: 210..210) -- (shared: 112)
0.00/0.01	c |                          Sum: 1
0.00/0.01	c |                          
0.00/0.01	c |               Objective: Minimize Sum
0.00/0.01	
0.00/0.01	c =========================================================================================================
0.00/0.01	c Parallel mode: Portfolio
0.00/0.01	c [pFactory][Group N°0] created (threads:8).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.01	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.01	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.01	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.01	c [pFactory][Group N°0] task 7 launched on thread 5.
0.00/0.01	c [pFactory][Group N°0] task 6 launched on thread 1.
0.00/0.01	c [pFactory][Group N°0] task 5 launched on thread 0.
0.00/0.01	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.01	c [pFactory][Group N°0] task 3 launched on thread 2.
0.00/0.01	c [pFactory][Group N°0] task 2 launched on thread 3.
0.00/0.01	c [pFactory][Group N°0] task 1 launched on thread 7.
0.00/0.01	c [pFactory][Group N°0] task 0 launched on thread 4.
0.00/0.01	o 223
0.00/0.01	o 182
0.00/0.02	o 129
0.00/0.02	o 116
0.00/0.02	o 114
0.00/0.04	o 111
0.00/0.09	o 110
0.79/0.14	o 107
2.44/0.34	o 106
7.08/0.93	o 105
11.07/1.47	o 104
11.87/1.51	o 103
11.87/1.59	o 101
19.85/2.50	o 99
31.90/4.11	o 97
55.00/7.00	o 96
78.16/9.80	o 94
101.32/12.76	o 93
2012.56/252.02	
2012.56/252.02	c *** INTERRUPTED ***
2012.56/252.02	c call to solver        : 13
2012.56/252.02	c
2012.56/252.02	c restarts              : 297491      
2012.56/252.02	c conflicts             : 3888989      (1932 /sec)
2012.56/252.02	c decisions             : 8356403      (4152 /sec)
2012.56/252.02	c propagations          : 611458472   (303805 /sec)
2012.56/252.02	c root propagations     : 178         
2012.56/252.02	c filter calls          : 101695562      (50528 /sec)
2012.56/252.02	c useless filter calls  : 57337651       (56 %)
2012.56/252.02	c Memory used           : 603.40 MB
2012.56/252.02	c Best bound time (wc)  : 12.7544 s
2012.56/252.02	c CPU time              : 2012.67 s
2012.56/252.02	c real time             : 252.016 s
2012.56/252.02	
2012.56/252.02	s SATISFIABLE
2012.56/252.02	c Best value found: 93
2012.56/252.02	
2012.56/252.02	
2012.56/252.02	v <instantiation type='solution' cost='93'>
2012.56/252.02	v <list>c[0] c[10] c[11] c[12] c[13] c[14] c[1] c[2] c[3] c[4] c[5] c[6] c[7] c[8] c[9] d[0] d[10] d[11] d[12] d[13] d[14] d[1] d[2] d[3] d[4] d[5] d[6] d[7] d[8] d[9] </list>
2012.56/252.02	v <values>5 4 1 0 2 3 7 9 8 10 14 13 12 11 6 8 4 7 2 2 5 4 9 5 7 15 8 1 8 8 </values>
2012.56/252.02	v </instantiation>
2012.56/252.02

Verifier Data 

OK	93

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14852 MiB free)
  memory of node 1: 16384 MiB (14593 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409938-1569829922/watcher-4409938-1569829922 -o /tmp/evaluation-result-4409938-1569829922/solver-4409938-1569829922 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node119-1569817669-3093 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4409938-1569829922.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=5703, runsolver pid=5700
Current StackSize limit: 8192 KiB


[startup+0.10081 s]*
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30151660/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4480 CPUtime=0.79 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1391 0 0 0 79 0 0 0 20 0 9 0 558906904 632705024 1120 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1120 828 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=-2177352373413752899 CPUtime=0.1 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 7 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877947436304 5079248 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=281010869602040 CPUtime=0.1 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 6 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877939043600 5081189 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=140505510807168 CPUtime=0.1 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877930650808 5037886 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=0 CPUtime=0.09 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 9 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877922258104 5039137 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=0 CPUtime=0.09 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 9 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877913865400 5080801 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=0 CPUtime=0.1 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 13 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877905472784 5250333 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=-1 CPUtime=0.1 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877897080080 5039536 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=0 CPUtime=0.1 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 10 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877888687288 5039038 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 0.79 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4480 KiB

[startup+0.210803 s]*
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30151660/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4480 CPUtime=1.65 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1392 0 0 0 165 0 0 0 20 0 9 0 558906904 632705024 1120 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1120 828 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=0 CPUtime=0.21 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 7 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877947436304 5392661 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=281010869602040 CPUtime=0.21 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 6 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877939043600 5078875 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=140505510807168 CPUtime=0.21 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877930650896 5250266 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=0 CPUtime=0.19 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 19 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877922258104 5158032 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=0 CPUtime=0.2 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 20 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877913865400 5389970 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=0 CPUtime=0.21 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 13 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877905472784 5193776 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=-1 CPUtime=0.21 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877897080080 5009195 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=0 CPUtime=0.21 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 21 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877888687288 5037823 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 1.65 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4480 KiB

[startup+0.309803 s]*
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30151660/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4480 CPUtime=2.44 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1392 0 0 0 244 0 0 0 20 0 9 0 558906904 632705024 1120 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1120 828 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=0 CPUtime=0.3 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 7 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877947436304 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=7959527647934920329 CPUtime=0.3 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 6 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877939043600 5079253 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=140505510807168 CPUtime=0.3 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877930650896 5155946 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=0 CPUtime=0.28 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 28 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877922258104 5193776 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=0 CPUtime=0.3 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877913865400 5037750 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=0 CPUtime=0.3 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 13 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877905472784 5039038 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=0 CPUtime=0.3 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877897080080 5250497 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=0 CPUtime=0.3 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 30 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877888687288 5039029 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 2.44 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4480 KiB

[startup+0.700809 s]
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30151368/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4480 CPUtime=5.48 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1392 0 0 0 548 0 0 0 20 0 9 0 558906904 632705024 1120 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1120 828 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=299060269 CPUtime=0.69 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 7 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877947436304 5081341 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=0 CPUtime=0.69 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 6 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877939043600 5186331 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=988 CPUtime=0.69 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877930650896 5039132 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=2008 CPUtime=0.64 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 64 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877922258104 5397295 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=1052 CPUtime=0.69 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877913865400 5250316 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=776 CPUtime=0.69 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 13 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877905472784 5250307 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=2832 CPUtime=0.69 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 5 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877897080080 5078720 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=668 CPUtime=0.69 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 4 0 0 0 69 0 0 0 20 0 9 0 558906905 632705024 1120 33554432000 4194304 6211132 140730180287840 139877888687288 5039026 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 5.48 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4480 KiB

[startup+1.50081 s]
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30152176/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4532 CPUtime=11.87 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1690 0 0 0 1187 0 0 0 20 0 9 0 558906904 632705024 1133 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1133 836 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=140509805774463 CPUtime=1.49 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 38 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877947436304 5186301 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=988 CPUtime=1.49 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 52 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877939043600 5039149 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=2008 CPUtime=1.49 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 27 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877930650896 5186260 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=299060269 CPUtime=1.42 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 20 0 0 0 142 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877922258104 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=0 CPUtime=1.49 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 35 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877913865400 5193786 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=0 CPUtime=1.49 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 74 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877905472784 5250330 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=140505358971296 CPUtime=1.49 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 36 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877897080080 5081703 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=140505358971392 CPUtime=1.49 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 64 0 0 0 149 0 0 0 20 0 9 0 558906905 632705024 1133 33554432000 4194304 6211132 140730180287840 139877888687288 5038792 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 11.87 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4532 KiB

[startup+3.1098 s]
/proc/loadavg: 7.68 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30152300/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4644 CPUtime=24.71 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 1988 0 0 0 2471 0 0 0 20 0 9 0 558906904 632705024 1161 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1161 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=0 CPUtime=3.1 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 85 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877947436304 5391326 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=4532 CPUtime=3.1 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 89 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877939043600 5078752 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=0 CPUtime=3.1 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 82 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877930650896 5039199 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=0 CPUtime=3.01 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 38 0 0 0 301 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877922258104 5039026 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=0 CPUtime=3.09 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 80 0 0 0 309 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877913865400 5394183 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=55 CPUtime=3.1 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 118 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877905472784 5397255 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=-7313654673739556905 CPUtime=3.1 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 53 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877897080080 5250325 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=3504 CPUtime=3.1 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 99 0 0 0 310 0 0 0 20 0 9 0 558906905 632705024 1161 33554432000 4194304 6211132 140730180287840 139877888687288 5397267 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 24.71 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4644 KiB

[startup+6.30081 s]
/proc/loadavg: 7.70 8.24 8.27 9/199 5712
/proc/meminfo: memFree=30152412/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4684 CPUtime=50.2 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 2595 0 0 0 5020 0 0 0 20 0 9 0 558906904 632705024 1171 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1171 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=0 CPUtime=6.29 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 138 0 0 0 629 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877947436304 5397535 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=140509805774463 CPUtime=6.29 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 167 0 0 0 629 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877939043600 5250321 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=3504 CPUtime=6.29 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 150 0 0 0 629 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877930650896 5157163 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=8248 CPUtime=6.16 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 122 0 0 0 616 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877922258104 5082358 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0

################
# More data... #
################

/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 265 0 0 0 2548 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877930650896 5039038 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=140509805774463 CPUtime=25.12 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 199 0 0 0 2512 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877922258104 5039038 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=3819063685824916065 CPUtime=25.49 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 289 0 0 0 2549 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877913865488 5392378 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=281010718026144 CPUtime=25.49 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 337 0 0 0 2549 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877905472784 5250304 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=8819569139123385389 CPUtime=25.49 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 240 0 0 0 2549 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877897080080 5250316 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=3504 CPUtime=25.48 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 327 0 0 0 2548 0 0 0 20 0 9 0 558906905 632705024 1171 33554432000 4194304 6211132 140730180287840 139877888687376 5250325 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 203.55 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4684 KiB

[startup+51.1098 s]
/proc/loadavg: 7.91 8.22 8.26 9/199 5715
/proc/meminfo: memFree=30151800/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4688 CPUtime=408.07 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 4099 0 0 0 40807 0 0 0 20 0 9 0 558906904 632705024 1172 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1172 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=4684 CPUtime=51.09 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 311 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877947436304 5158055 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=164 CPUtime=51.09 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 361 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877939043600 5396453 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=4684 CPUtime=51.09 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 342 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877930650896 5397255 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=4684 CPUtime=50.39 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 280 0 0 0 5039 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877922258104 5078752 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=520 CPUtime=51.09 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 351 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877913865488 5039026 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=1560 CPUtime=51.1 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 416 0 0 0 5110 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877905472784 5392646 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=4684 CPUtime=51.09 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 309 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877897080080 5394187 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=6492 CPUtime=51.09 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 385 0 0 0 5109 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877888687376 5081401 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 408.07 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4688 KiB

[startup+102.301 s]
/proc/loadavg: 7.96 8.18 8.24 9/199 5718
/proc/meminfo: memFree=30150708/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4688 CPUtime=816.91 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 4713 0 0 0 81691 0 0 0 20 0 9 0 558906904 632705024 1172 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1172 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=4688 CPUtime=102.27 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 379 0 0 0 10227 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877947436304 5039026 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=2257 CPUtime=102.28 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 446 0 0 0 10228 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877939043600 5081337 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=3504 CPUtime=102.28 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 431 0 0 0 10228 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877930650896 5039240 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=10560 CPUtime=100.93 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 358 0 0 0 10093 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877922258104 5250330 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=4684 CPUtime=102.28 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 420 0 0 0 10228 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877913865488 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=988 CPUtime=102.29 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 502 0 0 0 10229 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877905472784 5396436 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=4024 CPUtime=102.27 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 371 0 0 0 10227 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877897080080 5079917 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=1548 CPUtime=102.28 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 462 0 0 0 10228 0 0 0 20 0 9 0 558906905 632705024 1172 33554432000 4194304 6211132 140730180287840 139877888687376 5082814 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 816.91 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4688 KiB

[startup+162.301 s]
/proc/loadavg: 8.23 8.21 8.25 9/199 5721
/proc/meminfo: memFree=30151560/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4692 CPUtime=1296.11 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 5017 0 0 0 129611 0 0 0 20 0 9 0 558906904 632705024 1173 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1173 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=4692 CPUtime=162.26 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 411 0 0 0 16226 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877947436304 5039125 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=4692 CPUtime=162.27 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 484 0 0 0 16227 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877939043600 5039038 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=4692 CPUtime=162.28 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 473 0 0 0 16228 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877930650896 5038992 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=4692 CPUtime=160.16 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 393 0 0 0 16016 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877922258104 5039026 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=4692 CPUtime=162.27 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 465 0 0 0 16227 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877913865488 5039014 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=4692 CPUtime=162.28 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 528 0 0 0 16228 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877905472784 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=4692 CPUtime=162.27 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 412 0 0 0 16227 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877897080080 5079541 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=4692 CPUtime=162.28 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 507 0 0 0 16228 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877888687376 5039121 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 1296.11 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4692 KiB

[startup+222.301 s]
/proc/loadavg: 8.12 8.19 8.24 9/199 5725
/proc/meminfo: memFree=30150676/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4692 CPUtime=1775.3 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 5328 0 0 0 177530 0 0 0 20 0 9 0 558906904 632705024 1173 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1173 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=4692 CPUtime=222.25 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 443 0 0 0 22225 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877947436304 5078748 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=4692 CPUtime=222.27 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 539 0 0 0 22227 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877939043600 5080412 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=4692 CPUtime=222.28 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 512 0 0 0 22228 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877930650896 5158060 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=4692 CPUtime=219.38 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 438 0 0 0 21938 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877922258104 5157999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=22177 CPUtime=222.26 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 511 0 0 0 22226 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877913865488 5039189 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=4692 CPUtime=222.28 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 550 0 0 0 22228 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877905472784 5158052 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=3504 CPUtime=222.26 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 447 0 0 0 22226 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877897080080 5038671 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=10560 CPUtime=222.27 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 544 0 0 0 22227 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877888687376 5078752 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 1775.3 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4692 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]*
/proc/loadavg: 8.15 8.19 8.23 9/199 5728
/proc/meminfo: memFree=30151100/32770624 swapFree=66954180/67108860
[pid=5703] ppid=5700 vsize=617876 memory=4692 CPUtime=2012.56 cores=0-7
/proc/5703/stat : 5703 (cosoco) S 5700 5703 3066 0 -1 1077944320 5647 0 0 0 201256 0 0 0 20 0 9 0 558906904 632705024 1173 33554432000 4194304 6211132 140730180287840 140730180286096 139877970579191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
/proc/5703/statm: 154469 1173 839 493 0 147774 0
[pid=5703/tid=5705] ppid=5700 vsize=617876 memory=3504 CPUtime=251.96 cores=0-7
/proc/5703/task/5705/stat : 5705 (cosoco) R 5700 5703 3066 0 -1 4202560 481 0 0 0 25196 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877947436304 5082354 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5706] ppid=5700 vsize=617876 memory=10560 CPUtime=251.97 cores=0-7
/proc/5703/task/5706/stat : 5706 (cosoco) R 5700 5703 3066 0 -1 4202560 577 0 0 0 25197 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877939043600 5158025 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5707] ppid=5700 vsize=617876 memory=-7003737579269690708 CPUtime=251.99 cores=0-7
/proc/5703/task/5707/stat : 5707 (cosoco) R 5700 5703 3066 0 -1 4202560 546 0 0 0 25199 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877930650896 5250330 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5708] ppid=5700 vsize=617876 memory=1728 CPUtime=248.72 cores=0-7
/proc/5703/task/5708/stat : 5708 (cosoco) R 5700 5703 3066 0 -1 4202560 484 0 0 0 24872 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877922258104 5081412 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5709] ppid=5700 vsize=617876 memory=8248 CPUtime=251.96 cores=0-7
/proc/5703/task/5709/stat : 5709 (cosoco) R 5700 5703 3066 0 -1 4202560 545 0 0 0 25196 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877913865488 5158038 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5710] ppid=5700 vsize=617876 memory=9580 CPUtime=251.99 cores=0-7
/proc/5703/task/5710/stat : 5710 (cosoco) R 5700 5703 3066 0 -1 4202560 571 0 0 0 25199 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877905472784 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5711] ppid=5700 vsize=617876 memory=1052 CPUtime=251.97 cores=0-7
/proc/5703/task/5711/stat : 5711 (cosoco) R 5700 5703 3066 0 -1 4202560 498 0 0 0 25197 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877897080080 5082762 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
[pid=5703/tid=5712] ppid=5700 vsize=617876 memory=776 CPUtime=251.97 cores=0-7
/proc/5703/task/5712/stat : 5712 (cosoco) R 5700 5703 3066 0 -1 4202560 601 0 0 0 25197 0 0 0 20 0 9 0 558906905 632705024 1173 33554432000 4194304 6211132 140730180287840 139877888687040 5081320 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 14094336 140730180289558 140730180289650 140730180289650 140730180292558 0
Current children cumulated CPU time: 2012.56 s
Current children cumulated vsize: 617876 KiB
Current children cumulated memory: 4692 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.022 s]
# the end of solver process 5703 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2012.67 s, system=0.009995 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.022
CPU time (s): 2012.68
CPU user time (s): 2012.67
CPU system time (s): 0.009995
CPU usage (%): 798.612
Max. virtual memory (cumulated for all children) (KiB): 617876
Max. memory (cumulated for all children) (KiB): 4692

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2012.67
system time used= 0.009995
maximum resident set size= 5000
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5691
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 49
involuntary context switches= 16430


# summary of solver processes directly reported to runsolver:
#   pid: 5703
#   total CPU time (s): 2012.68
#   total CPU user time (s): 2012.67
#   total CPU system time (s): 0.009995

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.20936 second user time and 2.01609 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-30 09:51:20
IDJOB=4409938
IDBENCH=135739
IDSOLVER=2878
FILE ID=node119/4409938-1569829922
RUNJOBID= node119-1569817669-3093
PBS_JOBID= 21705918
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n15/TravellingSalesman-15-30-00.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409938-1569829922/watcher-4409938-1569829922 -o /tmp/evaluation-result-4409938-1569829922/solver-4409938-1569829922 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node119-1569817669-3093 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4409938-1569829922.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0f9f8d62bc132272af22ef8ddad99d7d
RANDOM SEED=1371016149

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30152932 kB
MemAvailable:   31826564 kB
Buffers:          226368 kB
Cached:          1785032 kB
SwapCached:        46700 kB
Active:          1075880 kB
Inactive:         986940 kB
Active(anon):      16676 kB
Inactive(anon):   116460 kB
Active(file):    1059204 kB
Inactive(file):   870480 kB
Unevictable:      107468 kB
Mlocked:          107468 kB
SwapTotal:      67108860 kB
SwapFree:       66954180 kB
Dirty:              2772 kB
Writeback:             0 kB
AnonPages:        113096 kB
Mapped:            26836 kB
Shmem:             73180 kB
Slab:             148536 kB
SReclaimable:     119568 kB
SUnreclaim:        28968 kB
KernelStack:        3360 kB
PageTables:         5420 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     539244 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 62028 MiB
End job on node119 at 2019-09-30 09:55:33