Trace number 4398328

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelOPT832 853.004 106.83

General information on the benchmark

NameMario/Mario-zinc-s1/
Mario-n-medium-4.xml
MD5SUM6d883eab13fdde7c2f2cac6b4a0af40c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark832
Best CPU time to get the best result obtained on this benchmark98.4606
Satisfiable
(Un)Satisfiability was proved
Number of variables90
Number of constraints61
Number of domains53
Minimum domain size1
Maximum domain size30
Distribution of domain sizes[{"size":1,"count":2},{"size":2,"count":28},{"size":29,"count":8},{"size":30,"count":52}]
Minimum variable degree1
Maximum variable degree3
Distribution of variable degrees[{"degree":1,"count":2},{"degree":2,"count":59},{"degree":3,"count":29}]
Minimum constraint arity1
Maximum constraint arity30
Distribution of constraint arities[{"arity":1,"count":1},{"arity":2,"count":58},{"arity":30,"count":2}]
Number of extensional constraints30
Number of intensional constraints29
Distribution of constraint types[{"type":"extension","count":30},{"type":"intension","count":29},{"type":"sum","count":1},{"type":"circuit","count":1}]
Optimization problemYES
Type of objectivemax SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -model -nbcores=8 HOME/instance-4398328-1568605718.xml 
0.00/0.01	c intension  iff(eq(g[2],0),eq(s[2],2)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[3],0),eq(s[3],3)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[4],0),eq(s[4],4)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[5],0),eq(s[5],5)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[6],0),eq(s[6],6)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[7],0),eq(s[7],7)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[8],0),eq(s[8],8)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[9],0),eq(s[9],9)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[10],0),eq(s[10],10)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[11],0),eq(s[11],11)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[12],0),eq(s[12],12)) -> extension (support ? 1) - 30tuples
0.00/0.01	c intension  iff(eq(g[13],0),eq(s[13],13)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[14],0),eq(s[14],14)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[15],0),eq(s[15],15)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[16],0),eq(s[16],16)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[17],0),eq(s[17],17)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[18],0),eq(s[18],18)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[19],0),eq(s[19],19)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[20],0),eq(s[20],20)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[21],0),eq(s[21],21)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[22],0),eq(s[22],22)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[23],0),eq(s[23],23)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[24],0),eq(s[24],24)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[25],0),eq(s[25],25)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[26],0),eq(s[26],26)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[27],0),eq(s[27],27)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[28],0),eq(s[28],28)) -> extension (support ? 1) - 30tuples
0.00/0.02	c intension  iff(eq(g[29],0),eq(s[29],29)) -> extension (support ? 1) - 30tuples
0.00/0.03	c enable optimization
0.00/0.03	c ========================================[ Problem Statistics ]===========================================
0.00/0.03	c |                                                                                                       
0.00/0.03	c |  Parse time        :         0.02 s 
0.00/0.03	c |
0.00/0.03	c |               Variables: 90
0.00/0.03	c |            Domain Sizes: 1..30
0.00/0.03	c |
0.00/0.03	c |             Constraints: 62
0.00/0.03	c |                   Arity: 1..30  -- Unary: 1  -- Binary: 58
0.00/0.03	c | 
0.00/0.03	c |                   Types: 
0.00/0.03	c |                          Circuit: 1
0.00/0.03	c |                          Extension: 58  (nb tuples: 30..30) -- (shared: 0)
0.00/0.03	c |                          Sum: 2
0.00/0.03	c |                          Unary: 1
0.00/0.03	c |                          
0.00/0.03	c |               Objective: Maximize Sum
0.00/0.03	
0.00/0.03	c =========================================================================================================
0.00/0.03	c Parallel mode: Portfolio
0.00/0.03	c [pFactory][Group N°0] created (threads:8).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.03	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.03	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.03	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.03	c [pFactory][Group N°0] task 7 launched on thread 4.
0.00/0.03	c [pFactory][Group N°0] task 6 launched on thread 1.
0.00/0.03	c [pFactory][Group N°0] task 5 launched on thread 0.
0.00/0.03	c [pFactory][Group N°0] task 4 launched on thread 2.
0.00/0.03	c [pFactory][Group N°0] task 3 launched on thread 6.
0.00/0.03	c [pFactory][Group N°0] task 2 launched on thread 7.
0.00/0.03	c [pFactory][Group N°0] task 1 launched on thread 5.
0.00/0.03	c [pFactory][Group N°0] task 0 launched on thread 3.
0.00/0.03	o 0
0.00/0.04	o 27
0.00/0.04	o 129
0.00/0.04	o 137
0.00/0.04	o 140
0.00/0.04	o 161
0.00/0.04	o 228
0.00/0.04	o 233
0.00/0.04	o 290
0.00/0.04	o 428
0.00/0.04	o 486
0.00/0.04	o 493
0.00/0.05	o 501
0.00/0.05	o 591
3.10/0.48	o 620
3.89/0.54	o 636
10.93/1.47	o 646
11.73/1.50	o 651
11.73/1.51	o 659
11.73/1.53	o 662
11.73/1.56	o 680
11.73/1.58	o 689
11.73/1.60	o 712
14.93/1.98	o 734
25.30/3.24	o 737
34.09/4.34	o 753
39.75/5.01	o 770
41.28/5.23	o 788
95.66/12.03	o 799
400.69/50.28	o 832
852.77/106.82	c [pFactory][Group N°0] concurent mode: thread 0 has won with the task 5.
852.77/106.82	c [pFactory][Group N°0] Thread N°0 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°1 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°2 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°3 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°4 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°5 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°6 is joined.
852.77/106.82	c [pFactory][Group N°0] Thread N°7 is joined.
852.77/106.82	c [pFactory][Group N°0] Return Code of the winner:3 (Thread N°0)
852.77/106.82	s OPTIMUM FOUND
852.77/106.82	c call to solver        : 16
852.77/106.82	c
852.77/106.82	c restarts              : 70866       
852.77/106.82	c conflicts             : 534335       (626 /sec)
852.77/106.82	c decisions             : 1703983      (1998 /sec)
852.77/106.82	c propagations          : 137857014   (161616 /sec)
852.77/106.82	c root propagations     : 412         
852.77/106.82	c filter calls          : 49366004       (57874 /sec)
852.77/106.82	c useless filter calls  : 22445672       (45 %)
852.77/106.82	c Memory used           : 572.93 MB
852.77/106.82	c Best bound time (wc)  : 50.2785 s
852.77/106.82	c CPU time              : 852.993 s
852.77/106.82	c real time             : 106.823 s
852.77/106.82	
852.77/106.82	
852.77/106.82	v <instantiation type='solution' cost='832'>
852.77/106.82	v <list>f[0] f[10] f[11] f[12] f[13] f[14] f[15] f[16] f[17] f[18] f[19] f[1] f[20] f[21] f[22] f[23] f[24] f[25] f[26] f[27] f[28] f[29] f[2] f[3] f[4] f[5] f[6] f[7] f[8] f[9] g[0] g[10] g[11] g[12] g[13] g[14] g[15] g[16] g[17] g[18] g[19] g[1] g[20] g[21] g[22] g[23] g[24] g[25] g[26] g[27] g[28] g[29] g[2] g[3] g[4] g[5] g[6] g[7] g[8] g[9] s[0] s[10] s[11] s[12] s[13] s[14] s[15] s[16] s[17] s[18] s[19] s[1] s[20] s[21] s[22] s[23] s[24] s[25] s[26] s[27] s[28] s[29] s[2] s[3] s[4] s[5] s[6] s[7] s[8] s[9] </list>
852.77/106.82	v <values>52 0 0 279 141 18 6 154 274 29 0 0 0 146 0 0 0 0 196 0 91 0 54 45 179 0 14 0 47 215 0 0 0 52 60 62 52 69 76 62 0 0 0 69 0 0 0 0 33 0 69 0 3 58 67 0 11 0 62 27 6 10 11 16 4 2 8 21 14 28 19 0 20 13 22 23 24 25 3 27 1 29 15 17 18 5 26 7 9 12 </values>
852.77/106.82	v </instantiation>
852.77/106.82

Verifier Data 

OK	832

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14677 MiB free)
  memory of node 1: 16384 MiB (15694 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398328-1568605718/watcher-4398328-1568605718 -o /tmp/evaluation-result-4398328-1568605718/solver-4398328-1568605718 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node127-1568598290-13264 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398328-1568605718.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16148, runsolver pid=16145
Current StackSize limit: 8192 KiB


[startup+0.100898 s]*
/proc/loadavg: 7.36 4.20 4.65 9/199 16157
/proc/meminfo: memFree=31098180/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=6328 CPUtime=0.66 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 1926 0 0 0 66 0 0 0 20 0 9 0 436840681 634327040 1582 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1582 895 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=576460756329955530 CPUtime=0.08 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479327783952 5156104 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=0 CPUtime=0.08 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 27 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479319391504 5145537 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=140340048068360 CPUtime=0.08 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479310998464 5081337 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=0 CPUtime=0.07 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 7 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479302605840 5158100 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=0 CPUtime=0.07 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 7 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479294213136 5078791 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=0 CPUtime=0.08 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479285820688 5081360 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=-1 CPUtime=0.08 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479277427728 5158000 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=0 CPUtime=0.08 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 8 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479269035280 5081747 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 0.66 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 6328 KiB

[startup+0.209898 s]*
/proc/loadavg: 7.36 4.20 4.65 9/199 16157
/proc/meminfo: memFree=31098180/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=6328 CPUtime=1.52 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 1926 0 0 0 152 0 0 0 20 0 9 0 436840681 634327040 1582 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1582 895 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 19 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479327783952 5193754 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=1947269 CPUtime=0.19 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 27 0 0 0 19 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479319391504 5081329 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=288370716199765632 CPUtime=0.18 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 18 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479310998464 5186269 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=-1 CPUtime=0.17 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 17 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479302605840 5157536 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=0 CPUtime=0.18 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 18 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479294213136 5250289 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=0 CPUtime=0.19 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 19 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479285820688 5396407 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=-1 CPUtime=0.19 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 19 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479277427728 5250275 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=0 CPUtime=0.19 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 19 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479269035280 5078765 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 1.52 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 6328 KiB

[startup+0.309893 s]*
/proc/loadavg: 7.36 4.20 4.65 9/199 16157
/proc/meminfo: memFree=31097868/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=6328 CPUtime=2.31 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 1926 0 0 0 231 0 0 0 20 0 9 0 436840681 634327040 1582 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1582 895 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=8317482817917895235 CPUtime=0.28 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 28 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479327783952 5393424 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=0 CPUtime=0.28 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 27 0 0 0 28 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479319391504 5076431 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=0 CPUtime=0.28 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 28 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479310998464 5078762 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=6944656592455097440 CPUtime=0.26 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 26 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479302605840 5078894 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=0 CPUtime=0.28 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 28 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479294213136 5075616 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=0 CPUtime=0.29 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 29 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479285820688 5079305 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=0 CPUtime=0.29 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 29 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479277427728 5250284 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=0 CPUtime=0.29 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 29 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479269035280 5250224 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 2.31 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 6328 KiB

[startup+0.700893 s]
/proc/loadavg: 7.36 4.20 4.65 9/199 16157
/proc/meminfo: memFree=31097868/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=6328 CPUtime=5.35 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 1926 0 0 0 535 0 0 0 20 0 9 0 436840681 634327040 1582 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1582 895 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=2828 CPUtime=0.67 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479327783952 5082397 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=780 CPUtime=0.67 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 27 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479319391504 5078752 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=620 CPUtime=0.67 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479310998560 5193733 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=1496 CPUtime=0.62 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 62 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479302605840 5250287 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=1016 CPUtime=0.67 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479294213136 5393306 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=1568 CPUtime=0.67 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 22 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479285820432 5017688 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=928 CPUtime=0.67 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 20 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479277427728 5082762 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=3520 CPUtime=0.67 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 21 0 0 0 67 0 0 0 20 0 9 0 436840684 634327040 1582 33554432000 4194304 6211092 140728789306352 140479269035280 5186210 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 5.35 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 6328 KiB

[startup+1.50089 s]
/proc/loadavg: 7.36 4.20 4.65 9/199 16157
/proc/meminfo: memFree=31097800/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7016 CPUtime=11.73 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 2719 0 0 0 1173 0 0 0 20 0 9 0 436840681 634327040 1754 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1754 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=1947178 CPUtime=1.47 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 93 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479327783952 5392343 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=1948606 CPUtime=1.47 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 140 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479319391504 5158100 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=0 CPUtime=1.47 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 105 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479310998560 5076431 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=8243114992657236051 CPUtime=1.4 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 169 0 0 0 140 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479302605840 5079276 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=288288891675607907 CPUtime=1.47 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 134 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479294213136 5193754 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=6940721388985149248 CPUtime=1.47 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 131 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479285820416 5017373 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=280679871346144 CPUtime=1.47 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 108 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479277427984 5081367 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=3540027054491375111 CPUtime=1.47 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 86 0 0 0 147 0 0 0 20 0 9 0 436840684 634327040 1754 33554432000 4194304 6211092 140728789306352 140479269035024 5157562 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 11.73 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7016 KiB

[startup+3.10989 s]
/proc/loadavg: 7.41 4.27 4.67 9/199 16157
/proc/meminfo: memFree=31097456/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7020 CPUtime=24.58 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 3496 0 0 0 2458 0 0 0 20 0 9 0 436840681 634327040 1755 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1755 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=7016 CPUtime=3.08 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 218 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479327783952 5389819 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=9592 CPUtime=3.08 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 233 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479319391504 5075156 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7016 CPUtime=3.08 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 149 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479310998560 5193754 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=1947178 CPUtime=2.99 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 300 0 0 0 299 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479302605840 5250453 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=1948606 CPUtime=3.07 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 248 0 0 0 307 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479294213136 5078767 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=287 CPUtime=3.08 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 229 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479285820416 5082378 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=287 CPUtime=3.08 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 203 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479277427840 5009192 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=287 CPUtime=3.08 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 170 0 0 0 308 0 0 0 20 0 9 0 436840684 634327040 1755 33554432000 4194304 6211092 140728789306352 140479269035024 5157577 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 24.58 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7020 KiB

[startup+6.3009 s]
/proc/loadavg: 7.41 4.27 4.67 9/199 16157
/proc/meminfo: memFree=31097640/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7032 CPUtime=50.07 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 5194 0 0 0 5007 0 0 0 20 0 9 0 436840681 634327040 1758 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1758 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=140344343021183 CPUtime=6.26 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 415 0 0 0 626 0 0 0 20 0 9 0 436840684 634327040 1758 33554432000 4194304 6211092 140728789306352 140479327783952 5250293 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=56 CPUtime=6.27 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 460 0 0 0 627 0 0 0 20 0 9 0 436840684 634327040 1758 33554432000 4194304 6211092 140728789306352 140479319391504 5081398 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7020 CPUtime=6.27 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 316 0 0 0 627 0 0 0 20 0 9 0 436840684 634327040 1758 33554432000 4194304 6211092 140728789306352 140479310998560 5079336 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=0 CPUtime=6.14 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 579 0 0 0 614 0 0 0 20 0 9 0 436840684 634327040 1758 33554432000 4194304 6211092 140728789306352 140479302605840 5082397 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0

################
# More data... #
################

/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10877 0 0 0 81682 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=6935054825532540783 CPUtime=102.26 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1094 0 0 0 10226 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5250275 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=7056 CPUtime=102.25 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1117 0 0 0 10225 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5017373 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7100 CPUtime=102.25 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1009 0 0 0 10225 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5397226 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=7100 CPUtime=100.98 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1468 0 0 0 10098 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5397223 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=0 CPUtime=102.25 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1224 0 0 0 10225 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5193754 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=7056 CPUtime=102.25 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1001 0 0 0 10225 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5078762 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=7056 CPUtime=102.26 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1199 0 0 0 10226 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5008827 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=7056 CPUtime=102.25 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1012 0 0 0 10225 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5079374 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 816.82 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

[startup+106.83 s]
# the end of solver process 16148 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=852.993 s, system=0.010995 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+102.401 s]
/proc/loadavg: 8.28 5.44 5.04 9/199 16163
/proc/meminfo: memFree=31096812/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7100 CPUtime=817.62 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10877 0 0 0 81762 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=0 CPUtime=102.36 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1094 0 0 0 10236 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5076376 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=7056 CPUtime=102.35 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1117 0 0 0 10235 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5250275 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=2828 CPUtime=102.35 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1009 0 0 0 10235 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5082376 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=7056 CPUtime=101.08 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1468 0 0 0 10108 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5250289 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=2116 CPUtime=102.35 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1224 0 0 0 10235 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5081375 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=71530264398314 CPUtime=102.35 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1001 0 0 0 10235 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5397375 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=71530264398314 CPUtime=102.36 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1199 0 0 0 10236 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5250293 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=7056 CPUtime=102.35 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1012 0 0 0 10235 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5078767 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 817.62 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

[startup+104.001 s]*
/proc/loadavg: 8.28 5.44 5.04 9/199 16163
/proc/meminfo: memFree=31096936/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7100 CPUtime=830.46 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10878 0 0 0 83046 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=0 CPUtime=103.96 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1094 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5250224 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=8317482817917895235 CPUtime=103.96 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1117 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5155511 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=1536 CPUtime=103.96 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1009 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5082814 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=9592 CPUtime=102.67 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1468 0 0 0 10267 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5081341 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=2828 CPUtime=103.96 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1225 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5074609 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=780 CPUtime=103.96 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1001 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5081439 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=620 CPUtime=103.97 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1199 0 0 0 10397 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5250289 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=1496 CPUtime=103.96 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1012 0 0 0 10396 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5076405 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 830.46 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

[startup+105.601 s]
/proc/loadavg: 8.28 5.44 5.04 9/199 16163
/proc/meminfo: memFree=31096936/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7100 CPUtime=843.18 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10883 0 0 0 84318 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=24760 CPUtime=105.56 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1095 0 0 0 10556 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5075188 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=14068 CPUtime=105.55 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1117 0 0 0 10555 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5082336 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7056 CPUtime=105.55 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1010 0 0 0 10555 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5081363 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=7100 CPUtime=104.24 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1468 0 0 0 10424 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5017170 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=3576 CPUtime=105.55 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1225 0 0 0 10555 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5155487 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=45636 CPUtime=105.55 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1001 0 0 0 10555 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5078762 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=7100 CPUtime=105.56 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1201 0 0 0 10556 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5075234 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=7100 CPUtime=105.55 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1013 0 0 0 10555 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5250289 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 843.18 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

[startup+106.401 s]
/proc/loadavg: 8.28 5.44 5.04 9/199 16163
/proc/meminfo: memFree=31096936/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7100 CPUtime=849.57 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10884 0 0 0 84957 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=7100 CPUtime=106.36 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1095 0 0 0 10636 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5155734 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=14012 CPUtime=106.35 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1117 0 0 0 10635 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5075192 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7100 CPUtime=106.35 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1010 0 0 0 10635 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5078748 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=1568 CPUtime=105.03 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1468 0 0 0 10503 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5250459 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=7056 CPUtime=106.35 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1225 0 0 0 10635 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5075312 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=637 CPUtime=106.35 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1001 0 0 0 10635 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5155804 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=7100 CPUtime=106.36 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1202 0 0 0 10636 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5156460 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=6935054825532540783 CPUtime=106.35 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1013 0 0 0 10635 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5075761 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 849.57 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

[startup+106.801 s]
/proc/loadavg: 8.28 5.44 5.04 9/199 16163
/proc/meminfo: memFree=31096936/32770624 swapFree=66952652/67108860
[pid=16148] ppid=16145 vsize=619460 memory=7100 CPUtime=852.77 cores=0-7
/proc/16148/stat : 16148 (cosoco) S 16145 16148 13237 0 -1 1077944320 10888 0 0 0 85277 0 0 0 20 0 9 0 436840681 634327040 1775 33554432000 4194304 6211092 140728789306352 140728789304608 140479350927095 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
/proc/16148/statm: 154865 1775 904 493 0 148170 0
[pid=16148/tid=16150] ppid=16145 vsize=619460 memory=6655300316396806192 CPUtime=106.76 cores=0-7
/proc/16148/task/16150/stat : 16150 (cosoco) R 16145 16148 13237 0 -1 4202560 1095 0 0 0 10676 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479327783952 5157929 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16151] ppid=16145 vsize=619460 memory=6944652177228980320 CPUtime=106.75 cores=0-7
/proc/16148/task/16151/stat : 16151 (cosoco) R 16145 16148 13237 0 -1 4202560 1119 0 0 0 10675 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479319391504 5081320 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16152] ppid=16145 vsize=619460 memory=7159946406083143581 CPUtime=106.75 cores=0-7
/proc/16148/task/16152/stat : 16152 (cosoco) R 16145 16148 13237 0 -1 4202560 1010 0 0 0 10675 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479310998560 5083216 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16153] ppid=16145 vsize=619460 memory=-6081100125891549016 CPUtime=105.43 cores=0-7
/proc/16148/task/16153/stat : 16153 (cosoco) R 16145 16148 13237 0 -1 4202560 1469 0 0 0 10543 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479302605840 5155804 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16154] ppid=16145 vsize=619460 memory=7100 CPUtime=106.75 cores=0-7
/proc/16148/task/16154/stat : 16154 (cosoco) R 16145 16148 13237 0 -1 4202560 1225 0 0 0 10675 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479294213136 5155800 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16155] ppid=16145 vsize=619460 memory=288230596050944315 CPUtime=106.75 cores=0-7
/proc/16148/task/16155/stat : 16155 (cosoco) R 16145 16148 13237 0 -1 4202560 1002 0 0 0 10675 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479285820432 5081706 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16156] ppid=16145 vsize=619460 memory=16100368647981698 CPUtime=106.76 cores=0-7
/proc/16148/task/16156/stat : 16156 (cosoco) R 16145 16148 13237 0 -1 4202560 1202 0 0 0 10676 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479277427840 5082800 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
[pid=16148/tid=16157] ppid=16145 vsize=619460 memory=288230596050944315 CPUtime=106.75 cores=0-7
/proc/16148/task/16157/stat : 16157 (cosoco) R 16145 16148 13237 0 -1 4202560 1013 0 0 0 10675 0 0 0 20 0 9 0 436840684 634327040 1775 33554432000 4194304 6211092 140728789306352 140479269035280 5076013 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 35540992 140728789312529 140728789312621 140728789312621 140728789315534 0
Current children cumulated CPU time: 852.77 s
Current children cumulated vsize: 619460 KiB
Current children cumulated memory: 7100 KiB

Child status: 0
Real time (s): 106.83
CPU time (s): 853.004
CPU user time (s): 852.993
CPU system time (s): 0.010995
CPU usage (%): 798.472
Max. virtual memory (cumulated for all children) (KiB): 619460
Max. memory (cumulated for all children) (KiB): 7100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 852.993
system time used= 0.010995
maximum resident set size= 7220
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10968
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 111
involuntary context switches= 7646


# summary of solver processes directly reported to runsolver:
#   pid: 16148
#   total CPU time (s): 853.004
#   total CPU user time (s): 852.993
#   total CPU system time (s): 0.010995

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.503189 second user time and 0.840729 second system time

The end

Launcher Data 

Begin job on node127 at 2019-09-16 05:47:58
IDJOB=4398328
IDBENCH=133281
IDSOLVER=2851
FILE ID=node127/4398328-1568605718
RUNJOBID= node127-1568598290-13264
PBS_JOBID= 21703425
Free space on /tmp= 61312 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Mario/Mario-zinc-s1/Mario-n-medium-4.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398328-1568605718/watcher-4398328-1568605718 -o /tmp/evaluation-result-4398328-1568605718/solver-4398328-1568605718 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node127-1568598290-13264 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398328-1568605718.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6d883eab13fdde7c2f2cac6b4a0af40c
RANDOM SEED=1046805686

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31101448 kB
MemAvailable:   31833400 kB
Buffers:           45492 kB
Cached:           972716 kB
SwapCached:        51316 kB
Active:           392048 kB
Inactive:         679316 kB
Active(anon):      12056 kB
Inactive(anon):    90388 kB
Active(file):     379992 kB
Inactive(file):   588928 kB
Unevictable:      110920 kB
Mlocked:          110920 kB
SwapTotal:      67108860 kB
SwapFree:       66952652 kB
Dirty:              2724 kB
Writeback:             0 kB
AnonPages:        114376 kB
Mapped:            45960 kB
Shmem:             40556 kB
Slab:             187860 kB
SReclaimable:     157736 kB
SUnreclaim:        30124 kB
KernelStack:        3360 kB
PageTables:         5144 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506524 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 61308 MiB
End job on node127 at 2019-09-16 05:49:45