Trace number 4398300

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelOPT2 9039.58 1132.1

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-11-011-005.xml
MD5SUM7a6a01f2d694ae1725dbabce720210ef
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark1.28174
Satisfiable
(Un)Satisfiability was proved
Number of variables122
Number of constraints67
Number of domains2
Minimum domain size2
Maximum domain size10
Distribution of domain sizes[{"size":2,"count":121},{"size":10,"count":1}]
Minimum variable degree12
Maximum variable degree56
Distribution of variable degrees[{"degree":12,"count":121},{"degree":56,"count":1}]
Minimum constraint arity11
Maximum constraint arity121
Distribution of constraint arities[{"arity":11,"count":11},{"arity":23,"count":55},{"arity":121,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":66}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

1.65/0.37	c
1.65/0.37	c This is cosoco 2.00 --  
1.65/0.37	c
1.65/0.37	c command line: cosoco -model -nbcores=8 HOME/instance-4398300-1568599904.xml 
1.65/0.37	c enable optimization
1.65/0.37	c ========================================[ Problem Statistics ]===========================================
1.65/0.37	c |                                                                                                       
1.65/0.37	c |  Parse time        :         0.12 s 
1.65/0.37	c |
1.65/0.37	c |               Variables: 122
1.65/0.37	c |            Domain Sizes: 2..10
1.65/0.37	c |
1.65/0.37	c |             Constraints: 87
1.65/0.37	c |                   Arity: 1..23  -- Unary: 1
1.65/0.37	c | 
1.65/0.37	c |                   Types: 
1.65/0.37	c |                          Intension: 56
1.65/0.37	c |                          Lex: 20
1.65/0.37	c |                          Sum: 11
1.65/0.37	c |                          
1.65/0.37	c |               Objective: Minimize Intension
1.65/0.37	
1.65/0.37	c =========================================================================================================
1.65/0.37	c Parallel mode: Portfolio
1.65/0.37	c [pFactory][Group N°0] created (threads:8).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
1.65/0.37	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
1.65/0.37	c [pFactory][Group N°0] concurrent mode: enabled.
1.65/0.37	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
1.65/0.37	c [pFactory][Group N°0] task 7 launched on thread 7.
1.65/0.37	c [pFactory][Group N°0] task 6 launched on thread 0.
1.65/0.37	c [pFactory][Group N°0] task 5 launched on thread 1.
1.65/0.37	c [pFactory][Group N°0] task 4 launched on thread 2.
1.65/0.37	c [pFactory][Group N°0] task 3 launched on thread 5.
1.65/0.37	c [pFactory][Group N°0] task 2 launched on thread 3.
1.65/0.37	c [pFactory][Group N°0] task 1 launched on thread 4.
1.65/0.37	c [pFactory][Group N°0] task 0 launched on thread 6.
1.65/0.37	o 5
4.68/0.79	o 4
24.64/3.27	o 3
9038.72/1131.96	o 2
9039.41/1132.10	c [pFactory][Group N°0] concurent mode: thread 1 has won with the task 5.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°0 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°1 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°2 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°3 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°4 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°5 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°6 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Thread N°7 is joined.
9039.41/1132.10	c [pFactory][Group N°0] Return Code of the winner:3 (Thread N°1)
9039.41/1132.10	s OPTIMUM FOUND
9039.41/1132.10	c call to solver        : 4
9039.41/1132.10	c
9039.41/1132.10	c restarts              : 2057        
9039.41/1132.10	c conflicts             : 23302        (3 /sec)
9039.41/1132.10	c decisions             : 193330       (21 /sec)
9039.41/1132.10	c propagations          : 678976      (75 /sec)
9039.41/1132.10	c root propagations     : 286         
9039.41/1132.10	c filter calls          : 4406198        (487 /sec)
9039.41/1132.10	c useless filter calls  : 4177006        (94 %)
9039.41/1132.10	c Memory used           : 576.10 MB
9039.41/1132.10	c Best bound time (wc)  : 1131.96 s
9039.41/1132.10	c CPU time              : 9039.5 s
9039.41/1132.10	c real time             : 1132.1 s
9039.41/1132.10	
9039.41/1132.10	
9039.41/1132.10	v <instantiation type='solution' cost='2'>
9039.41/1132.10	v <list>x[0][0] x[0][10] x[0][1] x[0][2] x[0][3] x[0][4] x[0][5] x[0][6] x[0][7] x[0][8] x[0][9] x[10][0] x[10][10] x[10][1] x[10][2] x[10][3] x[10][4] x[10][5] x[10][6] x[10][7] x[10][8] x[10][9] x[1][0] x[1][10] x[1][1] x[1][2] x[1][3] x[1][4] x[1][5] x[1][6] x[1][7] x[1][8] x[1][9] x[2][0] x[2][10] x[2][1] x[2][2] x[2][3] x[2][4] x[2][5] x[2][6] x[2][7] x[2][8] x[2][9] x[3][0] x[3][10] x[3][1] x[3][2] x[3][3] x[3][4] x[3][5] x[3][6] x[3][7] x[3][8] x[3][9] x[4][0] x[4][10] x[4][1] x[4][2] x[4][3] x[4][4] x[4][5] x[4][6] x[4][7] x[4][8] x[4][9] x[5][0] x[5][10] x[5][1] x[5][2] x[5][3] x[5][4] x[5][5] x[5][6] x[5][7] x[5][8] x[5][9] x[6][0] x[6][10] x[6][1] x[6][2] x[6][3] x[6][4] x[6][5] x[6][6] x[6][7] x[6][8] x[6][9] x[7][0] x[7][10] x[7][1] x[7][2] x[7][3] x[7][4] x[7][5] x[7][6] x[7][7] x[7][8] x[7][9] x[8][0] x[8][10] x[8][1] x[8][2] x[8][3] x[8][4] x[8][5] x[8][6] x[8][7] x[8][8] x[8][9] x[9][0] x[9][10] x[9][1] x[9][2] x[9][3] x[9][4] x[9][5] x[9][6] x[9][7] x[9][8] x[9][9] z </list>
9039.41/1132.10	v <values>0 1 0 0 0 0 0 1 1 1 1 1 0 1 0 0 1 0 0 0 1 1 0 1 0 0 1 1 1 0 0 0 1 0 0 0 1 0 1 1 0 1 1 0 0 0 1 0 1 0 1 1 0 1 0 0 1 1 1 0 1 0 1 0 0 0 0 0 1 1 1 0 0 0 1 0 1 1 0 0 0 1 1 0 1 1 0 0 1 0 0 1 0 0 1 1 0 0 1 1 1 0 1 1 0 0 0 0 1 0 1 1 1 0 0 0 1 0 1 0 0 2 </values>
9039.41/1132.10	v </instantiation>
9039.41/1132.10

Verifier Data 

OK	2

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15131 MiB free)
  memory of node 1: 16384 MiB (15715 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398300-1568599904/watcher-4398300-1568599904 -o /tmp/evaluation-result-4398300-1568599904/solver-4398300-1568599904 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node117-1568598149-15728 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398300-1568599904.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16091, runsolver pid=16088
Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 8.46 7.91 5.22 2/192 16092
/proc/meminfo: memFree=31583112/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=31800 memory=8124 CPUtime=0.1 cores=0-7
/proc/16091/stat : 16091 (cosoco) R 16088 16091 15701 0 -1 4202496 2238 0 0 0 10 0 0 0 20 0 1 0 435932254 32563200 2031 33554432000 4194304 6211092 140724331139264 140724331135800 140396697459685 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 7950 2031 849 493 0 1255 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31800 KiB
Current children cumulated memory: 8124 KiB

[startup+0.209829 s]*
/proc/loadavg: 8.46 7.91 5.22 9/200 16100
/proc/meminfo: memFree=31581476/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=10740 CPUtime=0.85 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 3189 0 0 0 85 0 0 0 20 0 9 0 435932254 637652992 2685 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 2685 880 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=8316850467074736180 CPUtime=0.09 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 60 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396690356904 4982624 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=13977 CPUtime=0.08 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 87 0 0 0 8 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396681964200 5164764 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=288370775658378880 CPUtime=0.09 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 75 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396673571576 5451572 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=-1 CPUtime=0.09 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 59 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396665178792 5452157 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=0 CPUtime=0.09 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 93 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396656786088 140396698385828 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=0 CPUtime=0.09 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 58 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396648393384 5441074 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=-1 CPUtime=0.09 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 92 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396640000760 5443042 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=0 CPUtime=0.09 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 98 0 0 0 9 0 0 0 20 0 9 0 435932267 637652992 2685 33554432000 4194304 6211092 140724331139264 140396631607912 140396707404614 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 0.85 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 10740 KiB

[startup+0.310818 s]*
/proc/loadavg: 8.46 7.91 5.22 9/200 16100
/proc/meminfo: memFree=31581104/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=11520 CPUtime=1.65 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 3314 0 0 0 165 0 0 0 20 0 9 0 435932254 637652992 2880 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 2880 881 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=8317482817917895235 CPUtime=0.19 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 96 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396690356840 5452153 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=4126316290023845779 CPUtime=0.17 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 89 0 0 0 17 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396681964232 140396698380209 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396673571576 5440697 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396665178792 5453896 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396656786088 5446275 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 85 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396648393384 140396706792608 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 94 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396640000760 4982624 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=0 CPUtime=0.19 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 101 0 0 0 19 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396631607992 140396707404625 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 1.65 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 11520 KiB

[startup+0.700821 s]
/proc/loadavg: 8.46 7.91 5.22 9/200 16100
/proc/meminfo: memFree=31580360/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=11520 CPUtime=4.68 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 3462 0 0 0 468 0 0 0 20 0 9 0 435932254 637652992 2880 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 2880 881 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=500 CPUtime=0.57 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 108 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396690356904 5443072 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=1556 CPUtime=0.53 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 114 0 0 0 53 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396681964200 5446218 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=924 CPUtime=0.57 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 117 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396673571576 5451500 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=1672 CPUtime=0.57 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 107 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396665178728 140396698380192 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=796 CPUtime=0.57 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 109 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396656786088 5453912 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=-7175204567652784766 CPUtime=0.57 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 108 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396648393384 5446260 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=3054156605268465310 CPUtime=0.57 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 110 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396640000760 140396698385828 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=2424 CPUtime=0.57 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 122 0 0 0 57 0 0 0 20 0 9 0 435932267 637652992 2880 33554432000 4194304 6211092 140724331139264 140396631607912 5164821 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 4.68 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 11520 KiB

[startup+1.50082 s]
/proc/loadavg: 8.46 7.91 5.22 9/200 16100
/proc/meminfo: memFree=31579712/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13116 CPUtime=11.07 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 5773 0 0 0 1106 1 0 0 20 0 9 0 435932254 637652992 3279 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3279 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=0 CPUtime=1.37 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 298 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396690356904 5068958 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=2110750001289284 CPUtime=1.32 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 402 0 0 0 132 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396681963960 5452242 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=288230600312370487 CPUtime=1.37 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 508 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396673571576 5443061 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=14131160485748966 CPUtime=1.37 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 412 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396665178728 5443042 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=3612 CPUtime=1.37 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 465 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396656786024 5446197 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=29800 CPUtime=1.37 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 266 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396648393144 5478632 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=992 CPUtime=1.37 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 375 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396640000440 5446226 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=2044 CPUtime=1.37 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 480 0 0 0 137 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396631607976 140396698385823 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 11.07 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13116 KiB

[startup+3.10982 s]
/proc/loadavg: 8.46 7.91 5.22 9/200 16100
/proc/meminfo: memFree=31578660/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13116 CPUtime=23.91 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 5872 0 0 0 2390 1 0 0 20 0 9 0 435932254 637652992 3279 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3279 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=0 CPUtime=2.98 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 317 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396690356904 5446248 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=97 CPUtime=2.9 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 403 0 0 0 290 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396681963944 5164749 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=2483699058177 CPUtime=2.98 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 509 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396673571432 5474506 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=0 CPUtime=2.98 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 421 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396665178728 140396698383948 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=280798787801568 CPUtime=2.98 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 469 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396656786088 5446279 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=280798787801632 CPUtime=2.98 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 317 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396648393320 140396698385838 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=4715952310075224460 CPUtime=2.98 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 383 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396640000424 5455650 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=0 CPUtime=2.98 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 486 0 0 0 298 0 0 0 20 0 9 0 435932267 637652992 3279 33554432000 4194304 6211092 140724331139264 140396631607976 5164759 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 23.91 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13116 KiB

[startup+6.30083 s]
/proc/loadavg: 8.34 7.89 5.23 9/200 16100
/proc/meminfo: memFree=31578412/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13352 CPUtime=49.4 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 12765 0 0 0 4939 1 0 0 20 0 9 0 435932254 637652992 3338 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3338 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=13332 CPUtime=6.17 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 1186 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396690356840 140396698380209 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=13332 CPUtime=6.05 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 1186 0 0 0 605 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396681964552 5451521 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=147 CPUtime=6.17 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 1302 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396673571240 5443072 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=147 CPUtime=6.17 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 1194 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396665178792 140396698383948 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=280798788367104 CPUtime=6.17 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 1227 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396656786024 5452215 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=209495619829181 CPUtime=6.17 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 1231 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396648393320 5456298 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=0 CPUtime=6.17 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 1354 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396640000424 5456310 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=0 CPUtime=6.17 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 1518 0 0 0 617 0 0 0 20 0 9 0 435932267 637652992 3338 33554432000 4194304 6211092 140724331139264 140396631607720 5456310 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 49.4 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13352 KiB

[startup+12.7008 s]
/proc/loadavg: 8.32 7.89 5.24 9/200 16100
/proc/meminfo: memFree=31577800/32770624 swapFree=66952332/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13368 CPUtime=100.52 cores=0-7

################
# More data... #
################

[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=13484 CPUtime=1062.04 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8745 0 0 0 106204 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 140396707404648 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=3612 CPUtime=1062.04 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8070 0 0 0 106204 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 5452223 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 8482.86 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1122.3 s]
/proc/loadavg: 8.03 8.17 7.30 9/200 16180
/proc/meminfo: memFree=31573640/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13484 CPUtime=8962.04 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66300 0 0 0 896197 7 0 0 20 0 9 0 435932254 637652992 3371 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3371 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=13484 CPUtime=1120.79 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 7807 0 0 0 112078 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396690356696 5446260 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=13484 CPUtime=1114.41 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 7924 0 0 0 111440 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396681963944 5478403 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=13484 CPUtime=1121.95 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 7844 0 0 0 112195 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396673571432 5453908 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=3612 CPUtime=1122.04 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 112204 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396665178536 5452157 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=13484 CPUtime=1121.95 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 7814 0 0 0 112195 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396656785832 5443111 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=13484 CPUtime=1116.63 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 111663 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396648393128 5446275 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=13484 CPUtime=1122.02 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8929 0 0 0 112202 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 4982624 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=13484 CPUtime=1122.04 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8229 0 0 0 112204 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 140396707404682 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 8962.04 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1132.1 s]
# the end of solver process 16091 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=9039.5 s, system=0.080958 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1126.4 s]
/proc/loadavg: 8.03 8.17 7.31 9/200 16180
/proc/meminfo: memFree=31573684/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13484 CPUtime=8994.79 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66305 0 0 0 899472 7 0 0 20 0 9 0 435932254 637652992 3371 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3371 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=1428 CPUtime=1124.89 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 7808 0 0 0 112488 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396690356696 5439810 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=13484 CPUtime=1118.46 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 7928 0 0 0 111845 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396681963944 5443061 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=13484 CPUtime=1126.05 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 7844 0 0 0 112605 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396673571432 140396698385856 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=13484 CPUtime=1126.14 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 112614 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396665178536 5454172 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=4108 CPUtime=1126.05 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 7814 0 0 0 112605 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396656785832 5164712 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=13484 CPUtime=1120.73 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 112073 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396648393128 5451521 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=29812 CPUtime=1126.12 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8929 0 0 0 112612 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 5440636 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=992 CPUtime=1126.14 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8229 0 0 0 112614 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 5443061 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 8994.79 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1129.6 s]
/proc/loadavg: 8.03 8.17 7.31 9/200 16180
/proc/meminfo: memFree=31573748/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13484 CPUtime=9020.34 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66305 0 0 0 902027 7 0 0 20 0 9 0 435932254 637652992 3371 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3371 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=3612 CPUtime=1128.09 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 7808 0 0 0 112808 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396690356696 5443096 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=13484 CPUtime=1121.62 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 7928 0 0 0 112161 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396681963944 5441093 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=6935054825532540783 CPUtime=1129.25 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 7844 0 0 0 112925 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396673571432 5441112 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=1428 CPUtime=1129.34 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 112934 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396665178536 5441090 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=13476 CPUtime=1129.25 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 7814 0 0 0 112925 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396656785832 5452242 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=13854057802500511 CPUtime=1123.93 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 112393 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396648393128 5453914 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=4132 CPUtime=1129.32 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8929 0 0 0 112932 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 5451566 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=13484 CPUtime=1129.34 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8229 0 0 0 112934 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 5164745 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 9020.34 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1131.2 s]
/proc/loadavg: 8.03 8.17 7.31 9/200 16180
/proc/meminfo: memFree=31573876/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13484 CPUtime=9033.12 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66305 0 0 0 903305 7 0 0 20 0 9 0 435932254 637652992 3371 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3371 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=1040 CPUtime=1129.69 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 7808 0 0 0 112968 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396690356696 5453912 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=4132 CPUtime=1123.2 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 7928 0 0 0 112319 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396681963944 5451510 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=13484 CPUtime=1130.85 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 7844 0 0 0 113085 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396673571432 5443096 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=740 CPUtime=1130.94 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 113094 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396665178536 5446240 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=13484 CPUtime=1130.85 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 7814 0 0 0 113085 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396656785832 5452242 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=11624 CPUtime=1125.53 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 112553 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396648393128 5440624 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=3612 CPUtime=1130.92 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8929 0 0 0 113092 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 5440616 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=29812 CPUtime=1130.94 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8229 0 0 0 113094 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 5451532 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 9033.12 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1131.6 s]
/proc/loadavg: 8.03 8.17 7.31 9/200 16180
/proc/meminfo: memFree=31573876/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13484 CPUtime=9036.32 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66305 0 0 0 903625 7 0 0 20 0 9 0 435932254 637652992 3371 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3371 882 493 0 148982 0
[pid=16091/tid=16093] ppid=16088 vsize=622708 memory=1040 CPUtime=1130.09 cores=0-7
/proc/16091/task/16093/stat : 16093 (cosoco) R 16088 16091 15701 0 -1 4202560 7808 0 0 0 113008 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396690356696 140396698380209 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16094] ppid=16088 vsize=622708 memory=4132 CPUtime=1123.6 cores=0-7
/proc/16091/task/16094/stat : 16094 (cosoco) R 16088 16091 15701 0 -1 4202560 7928 0 0 0 112359 1 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396681963944 140396707404614 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16095] ppid=16088 vsize=622708 memory=780 CPUtime=1131.25 cores=0-7
/proc/16091/task/16095/stat : 16095 (cosoco) R 16088 16091 15701 0 -1 4202560 7844 0 0 0 113125 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396673571432 5446927 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=6935054825532540783 CPUtime=1131.34 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 113134 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396665178536 5451528 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16097] ppid=16088 vsize=622708 memory=1720 CPUtime=1131.25 cores=0-7
/proc/16091/task/16097/stat : 16097 (cosoco) R 16088 16091 15701 0 -1 4202560 7814 0 0 0 113125 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396656785832 140396707404682 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=1200 CPUtime=1125.93 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 112593 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396648393128 140396707404682 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16099] ppid=16088 vsize=622708 memory=5988 CPUtime=1131.32 cores=0-7
/proc/16091/task/16099/stat : 16099 (cosoco) R 16088 16091 15701 0 -1 4202560 8929 0 0 0 113132 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396640000424 140396707404682 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16100] ppid=16088 vsize=622708 memory=14012 CPUtime=1131.34 cores=0-7
/proc/16091/task/16100/stat : 16100 (cosoco) R 16088 16091 15701 0 -1 4202560 8229 0 0 0 113134 0 0 0 20 0 9 0 435932267 637652992 3371 33554432000 4194304 6211092 140724331139264 140396631607720 140396698385823 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 9036.32 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13484 KiB

[startup+1132 s]*
/proc/loadavg: 8.03 8.17 7.31 3/194 16180
/proc/meminfo: memFree=31573876/32770624 swapFree=66952340/67108860
[pid=16091] ppid=16088 vsize=622708 memory=13488 CPUtime=9039.41 cores=0-7
/proc/16091/stat : 16091 (cosoco) S 16088 16091 15701 0 -1 1077944320 66331 0 0 0 903934 7 0 0 20 0 3 0 435932254 637652992 3372 33554432000 4194304 6211092 140724331139264 140724331137520 140396713500407 0 0 4096 8405026 18446744073709551615 0 0 17 7 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
/proc/16091/statm: 155677 3372 883 493 0 148982 0
[pid=16091/tid=16096] ppid=16088 vsize=622708 memory=8317482817917895235 CPUtime=1131.74 cores=0-7
/proc/16091/task/16096/stat : 16096 (cosoco) R 16088 16091 15701 0 -1 4202560 7575 0 0 0 113174 0 0 0 20 0 3 0 435932267 637652992 3372 33554432000 4194304 6211092 140724331139264 140396665178536 5452157 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
[pid=16091/tid=16098] ppid=16088 vsize=622708 memory=4126316290023845779 CPUtime=1126.33 cores=0-7
/proc/16091/task/16098/stat : 16098 (cosoco) R 16088 16091 15701 0 -1 4202560 7611 0 0 0 112633 0 0 0 20 0 3 0 435932267 637652992 3372 33554432000 4194304 6211092 140724331139264 140396648393128 140396698385823 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13811712 140724331144209 140724331144301 140724331144301 140724331147214 0
Current children cumulated CPU time: 9039.41 s
Current children cumulated vsize: 622708 KiB
Current children cumulated memory: 13488 KiB

Child status: 0
Real time (s): 1132.1
CPU time (s): 9039.58
CPU user time (s): 9039.5
CPU system time (s): 0.080958
CPU usage (%): 798.477
Max. virtual memory (cumulated for all children) (KiB): 622708
Max. memory (cumulated for all children) (KiB): 13488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 9039.5
system time used= 0.080958
maximum resident set size= 13696
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66357
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 245
involuntary context switches= 74162


# summary of solver processes directly reported to runsolver:
#   pid: 16091
#   total CPU time (s): 9039.58
#   total CPU user time (s): 9039.5
#   total CPU system time (s): 0.080958

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.13168 second user time and 8.93485 second system time

The end

Launcher Data 

Begin job on node117 at 2019-09-16 04:11:01
IDJOB=4398300
IDBENCH=122977
IDSOLVER=2851
FILE ID=node117/4398300-1568599904
RUNJOBID= node117-1568598149-15728
PBS_JOBID= 21703418
Free space on /tmp= 61184 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-11-011-005.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398300-1568599904/watcher-4398300-1568599904 -o /tmp/evaluation-result-4398300-1568599904/solver-4398300-1568599904 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node117-1568598149-15728 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398300-1568599904.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7a6a01f2d694ae1725dbabce720210ef
RANDOM SEED=1401725006

node117.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31586892 kB
MemAvailable:   31857568 kB
Buffers:           86852 kB
Cached:           464920 kB
SwapCached:        51220 kB
Active:           486556 kB
Inactive:         120272 kB
Active(anon):       4016 kB
Inactive(anon):    87880 kB
Active(file):     482540 kB
Inactive(file):    32392 kB
Unevictable:      108824 kB
Mlocked:          108824 kB
SwapTotal:      67108860 kB
SwapFree:       66952332 kB
Dirty:              2816 kB
Writeback:             0 kB
AnonPages:        113512 kB
Mapped:            39312 kB
Shmem:             28308 kB
Slab:             171140 kB
SReclaimable:     143156 kB
SUnreclaim:        27984 kB
KernelStack:        3392 kB
PageTables:         5740 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505900 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 61184 MiB
End job on node117 at 2019-09-16 04:29:53