Trace number 4409770

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelOPT72 2287.67 286.509

General information on the benchmark

NameGolombRuler/
GolombRuler-a3v18-11_c18.xml
MD5SUMed3f9a47d1f1ba76ff72e7160e212ad4
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark72
Best CPU time to get the best result obtained on this benchmark885.287
Satisfiable
(Un)Satisfiability was proved
Number of variables132
Number of constraints56
Number of domains2
Minimum domain size121
Maximum domain size122
Distribution of domain sizes[{"size":121,"count":55},{"size":122,"count":11}]
Minimum variable degree0
Maximum variable degree11
Distribution of variable degrees[{"degree":0,"count":66},{"degree":2,"count":55},{"degree":10,"count":10},{"degree":11,"count":1}]
Minimum constraint arity3
Maximum constraint arity55
Distribution of constraint arities[{"arity":3,"count":55},{"arity":55,"count":1}]
Number of extensional constraints0
Number of intensional constraints55
Distribution of constraint types[{"type":"intension","count":55},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.04	c
0.00/0.04	c This is cosoco 2.00 --  
0.00/0.04	c
0.00/0.04	c command line: cosoco -model -nbcores=8 HOME/instance-4409770-1569841039.xml 
0.00/0.04	c enable optimization
0.00/0.04	c ========================================[ Problem Statistics ]===========================================
0.00/0.04	c |                                                                                                       
0.00/0.04	c |  Parse time        :         0.02 s 
0.00/0.04	c |
0.00/0.04	c |               Variables: 132
0.00/0.04	c |            Domain Sizes: 121..122
0.00/0.04	c |
0.00/0.04	c |             Constraints: 57
0.00/0.04	c |                   Arity: 1..55  -- Unary: 1  -- Ternary: 55
0.00/0.04	c | 
0.00/0.04	c |                   Types: 
0.00/0.04	c |                          All Different: 1
0.00/0.04	c |                          Intension: 1
0.00/0.04	c |                          Sum: 55
0.00/0.04	c |                          
0.00/0.04	c |               Objective: Minimize Intension
0.00/0.04	
0.00/0.04	c =========================================================================================================
0.00/0.04	c Parallel mode: Portfolio
0.00/0.04	c [pFactory][Group N°0] created (threads:8).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
0.00/0.04	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
0.00/0.04	c [pFactory][Group N°0] concurrent mode: enabled.
0.00/0.04	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
0.00/0.04	c [pFactory][Group N°0] task 7 launched on thread 1.
0.00/0.04	c [pFactory][Group N°0] task 6 launched on thread 2.
0.00/0.04	c [pFactory][Group N°0] task 5 launched on thread 0.
0.00/0.04	c [pFactory][Group N°0] task 4 launched on thread 6.
0.00/0.04	c [pFactory][Group N°0] task 3 launched on thread 7.
0.00/0.04	c [pFactory][Group N°0] task 2 launched on thread 4.
0.00/0.04	c [pFactory][Group N°0] task 1 launched on thread 5.
0.00/0.04	c [pFactory][Group N°0] task 0 launched on thread 3.
0.00/0.04	o 113
0.00/0.05	o 112
0.00/0.05	o 98
0.00/0.06	o 95
0.00/0.07	o 92
0.00/0.07	o 88
0.67/0.11	o 85
0.67/0.13	o 84
0.67/0.14	o 83
0.67/0.15	o 82
1.54/0.28	o 81
3.12/0.44	o 78
4.63/0.63	o 77
24.58/4.34	o 76
77.22/9.72	o 75
311.73/39.17	o 74
468.27/58.78	o 72
2286.87/286.50	c [pFactory][Group N°0] concurent mode: thread 5 has won with the task 1.
2286.87/286.50	c [pFactory][Group N°0] Thread N°0 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°1 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°2 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°3 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°4 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°5 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°6 is joined.
2286.87/286.50	c [pFactory][Group N°0] Thread N°7 is joined.
2286.87/286.50	c [pFactory][Group N°0] Return Code of the winner:3 (Thread N°5)
2286.87/286.50	s OPTIMUM FOUND
2286.87/286.50	c call to solver        : 8
2286.87/286.50	c
2286.87/286.50	c restarts              : 173663      
2286.87/286.50	c conflicts             : 1359708      (594 /sec)
2286.87/286.50	c decisions             : 2755246      (1205 /sec)
2286.87/286.50	c propagations          : 724277919   (316666 /sec)
2286.87/286.50	c root propagations     : 440         
2286.87/286.50	c filter calls          : 177666816      (77679 /sec)
2286.87/286.50	c useless filter calls  : 22863583       (12 %)
2286.87/286.50	c Memory used           : 572.93 MB
2286.87/286.50	c Best bound time (wc)  : 58.7768 s
2286.87/286.50	c CPU time              : 2287.2 s
2286.87/286.50	c real time             : 286.503 s
2286.87/286.50	
2286.87/286.50	
2286.87/286.50	v <instantiation type='solution' cost='72'>
2286.87/286.50	v <list>x[0] x[10] x[1] x[2] x[3] x[4] x[5] x[6] x[7] x[8] x[9] y[0][0] y[0][10] y[0][1] y[0][2] y[0][3] y[0][4] y[0][5] y[0][6] y[0][7] y[0][8] y[0][9] y[10][0] y[10][10] y[10][1] y[10][2] y[10][3] y[10][4] y[10][5] y[10][6] y[10][7] y[10][8] y[10][9] y[1][0] y[1][10] y[1][1] y[1][2] y[1][3] y[1][4] y[1][5] y[1][6] y[1][7] y[1][8] y[1][9] y[2][0] y[2][10] y[2][1] y[2][2] y[2][3] y[2][4] y[2][5] y[2][6] y[2][7] y[2][8] y[2][9] y[3][0] y[3][10] y[3][1] y[3][2] y[3][3] y[3][4] y[3][5] y[3][6] y[3][7] y[3][8] y[3][9] y[4][0] y[4][10] y[4][1] y[4][2] y[4][3] y[4][4] y[4][5] y[4][6] y[4][7] y[4][8] y[4][9] y[5][0] y[5][10] y[5][1] y[5][2] y[5][3] y[5][4] y[5][5] y[5][6] y[5][7] y[5][8] y[5][9] y[6][0] y[6][10] y[6][1] y[6][2] y[6][3] y[6][4] y[6][5] y[6][6] y[6][7] y[6][8] y[6][9] y[7][0] y[7][10] y[7][1] y[7][2] y[7][3] y[7][4] y[7][5] y[7][6] y[7][7] y[7][8] y[7][9] y[8][0] y[8][10] y[8][1] y[8][2] y[8][3] y[8][4] y[8][5] y[8][6] y[8][7] y[8][8] y[8][9] y[9][0] y[9][10] y[9][1] y[9][2] y[9][3] y[9][4] y[9][5] y[9][6] y[9][7] y[9][8] y[9][9] </list>
2286.87/286.50	v <values>0 72 1 9 19 24 31 52 56 58 69 * 72 1 9 19 24 31 52 56 58 69 * * * * * * * * * * * * 71 * 8 18 23 30 51 55 57 68 * 63 * * 10 15 22 43 47 49 60 * 53 * * * 5 12 33 37 39 50 * 48 * * * * 7 28 32 34 45 * 41 * * * * * 21 25 27 38 * 20 * * * * * * 4 6 17 * 16 * * * * * * * 2 13 * 14 * * * * * * * * 11 * 3 * * * * * * * * * </values>
2286.87/286.50	v </instantiation>
2286.87/286.50	

Verifier Data

OK	72

Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15256 MiB free)
  memory of node 1: 16384 MiB (14445 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409770-1569841039/watcher-4409770-1569841039 -o /tmp/evaluation-result-4409770-1569841039/solver-4409770-1569841039 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node104-1569826684-2698 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409770-1569841039.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=3839, runsolver pid=3836

[startup+0.100136 s]*
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411824/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619716 memory=6500 CPUtime=0.67 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 2180 0 0 0 67 0 0 0 20 0 9 0 560360143 634589184 1625 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154929 1625 843 493 0 148234 0
[pid=3839/tid=3841] ppid=3836 vsize=619716 memory=8317482817917895235 CPUtime=0.08 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 50 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938664143904 5081744 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619716 memory=4342489072520795241 CPUtime=0.08 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 71 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938655750976 5081762 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619716 memory=139896346461824 CPUtime=0.08 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 107 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938647358480 5076402 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619716 memory=0 CPUtime=0.07 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 44 0 0 0 7 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938638965400 5207536 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619716 memory=0 CPUtime=0.08 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 46 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938630572344 5074850 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619716 memory=0 CPUtime=0.08 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 47 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938622180368 5081758 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619716 memory=-1 CPUtime=0.08 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 54 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938613787664 5075616 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619716 memory=0 CPUtime=0.08 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 47 0 0 0 8 0 0 0 20 0 9 0 560360146 634589184 1625 33554432000 4194304 6211132 140723839064528 139938605394976 5389855 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 619716 KiB
Current children cumulated memory: 6500 KiB

[startup+0.210135 s]*
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411824/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=6368 CPUtime=1.54 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 2210 0 0 0 153 1 0 0 20 0 9 0 560360143 634322944 1592 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1592 843 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=8316850467074736180 CPUtime=0.19 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 57 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938664143904 5079201 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=1898493 CPUtime=0.19 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 71 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938655751440 5079295 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=139896346475132 CPUtime=0.19 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 115 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938647358136 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=-1 CPUtime=0.17 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 50 0 0 0 17 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938638965176 5078752 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=0 CPUtime=0.19 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 50 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938630572920 5075694 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=0 CPUtime=0.19 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 51 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938622180384 5149706 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=-1 CPUtime=0.19 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 54 0 0 0 19 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938613787920 5149690 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=0 CPUtime=0.18 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 48 0 0 0 18 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938605394976 5082803 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 1.54 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 6368 KiB

[startup+0.310136 s]*
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411560/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=6368 CPUtime=2.32 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 2212 0 0 0 231 1 0 0 20 0 9 0 560360143 634322944 1592 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1592 843 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=8317482817917895235 CPUtime=0.29 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 57 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938664143904 5082800 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=4126316290023845779 CPUtime=0.29 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 71 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938655751440 5081337 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=0 CPUtime=0.29 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 115 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938647358736 5151013 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=6944656592455097440 CPUtime=0.26 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 50 0 0 0 26 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938638965776 5075735 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=6656426216303648864 CPUtime=0.29 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 52 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938630572824 5076205 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=0 CPUtime=0.29 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 51 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938622180384 5076389 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=0 CPUtime=0.29 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 54 0 0 0 29 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938613787920 5075208 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=0 CPUtime=0.29 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 48 0 0 0 28 1 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938605394960 5149985 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2.32 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 6368 KiB

[startup+0.701136 s]
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411560/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=6368 CPUtime=5.37 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 2218 0 0 0 535 2 0 0 20 0 9 0 560360143 634322944 1592 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1592 843 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=14012 CPUtime=0.67 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 57 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938664144144 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=14048 CPUtime=0.67 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 71 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938655751440 5389851 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=6776 CPUtime=0.67 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 118 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938647358736 5150143 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=2120 CPUtime=0.62 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 50 0 0 0 62 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938638965664 5081189 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=532 CPUtime=0.67 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 52 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938630572824 5076483 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=1564 CPUtime=0.67 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 51 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938622180624 5081398 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=924 CPUtime=0.67 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 54 0 0 0 67 0 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938613787920 5081320 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=1760 CPUtime=0.66 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 51 0 0 0 64 2 0 0 20 0 9 0 560360146 634322944 1592 33554432000 4194304 6211132 140723839064528 139938605394960 5081341 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 5.37 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 6368 KiB

[startup+1.50114 s]
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411560/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7704 CPUtime=11.75 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 2862 0 0 0 1170 5 0 0 20 0 9 0 560360143 634322944 1926 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1926 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=6333 CPUtime=1.47 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 83 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938664143888 5074596 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=279792423724096 CPUtime=1.47 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 177 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938655751440 5392540 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=288230617509003574 CPUtime=1.47 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 185 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938647358592 5009344 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=0 CPUtime=1.41 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 166 0 0 0 141 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938638965776 5149273 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=6656426216303648864 CPUtime=1.47 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 161 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938630573184 5075833 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=6944652177228980320 CPUtime=1.47 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 158 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938622180368 5082431 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=7086805888168125288 CPUtime=1.47 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 100 0 0 0 147 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938613787664 5079284 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=0 CPUtime=1.46 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 118 0 0 0 141 5 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938605395072 5076410 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 11.75 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7704 KiB

[startup+3.11014 s]
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411848/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7704 CPUtime=24.58 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 3566 0 0 0 2448 10 0 0 20 0 9 0 560360143 634322944 1926 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1926 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=3616 CPUtime=3.08 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 157 0 0 0 308 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938664143888 5081341 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=0 CPUtime=3.08 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 254 0 0 0 308 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938655751440 5390088 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=7681353821851579923 CPUtime=3.07 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 268 0 0 0 307 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938647358592 5081375 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=139900641429119 CPUtime=2.99 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 278 0 0 0 299 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938638965776 5151090 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=5794251801077829732 CPUtime=3.08 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 255 0 0 0 308 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938630573184 5075672 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=7809921726209747284 CPUtime=3.08 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 271 0 0 0 308 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938622180368 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=6333 CPUtime=3.08 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 163 0 0 0 308 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938613787664 5082724 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=279792423724096 CPUtime=3.06 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 206 0 0 0 296 10 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938605395072 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 24.58 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7704 KiB

[startup+8.63513 s]
/proc/loadavg: 1.00 1.01 1.48 9/199 3848
/proc/meminfo: memFree=30411848/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7704 CPUtime=68.71 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 5661 0 0 0 6842 29 0 0 20 0 9 0 560360143 634322944 1926 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1926 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=-7035114785800479027 CPUtime=8.6 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 453 0 0 0 860 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938664144144 5081486 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=-6237260532469557610 CPUtime=8.61 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 504 0 0 0 861 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938655751440 5075568 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=-3123010188551861097 CPUtime=8.56 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 434 0 0 0 856 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938647358592 5081422 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=-3831251742559211316 CPUtime=8.52 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 663 0 0 0 852 0 0 0 20 0 9 0 560360146 634322944 1926 33554432000 4194304 6211132 140723839064528 139938638965776 5081320 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0

################
# More data... #
################

/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 12652 0 0 0 177440 47 0 0 20 0 9 0 560360143 634322944 1962 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1962 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=7848 CPUtime=222.12 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1376 0 0 0 22207 5 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938664143736 5074575 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=7848 CPUtime=222.23 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1288 0 0 0 22223 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938655751440 5082800 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=15526306778019 CPUtime=222.16 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1036 0 0 0 22216 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938647358328 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=7848 CPUtime=220.16 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1845 0 0 0 22016 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938638965624 5079305 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=7848 CPUtime=221.69 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1433 0 0 0 22169 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938630572920 5149240 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=7848 CPUtime=222.15 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1641 0 0 0 22215 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938622180216 5409455 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=7848 CPUtime=222.2 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1113 0 0 0 22220 0 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938613787416 5078872 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=7848 CPUtime=222.09 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1206 0 0 0 22169 40 0 0 20 0 9 0 560360146 634322944 1962 33554432000 4194304 6211132 140723839064528 139938605394584 5074395 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 1774.87 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7848 KiB

[startup+282.301 s]
/proc/loadavg: 8.49 5.48 3.27 9/200 3877
/proc/meminfo: memFree=31533660/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7924 CPUtime=2254.07 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 13338 0 0 0 225360 47 0 0 20 0 9 0 560360143 634322944 1981 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1981 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=7924 CPUtime=282.11 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1445 0 0 0 28206 5 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938664143736 5074940 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=7924 CPUtime=282.22 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1378 0 0 0 28222 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938655751440 5149680 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=7924 CPUtime=282.15 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1073 0 0 0 28215 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938647358328 5075616 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=7924 CPUtime=280.15 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1955 0 0 0 28015 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938638965624 5079253 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=7924 CPUtime=280.95 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1541 0 0 0 28095 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938630572920 5082431 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=-7035114785800479027 CPUtime=282.15 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1717 0 0 0 28215 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938622180216 5074575 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=7924 CPUtime=282.19 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1201 0 0 0 28219 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938613787416 5075792 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=7924 CPUtime=282.08 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1314 0 0 0 28168 40 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938605394616 5082393 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2254.07 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7924 KiB

[startup+286.509 s]
# the end of solver process 3839 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2287.2 s, system=0.47674 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+283.801 s]
/proc/loadavg: 8.49 5.48 3.27 9/200 3877
/proc/meminfo: memFree=31533660/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7924 CPUtime=2266.05 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 13339 0 0 0 226558 47 0 0 20 0 9 0 560360143 634322944 1981 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1981 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=780 CPUtime=283.61 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1445 0 0 0 28356 5 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938664143736 5149224 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=10864 CPUtime=283.72 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1378 0 0 0 28372 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938655751440 5081510 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=988 CPUtime=283.65 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1073 0 0 0 28365 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938647358328 5082818 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=2004 CPUtime=281.65 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1955 0 0 0 28165 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938638965624 5081371 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=1416 CPUtime=282.43 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1541 0 0 0 28243 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938630572920 5081747 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=1728 CPUtime=283.65 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1717 0 0 0 28365 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938622180216 5082243 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=692 CPUtime=283.69 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1202 0 0 0 28369 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938613787512 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=-7035114785800479027 CPUtime=283.58 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1314 0 0 0 28318 40 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938605394616 5075560 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2266.05 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7924 KiB

[startup+285.401 s]*
/proc/loadavg: 8.53 5.54 3.30 9/200 3877
/proc/meminfo: memFree=31533736/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7924 CPUtime=2278.89 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 13347 0 0 0 227842 47 0 0 20 0 9 0 560360143 634322944 1981 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1981 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=8317482817917895235 CPUtime=285.21 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1446 0 0 0 28516 5 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938664143736 5081375 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=4126316290023845779 CPUtime=285.33 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1379 0 0 0 28533 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938655751440 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=1564 CPUtime=285.26 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1074 0 0 0 28526 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938647358328 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=924 CPUtime=283.26 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1956 0 0 0 28326 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938638965528 5082354 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=1760 CPUtime=284.02 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1542 0 0 0 28402 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938630572920 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=288230574492221466 CPUtime=285.25 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1718 0 0 0 28525 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938622180216 5081713 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=288230583166042426 CPUtime=285.3 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1203 0 0 0 28530 0 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938613787512 5081439 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=16098169624726078 CPUtime=285.19 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1315 0 0 0 28479 40 0 0 20 0 9 0 560360146 634322944 1981 33554432000 4194304 6211132 140723839064528 139938605394584 5397407 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2278.89 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7924 KiB

[startup+286.201 s]
/proc/loadavg: 8.53 5.54 3.30 9/200 3877
/proc/meminfo: memFree=31533736/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7936 CPUtime=2285.22 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 13356 0 0 0 228475 47 0 0 20 0 9 0 560360143 634322944 1984 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1984 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=4008 CPUtime=286.01 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1452 0 0 0 28596 5 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938664143736 5079258 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=1228 CPUtime=286.12 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1380 0 0 0 28612 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938655751440 5397281 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=-7035114785800479027 CPUtime=286.05 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1074 0 0 0 28605 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938647358328 5149680 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=1416 CPUtime=284.05 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1957 0 0 0 28405 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938638965528 5076256 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=1728 CPUtime=284.81 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1542 0 0 0 28481 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938630572920 5082800 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=7924 CPUtime=286.05 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1719 0 0 0 28605 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938622180216 5075245 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=10864 CPUtime=286.09 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1203 0 0 0 28609 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938613787512 5186231 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=988 CPUtime=285.98 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1315 0 0 0 28558 40 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938605394584 5076013 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2285.22 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7936 KiB

[startup+286.401 s]*
/proc/loadavg: 8.53 5.54 3.30 9/200 3877
/proc/meminfo: memFree=31533860/32770624 swapFree=66986684/67108860
[pid=3839] ppid=3836 vsize=619456 memory=7936 CPUtime=2286.87 cores=0-7
/proc/3839/stat : 3839 (cosoco) S 3836 3839 2671 0 -1 1077944320 13364 0 0 0 228640 47 0 0 20 0 9 0 560360143 634322944 1984 33554432000 4194304 6211132 140723839064528 140723839062784 139938687287031 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
/proc/3839/statm: 154864 1984 845 493 0 148169 0
[pid=3839/tid=3841] ppid=3836 vsize=619456 memory=8317482817917895235 CPUtime=286.21 cores=0-7
/proc/3839/task/3841/stat : 3841 (cosoco) R 3836 3839 2671 0 -1 4202560 1452 0 0 0 28616 5 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938664143640 5081341 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3842] ppid=3836 vsize=619456 memory=4126316290023845779 CPUtime=286.33 cores=0-7
/proc/3839/task/3842/stat : 3842 (cosoco) R 3836 3839 2671 0 -1 4202560 1380 0 0 0 28633 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938655751440 5074429 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3843] ppid=3836 vsize=619456 memory=2120 CPUtime=286.26 cores=0-7
/proc/3839/task/3843/stat : 3843 (cosoco) R 3836 3839 2671 0 -1 4202560 1074 0 0 0 28626 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938647358328 5393253 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3844] ppid=3836 vsize=619456 memory=-1807685287725067907 CPUtime=284.26 cores=0-7
/proc/3839/task/3844/stat : 3844 (cosoco) R 3836 3839 2671 0 -1 4202560 1957 0 0 0 28426 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938638965624 5149706 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3845] ppid=3836 vsize=619456 memory=290763849282617370 CPUtime=285.01 cores=0-7
/proc/3839/task/3845/stat : 3845 (cosoco) R 3836 3839 2671 0 -1 4202560 1542 0 0 0 28501 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938630572920 5078748 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3846] ppid=3836 vsize=619456 memory=288230583166042426 CPUtime=286.25 cores=0-7
/proc/3839/task/3846/stat : 3846 (cosoco) R 3836 3839 2671 0 -1 4202560 1719 0 0 0 28625 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938622180216 5078752 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3847] ppid=3836 vsize=619456 memory=16098169624726078 CPUtime=286.3 cores=0-7
/proc/3839/task/3847/stat : 3847 (cosoco) R 3836 3839 2671 0 -1 4202560 1210 0 0 0 28630 0 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938613787512 5081379 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
[pid=3839/tid=3848] ppid=3836 vsize=619456 memory=1440 CPUtime=286.19 cores=0-7
/proc/3839/task/3848/stat : 3848 (cosoco) R 3836 3839 2671 0 -1 4202560 1316 0 0 0 28579 40 0 0 20 0 9 0 560360146 634322944 1984 33554432000 4194304 6211132 140723839064528 139938605394584 5079248 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13938688 140723839071249 140723839071341 140723839071341 140723839074254 0
Current children cumulated CPU time: 2286.87 s
Current children cumulated vsize: 619456 KiB
Current children cumulated memory: 7936 KiB

Child status: 0
Real time (s): 286.509
CPU time (s): 2287.67
CPU user time (s): 2287.2
CPU system time (s): 0.47674
CPU usage (%): 798.465
Max. virtual memory (cumulated for all children) (KiB): 619716
Max. memory (cumulated for all children) (KiB): 7936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2287.2
system time used= 0.47674
maximum resident set size= 8428
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13434
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 127
involuntary context switches= 17873


# summary of solver processes directly reported to runsolver:
#   pid: 3839
#   total CPU time (s): 2287.67
#   total CPU user time (s): 2287.2
#   total CPU system time (s): 0.47674

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.23659 second user time and 2.14561 second system time

The end

Launcher Data

Begin job on node104 at 2019-09-30 11:46:52
IDJOB=4409770
IDBENCH=141364
IDSOLVER=2877
FILE ID=node104/4409770-1569841039
RUNJOBID= node104-1569826684-2698
PBS_JOBID= 21705948
Free space on /tmp= 61492 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP18/GolombRuler/GolombRuler-a3v18-11_c18.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409770-1569841039/watcher-4409770-1569841039 -o /tmp/evaluation-result-4409770-1569841039/solver-4409770-1569841039 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node104-1569826684-2698 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409770-1569841039.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ed3f9a47d1f1ba76ff72e7160e212ad4
RANDOM SEED=910421452

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30414892 kB
MemAvailable:   31826236 kB
Buffers:          217596 kB
Cached:          1512976 kB
SwapCached:        22760 kB
Active:           315932 kB
Inactive:        1445772 kB
Active(anon):      21968 kB
Inactive(anon):    91164 kB
Active(file):     293964 kB
Inactive(file):  1354608 kB
Unevictable:      109656 kB
Mlocked:          109656 kB
SwapTotal:      67108860 kB
SwapFree:       66986684 kB
Dirty:            858528 kB
Writeback:         67900 kB
AnonPages:        118548 kB
Mapped:            27276 kB
Shmem:             73632 kB
Slab:             186420 kB
SReclaimable:     157212 kB
SUnreclaim:        29208 kB
KernelStack:        3424 kB
PageTables:         5912 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     534544 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 62028 MiB
End job on node104 at 2019-09-30 11:51:38