Trace number 4409715

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)0 19828 2520.1

General information on the benchmark

NameBinPacking/BinPacking-tab-sw120/
BinPacking-tab-sw120-75.xml
MD5SUM9cdf82428becd6b5ad716031980a59d2
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark2520.02
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of constraints25
Number of domains2
Minimum domain size23
Maximum domain size47
Distribution of domain sizes[{"size":23,"count":1},{"size":47,"count":132}]
Minimum variable degree2
Maximum variable degree4
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":110},{"degree":4,"count":22}]
Minimum constraint arity6
Maximum constraint arity132
Distribution of constraint arities[{"arity":6,"count":22},{"arity":23,"count":1},{"arity":132,"count":2}]
Number of extensional constraints22
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":22},{"type":"lex","count":1},{"type":"count","count":1},{"type":"cardinality","count":1}]
Optimization problemYES
Type of objectivemax VAR

Solver Data 

38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
38.10/38.18	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
38.10/38.18	c
11502.98/1477.31	c
11502.98/1477.31	c This is cosoco 2.00 --  
11502.98/1477.31	c
11502.98/1477.31	c command line: cosoco -model -nbcores=8 HOME/instance-4409715-1569834239.xml 
11502.98/1477.31	c enable optimization
11502.98/1477.31	c ========================================[ Problem Statistics ]===========================================
11502.98/1477.31	c |                                                                                                       
11502.98/1477.31	c |  Parse time        :        40.38 s 
11502.98/1477.31	c |
11502.98/1477.31	c |               Variables: 133
11502.98/1477.31	c |            Domain Sizes: 23..47
11502.98/1477.31	c |
11502.98/1477.31	c |             Constraints: 92
11502.98/1477.31	c |                   Arity: 1..132  -- Unary: 1
11502.98/1477.31	c | 
11502.98/1477.31	c |                   Types: 
11502.98/1477.31	c |                          Exactly K: 47
11502.98/1477.31	c |                          Exactly K variable: 1
11502.98/1477.31	c |                          Extension: 22  (nb tuples: 3581958..3581958) -- (shared: 168)
11502.98/1477.31	c |                          Intension: 1
11502.98/1477.31	c |                          Lex: 21
11502.98/1477.31	c |                          
11502.98/1477.31	c |               Objective: Maximize Intension
11502.98/1477.31	
11502.98/1477.31	c =========================================================================================================
11502.98/1477.31	c Parallel mode: Portfolio
11502.98/1477.31	c [pFactory][Group N°0] created (threads:8).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
11502.98/1477.31	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
11502.98/1477.31	c [pFactory][Group N°0] concurrent mode: enabled.
11502.98/1477.31	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
11502.98/1477.31	c [pFactory][Group N°0] task 7 launched on thread 1.
11502.98/1477.31	c [pFactory][Group N°0] task 6 launched on thread 0.
11502.98/1477.31	c [pFactory][Group N°0] task 5 launched on thread 5.
11502.98/1477.31	c [pFactory][Group N°0] task 4 launched on thread 2.
11502.98/1477.31	c [pFactory][Group N°0] task 3 launched on thread 6.
11502.98/1477.31	c [pFactory][Group N°0] task 2 launched on thread 7.
11502.98/1477.31	c [pFactory][Group N°0] task 1 launched on thread 3.
11502.98/1477.31	c [pFactory][Group N°0] task 0 launched on thread 4.
11502.98/1477.31	o 0
19827.85/2520.02	
19827.85/2520.02	c *** INTERRUPTED ***
19827.85/2520.02	c call to solver        : 0
19827.85/2520.02	c
19827.85/2520.02	c restarts              : 259         
19827.85/2520.02	c conflicts             : 2727         (0 /sec)
19827.85/2520.02	c decisions             : 11148        (1 /sec)
19827.85/2520.02	c propagations          : 916261      (46 /sec)
19827.85/2520.02	c root propagations     : 682         
19827.85/2520.02	c filter calls          : 1437069        (73 /sec)
19827.85/2520.02	c useless filter calls  : 1397480        (97 %)
19827.85/2520.02	c Memory used           : 6907.99 MB
19827.85/2520.02	c Best bound time (wc)  : 1477.31 s
19827.85/2520.02	c CPU time              : 19812 s
19827.85/2520.02	c real time             : 2520.02 s
19827.85/2520.02	
19827.85/2520.02	s SATISFIABLE
19827.85/2520.02	c Best value found: 0
19827.85/2520.02	
19827.85/2520.02	
19827.85/2520.02	v <instantiation type='solution' cost='0'>
19827.85/2520.02	v <list>b[0][0] b[0][1] b[0][2] b[0][3] b[0][4] b[0][5] b[10][0] b[10][1] b[10][2] b[10][3] b[10][4] b[10][5] b[11][0] b[11][1] b[11][2] b[11][3] b[11][4] b[11][5] b[12][0] b[12][1] b[12][2] b[12][3] b[12][4] b[12][5] b[13][0] b[13][1] b[13][2] b[13][3] b[13][4] b[13][5] b[14][0] b[14][1] b[14][2] b[14][3] b[14][4] b[14][5] b[15][0] b[15][1] b[15][2] b[15][3] b[15][4] b[15][5] b[16][0] b[16][1] b[16][2] b[16][3] b[16][4] b[16][5] b[17][0] b[17][1] b[17][2] b[17][3] b[17][4] b[17][5] b[18][0] b[18][1] b[18][2] b[18][3] b[18][4] b[18][5] b[19][0] b[19][1] b[19][2] b[19][3] b[19][4] b[19][5] b[1][0] b[1][1] b[1][2] b[1][3] b[1][4] b[1][5] b[20][0] b[20][1] b[20][2] b[20][3] b[20][4] b[20][5] b[21][0] b[21][1] b[21][2] b[21][3] b[21][4] b[21][5] b[2][0] b[2][1] b[2][2] b[2][3] b[2][4] b[2][5] b[3][0] b[3][1] b[3][2] b[3][3] b[3][4] b[3][5] b[4][0] b[4][1] b[4][2] b[4][3] b[4][4] b[4][5] b[5][0] b[5][1] b[5][2] b[5][3] b[5][4] b[5][5] b[6][0] b[6][1] b[6][2] b[6][3] b[6][4] b[6][5] b[7][0] b[7][1] b[7][2] b[7][3] b[7][4] b[7][5] b[8][0] b[8][1] b[8][2] b[8][3] b[8][4] b[8][5] b[9][0] b[9][1] b[9][2] b[9][3] b[9][4] b[9][5] x </list>
19827.85/2520.02	v <values>200 200 200 200 197 0 184 182 182 180 179 0 183 183 182 181 178 0 176 174 173 171 171 0 175 170 158 157 156 0 174 170 161 161 156 153 173 170 163 159 159 150 173 170 161 160 159 153 172 167 167 164 164 152 171 170 162 160 156 152 171 166 166 164 163 154 200 197 197 196 196 0 168 168 168 166 166 154 163 163 163 163 160 155 196 196 196 196 190 0 195 193 192 191 191 0 194 194 194 193 193 0 190 190 189 188 187 0 190 169 168 161 158 150 189 171 161 161 158 150 187 187 186 186 185 0 185 178 178 178 176 0 0 </values>
19827.85/2520.02	v </instantiation>
19827.85/2520.02

Verifier Data 

OK	0

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15292 MiB free)
  memory of node 1: 16384 MiB (15302 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409715-1569834239/watcher-4409715-1569834239 -o /tmp/evaluation-result-4409715-1569834239/solver-4409715-1569834239 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node116-1569829077-3229 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409715-1569834239.xml 

running on 8 cores: 0-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=3973, runsolver pid=3970
Current StackSize limit: 8192 KiB


[startup+0.100107 s]*
/proc/loadavg: 6.32 8.54 8.92 2/193 3974
/proc/meminfo: memFree=31325408/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=31312 memory=7416 CPUtime=0.1 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 2109 0 0 0 10 0 0 0 20 0 1 0 559365554 32063488 1854 33554432000 4194304 6211132 140732432889872 140732432886408 5743398 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 7828 1854 806 493 0 1133 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31312 KiB
Current children cumulated memory: 7416 KiB

[startup+0.210507 s]*
/proc/loadavg: 6.32 8.54 8.92 2/193 3974
/proc/meminfo: memFree=31324984/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=32224 memory=8124 CPUtime=0.21 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 2386 0 0 0 21 0 0 0 20 0 1 0 559365554 32997376 2031 33554432000 4194304 6211132 140732432889872 140732432887144 139766922597504 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 8056 2031 806 493 0 1361 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32224 KiB
Current children cumulated memory: 8124 KiB

[startup+0.30982 s]*
/proc/loadavg: 6.32 8.54 8.92 2/193 3974
/proc/meminfo: memFree=31324212/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=33256 memory=8760 CPUtime=0.3 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 2743 0 0 0 30 0 0 0 20 0 1 0 559365554 34054144 2190 33554432000 4194304 6211132 140732432889872 140732432887144 139766906534885 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 8314 2190 806 493 0 1619 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33256 KiB
Current children cumulated memory: 8760 KiB

[startup+0.700322 s]
/proc/loadavg: 6.32 8.54 8.92 2/193 3974
/proc/meminfo: memFree=31323468/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=36244 memory=11820 CPUtime=0.69 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 3332 0 0 0 69 0 0 0 20 0 1 0 559365554 37113856 2955 33554432000 4194304 6211132 140732432889872 140732432887144 5816178 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 9061 2955 806 493 0 2366 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36244 KiB
Current children cumulated memory: 11820 KiB

[startup+1.50027 s]
/proc/loadavg: 6.32 8.54 8.92 2/194 3976
/proc/meminfo: memFree=31319692/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=42352 memory=16712 CPUtime=1.49 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 4345 0 0 0 148 1 0 0 20 0 1 0 559365554 43368448 4178 33554432000 4194304 6211132 140732432889872 140732432887144 5484894 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 10588 4178 806 493 0 3893 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 42352 KiB
Current children cumulated memory: 16712 KiB

[startup+3.1098 s]
/proc/loadavg: 5.89 8.42 8.88 2/194 3976
/proc/meminfo: memFree=31305632/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=54568 memory=29060 CPUtime=3.1 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 6797 0 0 0 308 2 0 0 20 0 1 0 559365554 55877632 7265 33554432000 4194304 6211132 140732432889872 140732432887144 5818586 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 13642 7265 806 493 0 6947 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 54568 KiB
Current children cumulated memory: 29060 KiB

[startup+6.30031 s]
/proc/loadavg: 5.89 8.42 8.88 2/194 3976
/proc/meminfo: memFree=31286336/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=79000 memory=49140 CPUtime=6.29 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 10641 0 0 0 626 3 0 0 20 0 1 0 559365554 80896000 12285 33554432000 4194304 6211132 140732432889872 140732432887144 139766906534885 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 19750 12285 806 493 0 13055 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 79000 KiB
Current children cumulated memory: 49140 KiB

[startup+12.7003 s]
/proc/loadavg: 5.50 8.30 8.84 2/193 3976
/proc/meminfo: memFree=31247308/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=127864 memory=92132 CPUtime=12.69 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 17383 0 0 0 1264 5 0 0 20 0 1 0 559365554 130932736 23033 33554432000 4194304 6211132 140732432889872 140732432887144 5707938 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 31966 23033 806 493 0 25271 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 127864 KiB
Current children cumulated memory: 92132 KiB

[startup+25.5003 s]
/proc/loadavg: 4.51 7.94 8.71 2/193 3976
/proc/meminfo: memFree=31160188/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=226648 memory=178508 CPUtime=25.49 cores=0-7
/proc/3973/stat : 3973 (cosoco) R 3970 3973 3202 0 -1 4202496 30493 0 0 0 2539 10 0 0 20 0 1 0 559365554 232087552 44627 33554432000 4194304 6211132 140732432889872 140732432887144 5707973 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 56662 44627 806 493 0 49967 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 226648 KiB
Current children cumulated memory: 178508 KiB

[startup+51.1113 s]
/proc/loadavg: 4.39 7.61 8.58 9/201 3986
/proc/meminfo: memFree=24994444/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6326704 CPUtime=117.05 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 1314754 0 0 0 11323 382 0 0 20 0 9 0 559365554 7243546624 1581676 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581676 901 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6326704 CPUtime=9.44 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 96172 0 0 0 890 54 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766899432120 5039199 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6326704 CPUtime=9.44 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 93144 0 0 0 938 6 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766815435792 5039022 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=0 CPUtime=9.44 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 102097 0 0 0 880 64 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766807042744 5039029 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=10552 CPUtime=9.42 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 93250 0 0 0 938 4 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766798650384 5039323 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6326704 CPUtime=9.43 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 231704 0 0 0 929 14 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766790257336 5039132 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6326704 CPUtime=9.44 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 99997 0 0 0 935 9 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766781864632 5039022 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=279543986589376 CPUtime=9.29 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 97425 0 0 0 879 50 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766773471928 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6545 CPUtime=9.43 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 100209 0 0 0 892 51 0 0 20 0 9 0 559369721 7243546624 1581676 33554432000 4194304 6211132 140732432889872 139766765079224 5039026 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 117.05 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6326704 KiB

[startup+102.301 s]
/proc/loadavg: 6.43 7.67 8.56 9/201 3989
/proc/meminfo: memFree=24991652/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6326732 CPUtime=525.74 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 3022775 0 0 0 52024 550 0 0 20 0 9 0 559365554 7243546624 1581683 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581683 901 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6326732 CPUtime=60.6 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 286170 0 0 0 5976 84 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766899431960 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6326732 CPUtime=60.62 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 278675 0 0 0 6046 16 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766815435792 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=55 CPUtime=60.63 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 286610 0 0 0 5982 81 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766807042744 5037821 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=279543987088224 CPUtime=60.6 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 254603 0 0 0 6047 13 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766798650384 5037759 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6326732 CPUtime=60.63 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 612593 0 0 0 6028 35 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766790257336 5037841 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=111636 CPUtime=60.61 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 294490 0 0 0 6039 22 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766781864632 5037821 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=179036 CPUtime=59.91 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 303669 0 0 0 5907 84 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766773471928 5039121 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6326732 CPUtime=60.4 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 305242 0 0 0 5956 84 0 0 20 0 9 0 559369721 7243546624 1581683 33554432000 4194304 6211132 140732432889872 139766765079224 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 525.74 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6326732 KiB

[startup+162.301 s]
/proc/loadavg: 7.43 7.73 8.52 9/200 3992
/proc/meminfo: memFree=24994512/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6326820 CPUtime=1004.71 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 3833661 0 0 0 99786 685 0 0 20 0 9 0 559365554 7243546624 1581705 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581705 901 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.44 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 382707 0 0 0 11954 90 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766899431992 5038999 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.46 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 376564 0 0 0 11988 58 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766815435792 5039029 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.48 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 375711 0 0 0 11916 132 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766807042536 5039029 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.58 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 353146 0 0 0 12039 19 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766798649912 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.62 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 769501 0 0 0 12017 45 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766790257336 5039014 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.6 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 389894 0 0 0 12033 27 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766781864504 5038944 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=6326820 CPUtime=119.4 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 391280 0 0 0 11848 92 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766773471928 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6326820 CPUtime=120.38 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 394111 0 0 0 11948 90 0 0 20 0 9 0 559369721 7243546624 1581705 33554432000 4194304 6211132 140732432889872 139766765079224 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 1004.71 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6326820 KiB

[startup+222.301 s]
/proc/loadavg: 7.84 7.80 8.49 9/199 3995

################
# More data... #
################

/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1336790 0 0 0 221791 221 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2206.07 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1028366 0 0 0 220492 115 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5039047 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2214.93 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1450159 0 0 0 221371 122 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2220.18 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1420961 0 0 0 221912 106 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5037825 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=1984 CPUtime=2216.23 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1420760 0 0 0 221410 213 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2212.34 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1332872 0 0 0 221066 168 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 17770.3 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB

[startup+2322.3 s]
/proc/loadavg: 8.70 8.33 8.34 9/199 4159
/proc/meminfo: memFree=24994332/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6327140 CPUtime=18249.3 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 11497676 0 0 0 1823371 1562 0 0 20 0 9 0 559365554 7243546624 1581785 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581785 902 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2280.17 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 1578459 0 0 0 227825 192 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766899432720 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2278.5 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 1444779 0 0 0 227561 289 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766815435320 5039228 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=1820303 CPUtime=2280.12 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1349252 0 0 0 227789 223 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5037823 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2266.07 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1038029 0 0 0 226491 116 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2274.92 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1463090 0 0 0 227370 122 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2280.17 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1443714 0 0 0 227910 107 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2276.2 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1433655 0 0 0 227406 214 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2271.45 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1345942 0 0 0 226976 169 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 18249.3 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB

[startup+2382.3 s]
/proc/loadavg: 8.45 8.34 8.34 9/199 4162
/proc/meminfo: memFree=24994372/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6327140 CPUtime=18728.4 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 11631068 0 0 0 1871266 1572 0 0 20 0 9 0 559365554 7243546624 1581785 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581785 902 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2340.17 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 1607178 0 0 0 233822 195 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766899432720 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2338.51 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 1468377 0 0 0 233560 291 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766815435320 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2340.1 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1360353 0 0 0 233787 223 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=164 CPUtime=2326.07 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1047818 0 0 0 232490 117 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2334.9 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1476427 0 0 0 233366 124 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2340.15 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1464652 0 0 0 233907 108 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2336.19 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1446732 0 0 0 233405 214 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=8392 CPUtime=2330.56 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1358775 0 0 0 232886 170 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 18728.4 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB

[startup+2442.3 s]
/proc/loadavg: 8.16 8.28 8.32 9/199 4167
/proc/meminfo: memFree=24994424/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6327140 CPUtime=19207.4 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 11774759 0 0 0 1919156 1586 0 0 20 0 9 0 559365554 7243546624 1581785 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581785 902 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2400.16 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 1633838 0 0 0 239819 197 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766899432720 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2398.51 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 1491603 0 0 0 239557 294 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766815435320 5039132 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2400.09 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1377214 0 0 0 239785 224 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=-7035114785800479027 CPUtime=2386.05 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1057406 0 0 0 238488 117 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2394.9 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1489637 0 0 0 239365 125 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2400.14 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1492846 0 0 0 239904 110 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2396.17 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1459602 0 0 0 239402 215 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2389.64 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1371857 0 0 0 238793 171 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 19207.4 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB

[startup+2502.3 s]
/proc/loadavg: 8.09 8.24 8.30 9/199 4170
/proc/meminfo: memFree=24994596/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6327140 CPUtime=19686.5 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 11905792 0 0 0 1967050 1597 0 0 20 0 9 0 559365554 7243546624 1581785 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581785 902 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2460.16 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 1658710 0 0 0 245816 200 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766899432720 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2458.5 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 1512876 0 0 0 245554 296 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766815435320 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2460.08 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1391678 0 0 0 245782 226 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2446.06 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1067115 0 0 0 244488 118 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2454.91 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1500512 0 0 0 245365 126 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2460.12 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1516698 0 0 0 245900 112 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=6327140 CPUtime=2456.17 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1472657 0 0 0 245401 216 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=3612 CPUtime=2448.73 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1384790 0 0 0 244701 172 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 19686.5 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.07 8.22 8.30 9/199 4171
/proc/meminfo: memFree=24994624/32770688 swapFree=67001808/67108860
[pid=3973] ppid=3970 vsize=7073776 memory=6327140 CPUtime=19827.8 cores=0-7
/proc/3973/stat : 3973 (cosoco) S 3970 3973 3202 0 -1 1077944320 11926219 0 0 0 1981186 1599 0 0 20 0 9 0 559365554 7243546624 1581785 33554432000 4194304 6211132 140732432889872 140732432888128 139766922575607 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
/proc/3973/statm: 1768444 1581785 902 493 0 1761749 0
[pid=3973/tid=3977] ppid=3970 vsize=7073776 memory=1398722017469774279 CPUtime=2477.87 cores=0-7
/proc/3973/task/3977/stat : 3977 (cosoco) R 3970 3973 3202 0 -1 4202560 1665053 0 0 0 247586 201 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766899432720 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3978] ppid=3970 vsize=7073776 memory=4126316290023845779 CPUtime=2476.21 cores=0-7
/proc/3973/task/3978/stat : 3978 (cosoco) R 3970 3973 3202 0 -1 4202560 1512884 0 0 0 247325 296 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766815435320 5037825 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3979] ppid=3970 vsize=7073776 memory=2524 CPUtime=2477.78 cores=0-7
/proc/3973/task/3979/stat : 3979 (cosoco) R 3970 3973 3202 0 -1 4202560 1391735 0 0 0 247552 226 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766807042616 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3980] ppid=3970 vsize=7073776 memory=1760 CPUtime=2463.77 cores=0-7
/proc/3973/task/3980/stat : 3980 (cosoco) R 3970 3973 3202 0 -1 4202560 1067145 0 0 0 246259 118 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766798650056 5038999 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3981] ppid=3970 vsize=7073776 memory=111636 CPUtime=2472.62 cores=0-7
/proc/3973/task/3981/stat : 3981 (cosoco) R 3970 3973 3202 0 -1 4202560 1500515 0 0 0 247136 126 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766790257208 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3982] ppid=3970 vsize=7073776 memory=-7035114785800479027 CPUtime=2477.82 cores=0-7
/proc/3973/task/3982/stat : 3982 (cosoco) R 3970 3973 3202 0 -1 4202560 1530503 0 0 0 247669 113 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766781864424 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3983] ppid=3970 vsize=7073776 memory=4126316290023845779 CPUtime=2473.88 cores=0-7
/proc/3973/task/3983/stat : 3983 (cosoco) R 3970 3973 3202 0 -1 4202560 1472788 0 0 0 247172 216 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766773471800 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
[pid=3973/tid=3984] ppid=3970 vsize=7073776 memory=111636 CPUtime=2466.18 cores=0-7
/proc/3973/task/3984/stat : 3984 (cosoco) R 3970 3973 3202 0 -1 4202560 1384840 0 0 0 246446 172 0 0 20 0 9 0 559369721 7243546624 1581785 33554432000 4194304 6211132 140732432889872 139766765079096 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 25649152 140732432892945 140732432893037 140732432893037 140732432895950 0
Current children cumulated CPU time: 19827.8 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327140 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.1 s]
# the end of solver process 3973 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=19812 s, system=16.0734 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.1
CPU time (s): 19828
CPU user time (s): 19812
CPU system time (s): 16.0734
CPU usage (%): 786.795
Max. virtual memory (cumulated for all children) (KiB): 7073776
Max. memory (cumulated for all children) (KiB): 6327140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 19812
system time used= 16.0734
maximum resident set size= 6327316
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11926270
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 271
involuntary context switches= 163584


# summary of solver processes directly reported to runsolver:
#   pid: 3973
#   total CPU time (s): 19828
#   total CPU user time (s): 19812
#   total CPU system time (s): 16.0734

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 13.0927 second user time and 24.7224 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-30 11:03:18
IDJOB=4409715
IDBENCH=138083
IDSOLVER=2877
FILE ID=node116/4409715-1569834239
RUNJOBID= node116-1569829077-3229
PBS_JOBID= 21705937
Free space on /tmp= 61952 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/BinPacking/BinPacking-tab-sw120/BinPacking-tab-sw120-75.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409715-1569834239/watcher-4409715-1569834239 -o /tmp/evaluation-result-4409715-1569834239/solver-4409715-1569834239 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node116-1569829077-3229 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409715-1569834239.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9cdf82428becd6b5ad716031980a59d2
RANDOM SEED=1244585799

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        31329068 kB
MemAvailable:   31852368 kB
Buffers:          211136 kB
Cached:           632360 kB
SwapCached:         3336 kB
Active:           465124 kB
Inactive:         383352 kB
Active(anon):      22896 kB
Inactive(anon):    63244 kB
Active(file):     442228 kB
Inactive(file):   320108 kB
Unevictable:      109448 kB
Mlocked:          109448 kB
SwapTotal:      67108860 kB
SwapFree:       67001808 kB
Dirty:             85680 kB
Writeback:             0 kB
AnonPages:        112748 kB
Mapped:            26884 kB
Shmem:             72424 kB
Slab:             183396 kB
SReclaimable:     153600 kB
SUnreclaim:        29796 kB
KernelStack:        3392 kB
PageTables:         4980 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     538712 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 61948 MiB
End job on node116 at 2019-09-30 11:45:18