Trace number 4398455

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)0 19862.1 2520.08

General information on the benchmark

NameBinPacking/BinPacking-tab-sw120/
BinPacking-tab-sw120-75.xml
MD5SUM9cdf82428becd6b5ad716031980a59d2
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark2520.02
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of constraints25
Number of domains2
Minimum domain size23
Maximum domain size47
Distribution of domain sizes[{"size":23,"count":1},{"size":47,"count":132}]
Minimum variable degree2
Maximum variable degree4
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":110},{"degree":4,"count":22}]
Minimum constraint arity6
Maximum constraint arity132
Distribution of constraint arities[{"arity":6,"count":22},{"arity":23,"count":1},{"arity":132,"count":2}]
Number of extensional constraints22
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":22},{"type":"lex","count":1},{"type":"count","count":1},{"type":"cardinality","count":1}]
Optimization problemYES
Type of objectivemax VAR

Solver Data 

33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
33.29/33.38	c Create Cardinality(vars,values,occurs) constraint using 132 Exactly/AtMost.. constraint 
33.29/33.38	c
9255.74/1191.53	c
9255.74/1191.53	c This is cosoco 2.00 --  
9255.74/1191.53	c
9255.74/1191.53	c command line: cosoco -model -nbcores=8 HOME/instance-4398455-1568611136.xml 
9255.74/1191.53	c enable optimization
9255.74/1191.53	c ========================================[ Problem Statistics ]===========================================
9255.74/1191.53	c |                                                                                                       
9255.74/1191.53	c |  Parse time        :        35.45 s 
9255.74/1191.53	c |
9255.74/1191.53	c |               Variables: 133
9255.74/1191.53	c |            Domain Sizes: 23..47
9255.74/1191.53	c |
9255.74/1191.53	c |             Constraints: 92
9255.74/1191.53	c |                   Arity: 1..132  -- Unary: 1
9255.74/1191.53	c | 
9255.74/1191.53	c |                   Types: 
9255.74/1191.53	c |                          Exactly K: 47
9255.74/1191.53	c |                          Exactly K variable: 1
9255.74/1191.53	c |                          Extension: 22  (nb tuples: 3581958..3581958) -- (shared: 168)
9255.74/1191.53	c |                          Intension: 1
9255.74/1191.53	c |                          Lex: 21
9255.74/1191.53	c |                          
9255.74/1191.53	c |               Objective: Maximize Intension
9255.74/1191.53	
9255.74/1191.53	c =========================================================================================================
9255.74/1191.53	c Parallel mode: Portfolio
9255.74/1191.53	c [pFactory][Group N°0] created (threads:8).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
9255.74/1191.53	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
9255.74/1191.53	c [pFactory][Group N°0] concurrent mode: enabled.
9255.74/1191.53	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
9255.74/1191.53	c [pFactory][Group N°0] task 7 launched on thread 4.
9255.74/1191.53	c [pFactory][Group N°0] task 6 launched on thread 1.
9255.74/1191.53	c [pFactory][Group N°0] task 5 launched on thread 2.
9255.74/1191.53	c [pFactory][Group N°0] task 4 launched on thread 0.
9255.74/1191.53	c [pFactory][Group N°0] task 3 launched on thread 6.
9255.74/1191.53	c [pFactory][Group N°0] task 2 launched on thread 7.
9255.74/1191.53	c [pFactory][Group N°0] task 1 launched on thread 5.
9255.74/1191.53	c [pFactory][Group N°0] task 0 launched on thread 3.
9255.74/1191.53	o 0
19861.89/2520.01	
19861.89/2520.01	c *** INTERRUPTED ***
19861.89/2520.01	c call to solver        : 1
19861.89/2520.01	c
19861.89/2520.01	c restarts              : 193         
19861.89/2520.01	c conflicts             : 2063         (0 /sec)
19861.89/2520.01	c decisions             : 7963         (0 /sec)
19861.89/2520.01	c propagations          : 717891      (36 /sec)
19861.89/2520.01	c root propagations     : 682         
19861.89/2520.01	c filter calls          : 1115552        (56 /sec)
19861.89/2520.01	c useless filter calls  : 1084941        (97 %)
19861.89/2520.01	c Memory used           : 6907.99 MB
19861.89/2520.01	c Best bound time (wc)  : 1191.53 s
19861.89/2520.01	c CPU time              : 19849.3 s
19861.89/2520.01	c real time             : 2520.01 s
19861.89/2520.01	
19861.89/2520.01	s SATISFIABLE
19861.89/2520.01	c Best value found: 0
19861.89/2520.01	
19861.89/2520.01	
19861.89/2520.01	v <instantiation type='solution' cost='0'>
19861.89/2520.01	v <list>b[0][0] b[0][1] b[0][2] b[0][3] b[0][4] b[0][5] b[10][0] b[10][1] b[10][2] b[10][3] b[10][4] b[10][5] b[11][0] b[11][1] b[11][2] b[11][3] b[11][4] b[11][5] b[12][0] b[12][1] b[12][2] b[12][3] b[12][4] b[12][5] b[13][0] b[13][1] b[13][2] b[13][3] b[13][4] b[13][5] b[14][0] b[14][1] b[14][2] b[14][3] b[14][4] b[14][5] b[15][0] b[15][1] b[15][2] b[15][3] b[15][4] b[15][5] b[16][0] b[16][1] b[16][2] b[16][3] b[16][4] b[16][5] b[17][0] b[17][1] b[17][2] b[17][3] b[17][4] b[17][5] b[18][0] b[18][1] b[18][2] b[18][3] b[18][4] b[18][5] b[19][0] b[19][1] b[19][2] b[19][3] b[19][4] b[19][5] b[1][0] b[1][1] b[1][2] b[1][3] b[1][4] b[1][5] b[20][0] b[20][1] b[20][2] b[20][3] b[20][4] b[20][5] b[21][0] b[21][1] b[21][2] b[21][3] b[21][4] b[21][5] b[2][0] b[2][1] b[2][2] b[2][3] b[2][4] b[2][5] b[3][0] b[3][1] b[3][2] b[3][3] b[3][4] b[3][5] b[4][0] b[4][1] b[4][2] b[4][3] b[4][4] b[4][5] b[5][0] b[5][1] b[5][2] b[5][3] b[5][4] b[5][5] b[6][0] b[6][1] b[6][2] b[6][3] b[6][4] b[6][5] b[7][0] b[7][1] b[7][2] b[7][3] b[7][4] b[7][5] b[8][0] b[8][1] b[8][2] b[8][3] b[8][4] b[8][5] b[9][0] b[9][1] b[9][2] b[9][3] b[9][4] b[9][5] x </list>
19861.89/2520.01	v <values>200 168 158 158 156 156 196 169 166 161 154 154 196 168 160 160 160 155 196 163 161 161 161 158 195 190 189 189 187 0 194 193 183 174 171 0 194 193 180 179 176 0 194 192 187 187 185 0 188 168 166 163 163 152 184 183 182 182 182 0 174 171 168 167 167 153 200 166 163 162 156 153 173 173 171 170 170 0 173 172 170 170 170 0 200 164 163 161 159 152 200 164 163 150 150 150 200 164 161 159 159 157 197 191 190 181 178 0 197 191 185 176 175 0 197 190 190 186 186 0 196 196 178 171 171 0 196 193 178 178 166 0 0 </values>
19861.89/2520.01	v </instantiation>
19861.89/2520.01

Verifier Data 

OK	0

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14354 MiB free)
  memory of node 1: 16384 MiB (14874 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398455-1568611136/watcher-4398455-1568611136 -o /tmp/evaluation-result-4398455-1568611136/solver-4398455-1568611136 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node134-1568611094-22102 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398455-1568611136.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22119, runsolver pid=22116

[startup+0.100151 s]*
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29927564/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=31444 memory=7676 CPUtime=0.1 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 2136 0 0 0 10 0 0 0 20 0 1 0 437364139 32198656 1919 33554432000 4194304 6211092 140721876622624 140721876619160 139895171953792 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 7861 1919 806 493 0 1166 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31444 KiB
Current children cumulated memory: 7676 KiB

[startup+0.209654 s]*
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29926448/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=32224 memory=8388 CPUtime=0.21 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 2441 0 0 0 21 0 0 0 20 0 1 0 437364139 32997376 2097 33554432000 4194304 6211092 140721876622624 140721876619160 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 8056 2097 806 493 0 1361 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32224 KiB
Current children cumulated memory: 8388 KiB

[startup+0.308904 s]*
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29925572/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=33520 memory=9020 CPUtime=0.3 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 2821 0 0 0 30 0 0 0 20 0 1 0 437364139 34324480 2255 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 8380 2255 806 493 0 1685 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33520 KiB
Current children cumulated memory: 9020 KiB

[startup+0.700276 s]
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29923124/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=36640 memory=11964 CPUtime=0.69 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 3420 0 0 0 69 0 0 0 20 0 1 0 437364139 37519360 2991 33554432000 4194304 6211092 140721876622624 140721876619896 5743366 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 9160 2991 806 493 0 2465 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36640 KiB
Current children cumulated memory: 11964 KiB

[startup+1.50028 s]
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29919216/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=43144 memory=18176 CPUtime=1.49 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 4678 0 0 0 149 0 0 0 20 0 1 0 437364139 44179456 4544 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 10786 4544 806 493 0 4091 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 43144 KiB
Current children cumulated memory: 18176 KiB

[startup+3.10961 s]
/proc/loadavg: 7.89 7.44 7.37 2/196 22120
/proc/meminfo: memFree=29883788/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=56284 memory=30656 CPUtime=3.1 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 6814 0 0 0 309 1 0 0 20 0 1 0 437364139 57634816 7664 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 14071 7664 806 493 0 7376 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 56284 KiB
Current children cumulated memory: 30656 KiB

[startup+6.30025 s]*
/proc/loadavg: 7.50 7.37 7.35 2/196 22120
/proc/meminfo: memFree=29880076/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=82432 memory=54648 CPUtime=6.3 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 10866 0 0 0 628 2 0 0 20 0 1 0 437364139 84410368 13662 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 20608 13662 806 493 0 13913 0
Current children cumulated CPU time: 6.3 s
Current children cumulated vsize: 82432 KiB
Current children cumulated memory: 54648 KiB

[startup+12.7002 s]
/proc/loadavg: 6.98 7.26 7.32 2/196 22120
/proc/meminfo: memFree=29834424/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=134992 memory=105272 CPUtime=12.69 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 18810 0 0 0 1265 4 0 0 20 0 1 0 437364139 138231808 26318 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 33748 26318 806 493 0 27053 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 134992 KiB
Current children cumulated memory: 105272 KiB

[startup+25.5003 s]
/proc/loadavg: 5.66 6.96 7.22 2/196 22121
/proc/meminfo: memFree=29734260/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=301760 memory=263880 CPUtime=25.49 cores=0-7
/proc/22119/stat : 22119 (cosoco) R 22116 22119 22075 0 -1 4202496 35160 0 0 0 2539 10 0 0 20 0 1 0 437364139 309002240 65970 33554432000 4194304 6211092 140721876622624 140721876619896 139895155891173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 75440 65970 810 493 0 68745 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 301760 KiB
Current children cumulated memory: 263880 KiB

[startup+51.1007 s]
/proc/loadavg: 5.35 6.76 7.14 11/204 22131
/proc/meminfo: memFree=23598508/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6327888 CPUtime=151.95 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 1920581 0 0 0 14793 402 0 0 20 0 9 0 437364139 7243546624 1581972 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1581972 913 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=792 CPUtime=14.44 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 177581 0 0 0 1381 63 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895148788408 5039125 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=1640 CPUtime=14.43 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 188663 0 0 0 1433 10 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895064791736 5037821 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=4096 CPUtime=14.44 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 175093 0 0 0 1435 9 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895056399032 5038992 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=1808 CPUtime=14.21 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 323456 0 0 0 1404 17 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895048006328 5039132 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=6327888 CPUtime=14.44 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 167449 0 0 0 1388 56 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895039613624 5039022 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=288230596050944315 CPUtime=14.42 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 169718 0 0 0 1433 9 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895031220920 5039026 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=15815590841420219 CPUtime=14.44 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 159038 0 0 0 1390 54 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895022828216 5039217 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=6935054825532540783 CPUtime=14.42 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 168358 0 0 0 1380 62 0 0 20 0 9 0 437367804 7243546624 1581972 33554432000 4194304 6211092 140721876622624 139895014435512 5039125 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 151.95 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327888 KiB

[startup+102.301 s]*
/proc/loadavg: 6.85 6.95 7.18 10/204 22134
/proc/meminfo: memFree=23599180/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6327916 CPUtime=560.66 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 3400704 0 0 0 55511 555 0 0 20 0 9 0 437364139 7243546624 1581979 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1581979 913 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6935054825532540783 CPUtime=65.63 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 349990 0 0 0 6480 83 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895148788408 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=4872558044660077418 CPUtime=65.19 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 339520 0 0 0 6498 21 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895064791576 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=0 CPUtime=65.34 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 349491 0 0 0 6503 31 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895056399032 5039026 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=0 CPUtime=65.34 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 602058 0 0 0 6504 30 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895048006328 5039121 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=0 CPUtime=65.61 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 355206 0 0 0 6478 83 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895039613624 5039038 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=0 CPUtime=65.61 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 327959 0 0 0 6543 18 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895031220920 5038992 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=0 CPUtime=65.61 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 335448 0 0 0 6482 79 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895022828216 5038944 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=0 CPUtime=65.6 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 349803 0 0 0 6473 87 0 0 20 0 9 0 437367804 7243546624 1581979 33554432000 4194304 6211092 140721876622624 139895014435512 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 560.66 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6327916 KiB

[startup+162.301 s]*
/proc/loadavg: 7.75 7.20 7.26 11/204 22146
/proc/meminfo: memFree=23597292/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328080 CPUtime=1039.6 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 3963782 0 0 0 103304 656 0 0 20 0 9 0 437364139 7243546624 1582020 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582020 913 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6935054825532540783 CPUtime=125.61 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 432441 0 0 0 12473 88 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895148788504 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=4872558044660077418 CPUtime=124.31 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 416876 0 0 0 12404 27 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=2528 CPUtime=125.3 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 412543 0 0 0 12482 48 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895056398904 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=1764 CPUtime=125.32 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 662541 0 0 0 12498 34 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895048006328 5039132 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=111632 CPUtime=125.57 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 426091 0 0 0 12470 87 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895039613496 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=792 CPUtime=125.59 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 399391 0 0 0 12533 26 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895031220792 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=1640 CPUtime=125.59 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 403129 0 0 0 12476 83 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895022828312 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=4096 CPUtime=125.58 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 419577 0 0 0 12418 140 0 0 20 0 9 0 437367804 7243546624 1582020 33554432000 4194304 6211092 140721876622624 139895014435512 5037821 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 1039.6 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328080 KiB

[startup+222.301 s]*
/proc/loadavg: 7.99 7.36 7.31 10/204 22151

################
# More data... #
################

/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1415331 0 0 0 227135 149 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=14012 CPUtime=2284.85 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1212488 0 0 0 228408 77 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=1156 CPUtime=2284.92 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1462488 0 0 0 228330 162 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=944 CPUtime=2284.15 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1011555 0 0 0 228297 118 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5038999 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=1552 CPUtime=2284.89 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1287877 0 0 0 228345 144 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=1052 CPUtime=2280.66 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1246891 0 0 0 227859 207 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 18283.6 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB

[startup+2382.3 s]*
/proc/loadavg: 8.55 8.43 8.33 9/204 22340
/proc/meminfo: memFree=23597980/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328276 CPUtime=18762.7 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 10943081 0 0 0 1875014 1251 0 0 20 0 9 0 437364139 7243546624 1582069 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582069 914 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=1552 CPUtime=2344.97 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 1391480 0 0 0 234340 157 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895148788280 5039026 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=1052 CPUtime=2328.78 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 1433323 0 0 0 232769 109 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=4872558044660077418 CPUtime=2332.82 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1430827 0 0 0 233132 150 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=1052 CPUtime=2344.84 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1225376 0 0 0 234406 78 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5038947 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=6044 CPUtime=2344.89 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1489253 0 0 0 234325 164 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=3628 CPUtime=2344.13 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1021180 0 0 0 234294 119 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2344.88 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1300765 0 0 0 234343 145 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=14012 CPUtime=2340.65 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1259648 0 0 0 233856 209 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 18762.7 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB

[startup+2442.3 s]*
/proc/loadavg: 8.33 8.38 8.32 9/204 22345
/proc/meminfo: memFree=23597772/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328276 CPUtime=19241.7 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 11082472 0 0 0 1922907 1260 0 0 20 0 9 0 437364139 7243546624 1582069 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582069 914 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6935054825532540783 CPUtime=2404.96 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 1405193 0 0 0 240338 158 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895148788280 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=4872558044660077418 CPUtime=2387.87 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 1457832 0 0 0 238677 110 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=4096 CPUtime=2392.82 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1460352 0 0 0 239131 151 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=1808 CPUtime=2404.83 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1238244 0 0 0 240405 78 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=920 CPUtime=2404.87 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1512730 0 0 0 240321 166 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5039029 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=3908 CPUtime=2404.13 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1030784 0 0 0 240293 120 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5037825 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=1408 CPUtime=2404.87 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1313639 0 0 0 240341 146 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5037823 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=2936 CPUtime=2400.63 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1272469 0 0 0 239854 209 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 19241.7 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB

[startup+2502.3 s]*
/proc/loadavg: 8.12 8.31 8.30 9/203 22348
/proc/meminfo: memFree=23598200/32770624 swapFree=66917044/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328276 CPUtime=19720.7 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 11206646 0 0 0 1970800 1270 0 0 20 0 9 0 437364139 7243546624 1582069 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582069 914 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6935054825532540783 CPUtime=2464.93 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 1417638 0 0 0 246334 159 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895148788280 5250272 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=4872558044660077418 CPUtime=2446.99 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 1478360 0 0 0 244587 112 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=1052 CPUtime=2452.8 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1485682 0 0 0 245128 152 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5037801 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=6044 CPUtime=2464.82 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1251117 0 0 0 246403 79 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5039029 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=288230591722422566 CPUtime=2464.85 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1530455 0 0 0 246317 168 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5250272 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=15540708622730665 CPUtime=2464.12 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1040330 0 0 0 246291 121 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5039132 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=14012 CPUtime=2464.85 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1326489 0 0 0 246339 146 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=23368 CPUtime=2460.61 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1285346 0 0 0 245851 210 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5038947 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 19720.7 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 8.09 8.29 8.29 11/203 22356
/proc/meminfo: memFree=23597220/32770624 swapFree=66917048/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328276 CPUtime=19861.9 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 11215604 0 0 0 1984918 1271 0 0 20 0 9 0 437364139 7243546624 1582069 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582069 914 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.61 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 1419967 0 0 0 248102 159 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895148788280 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2464.43 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 1480451 0 0 0 246330 113 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2470.49 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1489917 0 0 0 246896 153 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.51 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1251125 0 0 0 248172 79 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=8564 CPUtime=2482.53 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1530455 0 0 0 248085 168 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2481.8 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1040355 0 0 0 248059 121 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.54 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1326691 0 0 0 248107 147 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2478.28 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1285414 0 0 0 247618 210 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5037825 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 19861.9 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.08 s]
# the end of solver process 22119 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=19849.3 s, system=12.776 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 8.09 8.29 8.29 11/203 22356
/proc/meminfo: memFree=23597220/32770624 swapFree=66917048/67108860
[pid=22119] ppid=22116 vsize=7073776 memory=6328276 CPUtime=19861.9 cores=0-7
/proc/22119/stat : 22119 (cosoco) S 22116 22119 22075 0 -1 1077944320 11215604 0 0 0 1984918 1271 0 0 20 0 9 0 437364139 7243546624 1582069 33554432000 4194304 6211092 140721876622624 140721876620880 139895171931895 0 0 4096 8405026 18446744073709551615 0 0 17 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
/proc/22119/statm: 1768444 1582069 914 493 0 1761749 0
[pid=22119/tid=22124] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.61 cores=0-7
/proc/22119/task/22124/stat : 22124 (cosoco) R 22116 22119 22075 0 -1 4202560 1419967 0 0 0 248102 159 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895148788280 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22125] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2464.43 cores=0-7
/proc/22119/task/22125/stat : 22125 (cosoco) R 22116 22119 22075 0 -1 4202560 1480451 0 0 0 246330 113 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895064791608 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22126] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2470.49 cores=0-7
/proc/22119/task/22126/stat : 22126 (cosoco) R 22116 22119 22075 0 -1 4202560 1489917 0 0 0 246896 153 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895056399632 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22127] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.51 cores=0-7
/proc/22119/task/22127/stat : 22127 (cosoco) R 22116 22119 22075 0 -1 4202560 1251125 0 0 0 248172 79 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895048006200 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22128] ppid=22116 vsize=7073776 memory=8564 CPUtime=2482.53 cores=0-7
/proc/22119/task/22128/stat : 22128 (cosoco) R 22116 22119 22075 0 -1 4202560 1530455 0 0 0 248085 168 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895039613464 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22129] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2481.8 cores=0-7
/proc/22119/task/22129/stat : 22129 (cosoco) R 22116 22119 22075 0 -1 4202560 1040355 0 0 0 248059 121 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895031220936 5038990 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22130] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2482.54 cores=0-7
/proc/22119/task/22130/stat : 22130 (cosoco) R 22116 22119 22075 0 -1 4202560 1326691 0 0 0 248107 147 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895022828088 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
[pid=22119/tid=22131] ppid=22116 vsize=7073776 memory=6328276 CPUtime=2478.28 cores=0-7
/proc/22119/task/22131/stat : 22131 (cosoco) R 22116 22119 22075 0 -1 4202560 1285414 0 0 0 247618 210 0 0 20 0 9 0 437367804 7243546624 1582069 33554432000 4194304 6211092 140721876622624 139895014435528 5037825 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 15736832 140721876628497 140721876628589 140721876628589 140721876631502 0
Current children cumulated CPU time: 19861.9 s
Current children cumulated vsize: 7073776 KiB
Current children cumulated memory: 6328276 KiB

Child status: 1
Real time (s): 2520.08
CPU time (s): 19862.1
CPU user time (s): 19849.3
CPU system time (s): 12.776
CPU usage (%): 788.153
Max. virtual memory (cumulated for all children) (KiB): 7073776
Max. memory (cumulated for all children) (KiB): 6328276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 19849.3
system time used= 12.776
maximum resident set size= 6328356
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11215653
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 419
involuntary context switches= 180961


# summary of solver processes directly reported to runsolver:
#   pid: 22119
#   total CPU time (s): 19862.1
#   total CPU user time (s): 19849.3
#   total CPU system time (s): 12.776

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.5412 second user time and 23.3985 second system time

The end

Launcher Data 

Begin job on node134 at 2019-09-16 07:18:15
IDJOB=4398455
IDBENCH=138083
IDSOLVER=2851
FILE ID=node134/4398455-1568611136
RUNJOBID= node134-1568611094-22102
PBS_JOBID= 21703452
Free space on /tmp= 59520 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/BinPacking/BinPacking-tab-sw120/BinPacking-tab-sw120-75.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398455-1568611136/watcher-4398455-1568611136 -o /tmp/evaluation-result-4398455-1568611136/solver-4398455-1568611136 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node134-1568611094-22102 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398455-1568611136.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9cdf82428becd6b5ad716031980a59d2
RANDOM SEED=2044269343

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29931240 kB
MemAvailable:   31782844 kB
Buffers:          209560 kB
Cached:          1916268 kB
SwapCached:        90384 kB
Active:           688136 kB
Inactive:        1530532 kB
Active(anon):       3268 kB
Inactive(anon):   138052 kB
Active(file):     684868 kB
Inactive(file):  1392480 kB
Unevictable:      108520 kB
Mlocked:          108520 kB
SwapTotal:      67108860 kB
SwapFree:       66917044 kB
Dirty:             85396 kB
Writeback:             4 kB
AnonPages:        112868 kB
Mapped:            46752 kB
Shmem:             39652 kB
Slab:             210812 kB
SReclaimable:     180180 kB
SUnreclaim:        30632 kB
KernelStack:        3424 kB
PageTables:         5184 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505744 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 59516 MiB
End job on node134 at 2019-09-16 08:00:15