Trace number 4398745

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 1943.98 253.182

General information on the benchmark

NameScheduling/Scheduling-fs-taillard/
Taillard-fs-200-10-1.xml
MD5SUM4dc4d699091ca89690279c2093d69f52
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2200
Number of constraints2210
Number of domains1
Minimum domain size10594
Maximum domain size10594
Distribution of domain sizes[{"size":10594,"count":2200}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":200},{"degree":3,"count":2000}]
Minimum constraint arity1
Maximum constraint arity200
Distribution of constraint arities[{"arity":1,"count":200},{"arity":2,"count":2000},{"arity":200,"count":10}]
Number of extensional constraints0
Number of intensional constraints2200
Distribution of constraint types[{"type":"intension","count":2200},{"type":"noOverlap","count":10}]
Optimization problemYES
Type of objectivemin MAXIMUM

Solver Data 

1942.71/252.02	c
1942.71/252.02	c This is cosoco 2.00 --  
1942.71/252.02	c
1942.71/252.02	c command line: cosoco -model -nbcores=8 HOME/instance-4398745-1568604052.xml 
1942.71/252.02	c enable optimization
1942.71/252.02	c ========================================[ Problem Statistics ]===========================================
1942.71/252.02	c |                                                                                                       
1942.71/252.02	c |  Parse time        :         3.68 s 
1942.71/252.02	c |
1942.71/252.02	c |               Variables: 2200
1942.71/252.02	c |            Domain Sizes: 10594..10594
1942.71/252.02	c |
1942.71/252.02	c |             Constraints: 201201
1942.71/252.02	c |                   Arity: 1..200  -- Unary: 200  -- Binary: 201000
1942.71/252.02	c | 
1942.71/252.02	c |                   Types: 
1942.71/252.02	c |                          (X -Y <= k): 1800
1942.71/252.02	c |                          Disjunctive: 199000
1942.71/252.02	c |                          Intension: 200
1942.71/252.02	c |                          Max constant: 1
1942.71/252.02	c |                          Unary: 200
1942.71/252.02	c |                          
1942.71/252.02	c |               Objective: Minimize Max constant
1942.71/252.02	
1942.71/252.02	c =========================================================================================================
1942.71/252.02	c Parallel mode: Portfolio
1942.71/252.02	c [pFactory][Group N°0] created (threads:8).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
1942.71/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
1942.71/252.02	c [pFactory][Group N°0] concurrent mode: enabled.
1942.71/252.02	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
1942.71/252.02	c [pFactory][Group N°0] task 7 launched on thread 0.
1942.71/252.02	c [pFactory][Group N°0] task 6 launched on thread 1.
1942.71/252.02	c [pFactory][Group N°0] task 5 launched on thread 5.
1942.71/252.02	c [pFactory][Group N°0] task 4 launched on thread 2.
1942.71/252.02	c [pFactory][Group N°0] task 3 launched on thread 6.
1942.71/252.02	c [pFactory][Group N°0] task 2 launched on thread 7.
1942.71/252.02	c [pFactory][Group N°0] task 1 launched on thread 3.
1942.71/252.02	c [pFactory][Group N°0] task 0 launched on thread 4.
1942.71/252.02	
1942.71/252.02	c *** INTERRUPTED ***
1942.71/252.02	c call to solver        : 0
1942.71/252.02	c
1942.71/252.02	c restarts              : 553         
1942.71/252.02	c conflicts             : 6526         (3 /sec)
1942.71/252.02	c decisions             : 7596         (4 /sec)
1942.71/252.02	c propagations          : 66362609    (34653 /sec)
1942.71/252.02	c root propagations     : 991220      
1942.71/252.02	c filter calls          : 56345919       (29423 /sec)
1942.71/252.02	c useless filter calls  : 55231795       (98 %)
1942.71/252.02	c Memory used           : 17335.85 MB
1942.71/252.02	c Best bound time (wc)  : -1.5686e+09 s
1942.71/252.02	c CPU time              : 1915.05 s
1942.71/252.02	c real time             : 252.018 s
1942.71/252.02	
1942.71/252.02	c No Bound found!
1942.71/252.02	
1942.71/252.02	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15477 MiB free)
  memory of node 1: 16384 MiB (15597 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398745-1568604052/watcher-4398745-1568604052 -o /tmp/evaluation-result-4398745-1568604052/solver-4398745-1568604052 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node135-1568595834-11491 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4398745-1568604052.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=13213, runsolver pid=13210
Current StackSize limit: 8192 KiB


[startup+0.100164 s]*
/proc/loadavg: 8.20 8.39 8.41 2/197 13214
/proc/meminfo: memFree=31678972/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=182140 memory=158100 CPUtime=0.1 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 39722 0 0 0 4 6 0 0 20 0 1 0 436654695 186511360 39525 33554432000 4194304 6211092 140723898330480 140723898327016 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 45535 39525 752 493 0 38840 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 182140 KiB
Current children cumulated memory: 158100 KiB

[startup+0.209788 s]*
/proc/loadavg: 8.20 8.39 8.41 2/197 13214
/proc/meminfo: memFree=31501528/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=359492 memory=335508 CPUtime=0.21 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 84072 0 0 0 10 11 0 0 20 0 1 0 436654695 368119808 83877 33554432000 4194304 6211092 140723898330480 140723898327016 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 89873 83877 752 493 0 83178 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 359492 KiB
Current children cumulated memory: 335508 KiB

[startup+0.309739 s]*
/proc/loadavg: 8.20 8.39 8.41 2/197 13214
/proc/meminfo: memFree=31338592/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=522260 memory=498396 CPUtime=0.31 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 124745 0 0 0 15 16 0 0 20 0 1 0 436654695 534794240 124533 33554432000 4194304 6211092 140723898330480 140723898327016 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 130565 124533 752 493 0 123870 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 522260 KiB
Current children cumulated memory: 498396 KiB

[startup+0.700383 s]
/proc/loadavg: 8.20 8.39 8.41 2/197 13214
/proc/meminfo: memFree=31010860/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=1149120 memory=1125132 CPUtime=0.69 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 281472 0 0 0 36 33 0 0 20 0 1 0 436654695 1176698880 281283 33554432000 4194304 6211092 140723898330480 140723898327016 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 287321 281283 752 493 0 280626 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 1149120 KiB
Current children cumulated memory: 1125132 KiB

[startup+1.50036 s]
/proc/loadavg: 8.20 8.39 8.41 2/197 13214
/proc/meminfo: memFree=30198492/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=2122120 memory=2098436 CPUtime=1.48 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 524790 0 0 0 86 62 0 0 20 0 1 0 436654695 2173050880 524609 33554432000 4194304 6211092 140723898330480 140723898324984 140052043025381 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 530530 524609 827 493 0 523835 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 2122120 KiB
Current children cumulated memory: 2098436 KiB

[startup+3.10979 s]
/proc/loadavg: 7.62 8.26 8.37 2/197 13214
/proc/meminfo: memFree=26666744/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=5441204 memory=5416696 CPUtime=3.1 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 1360533 0 0 0 147 163 0 0 20 0 1 0 436654695 5571792896 1354174 33554432000 4194304 6211092 140723898330480 140723898326072 140052043025381 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 1360335 1354174 838 493 0 1353640 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 5441204 KiB
Current children cumulated memory: 5416696 KiB

[startup+6.30038 s]
/proc/loadavg: 7.62 8.26 8.37 2/197 13214
/proc/meminfo: memFree=19178844/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=13395224 memory=13369944 CPUtime=6.28 cores=0-7
/proc/13213/stat : 13213 (cosoco) R 13210 13213 11464 0 -1 4202496 3356002 0 0 0 229 399 0 0 20 0 1 0 436654695 13716709376 3342486 33554432000 4194304 6211092 140723898330480 140723898326072 140052043073440 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 3348840 3342486 838 493 0 3342145 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 13395224 KiB
Current children cumulated memory: 13369944 KiB

[startup+12.7012 s]
/proc/loadavg: 7.16 8.14 8.33 9/205 13222
/proc/meminfo: memFree=15175648/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17225964 memory=16620968 CPUtime=36.33 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 5586973 0 0 0 3061 572 0 0 20 0 9 0 436654695 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4306491 4155242 882 493 0 4299796 0
[pid=13213/tid=13215] ppid=13210 vsize=17225964 memory=3624 CPUtime=3.37 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 6743 0 0 0 335 2 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051463097112 5046864 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17225964 memory=5641804 CPUtime=3.38 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 3227 0 0 0 337 1 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051454704408 5046873 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17225964 memory=0 CPUtime=3.36 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 7119 0 0 0 336 0 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051446311704 5046873 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17225964 memory=16613384 CPUtime=3.33 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 5742 0 0 0 333 0 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051437918904 5046873 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17225964 memory=2372 CPUtime=3.37 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 3220 0 0 0 336 1 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051429526200 5046864 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17225964 memory=0 CPUtime=3.38 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 6074 0 0 0 336 2 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051421133496 5046873 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17225964 memory=0 CPUtime=3.37 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 5794 0 0 0 335 2 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051412740792 5046873 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17225964 memory=16619528 CPUtime=3.37 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 4978 0 0 0 335 2 0 0 20 0 9 0 436655626 17639387136 4155242 33554432000 4194304 6211092 140723898330480 140051404348184 5046873 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 36.33 s
Current children cumulated vsize: 17225964 KiB
Current children cumulated memory: 16620968 KiB

[startup+25.5012 s]
/proc/loadavg: 7.29 8.14 8.32 9/205 13223
/proc/meminfo: memFree=14320800/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470760 CPUtime=134.71 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 8583664 0 0 0 12234 1237 0 0 20 0 9 0 436654695 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367690 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=13619924 CPUtime=15.66 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 371083 0 0 0 1439 127 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051463097360 5167529 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=16959840 CPUtime=15.75 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 405911 0 0 0 1517 58 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051454704656 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=17470760 CPUtime=15.64 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 333682 0 0 0 1517 47 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051446311952 5046864 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=0 CPUtime=15.5 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 413940 0 0 0 1506 44 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051437919152 5046864 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=13311 CPUtime=15.79 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 443092 0 0 0 1515 64 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051429526544 5451532 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=56 CPUtime=15.68 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 341847 0 0 0 1478 90 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051421133840 5168219 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=17470760 CPUtime=15.66 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 331153 0 0 0 1458 108 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051412741208 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=280827913804160 CPUtime=15.66 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 398880 0 0 0 1428 138 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051404348432 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 134.71 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470760 KiB

[startup+51.1112 s]
/proc/loadavg: 7.53 8.13 8.31 9/205 13225
/proc/meminfo: memFree=14320992/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470760 CPUtime=339.17 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 11976103 0 0 0 32166 1751 0 0 20 0 9 0 436654695 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367690 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=56 CPUtime=41.26 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 813395 0 0 0 3910 216 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051463097360 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=17470760 CPUtime=41.35 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 832530 0 0 0 4053 82 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051454704536 5167504 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=17470760 CPUtime=41.24 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 876407 0 0 0 4045 79 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051446311816 5397368 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=0 CPUtime=40.73 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 766295 0 0 0 4009 64 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051437919152 5446230 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=0 CPUtime=41.4 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 747388 0 0 0 4057 83 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051429526544 5046873 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=3624 CPUtime=41.28 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 725368 0 0 0 3922 206 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051421133840 5046873 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=30532 CPUtime=41.27 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 842218 0 0 0 3894 233 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051412741208 5397368 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=0 CPUtime=41.26 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 828749 0 0 0 3900 226 0 0 20 0 9 0 436655626 18177949696 4367690 33554432000 4194304 6211092 140723898330480 140051404348432 5167504 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 339.17 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470760 KiB

[startup+102.301 s]
/proc/loadavg: 7.95 8.15 8.31 9/205 13228
/proc/meminfo: memFree=14318880/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470780 CPUtime=747.76 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 16144836 0 0 0 72646 2130 0 0 20 0 9 0 436654695 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367695 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=17470780 CPUtime=92.44 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 1361180 0 0 0 8994 250 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051463097360 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=17470780 CPUtime=92.52 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 1374594 0 0 0 9141 111 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051454704536 5167507 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=17470780 CPUtime=92.41 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 1427823 0 0 0 9131 110 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051446311816 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=280827913159264 CPUtime=91.69 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 1320088 0 0 0 9013 156 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051437919152 5397368 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=17470780 CPUtime=92.44 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 1359933 0 0 0 9130 114 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051429526544 5168192 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=17470780 CPUtime=92.46 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 1068050 0 0 0 9018 228 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051421133840 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=140418356541055 CPUtime=92 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 1343988 0 0 0 8858 342 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051412741208 5167888 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=17470760 CPUtime=92.42 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 1345112 0 0 0 8984 258 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051404348432 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 747.76 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470780 KiB

[startup+162.301 s]
/proc/loadavg: 8.44 8.23 8.33 9/204 13231
/proc/meminfo: memFree=14316228/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470780 CPUtime=1226.58 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 19629139 0 0 0 120143 2515 0 0 20 0 9 0 436654695 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367695 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=17470780 CPUtime=152.37 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 1815814 0 0 0 14962 275 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051463097360 5167904 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=17470780 CPUtime=152.31 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 1845594 0 0 0 15092 139 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051454704536 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=0 CPUtime=152.39 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 1837633 0 0 0 15108 131 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051446311816 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=17470780 CPUtime=151.66 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 1808501 0 0 0 14869 297 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051437919152 5168360 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=17470780 CPUtime=152.15 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 1795649 0 0 0 15076 139 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051429526544 5393040 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=3624 CPUtime=152.44 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 1326721 0 0 0 15004 240 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051421133840 5046864 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=17470780 CPUtime=151.51 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 1816567 0 0 0 14704 447 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051412741208 5168363 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=17470780 CPUtime=152.39 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 1838584 0 0 0 14953 286 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051404348432 5168219 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 1226.58 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470780 KiB

[startup+222.301 s]
/proc/loadavg: 8.79 8.37 8.37 9/205 13237
/proc/meminfo: memFree=14317308/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470780 CPUtime=1705.56 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 22327479 0 0 0 167864 2692 0 0 20 0 9 0 436654695 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367695 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=17470780 CPUtime=212.35 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 2206619 0 0 0 20939 296 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051463097360 5167904 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=17470780 CPUtime=212.28 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 2217536 0 0 0 21067 161 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051454704536 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=17470780 CPUtime=212.06 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 2200199 0 0 0 21057 149 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051446311816 5167888 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=17470780 CPUtime=211.63 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 2154476 0 0 0 20832 331 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051437919152 140052052970365 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=17470780 CPUtime=211.65 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 2170687 0 0 0 21006 159 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051429526544 5455642 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=17470780 CPUtime=212.43 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 1508415 0 0 0 20993 250 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051421133840 5168216 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=17470780 CPUtime=211.4 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 2138115 0 0 0 20664 476 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051412741208 5167547 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=0 CPUtime=212.38 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 2187356 0 0 0 20931 307 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051404348432 5167504 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 1705.56 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470780 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]*
/proc/loadavg: 8.73 8.40 8.38 9/205 13238
/proc/meminfo: memFree=14317892/32770624 swapFree=66970412/67108860
[pid=13213] ppid=13210 vsize=17751904 memory=17470780 CPUtime=1942.71 cores=0-7
/proc/13213/stat : 13213 (cosoco) S 13210 13213 11464 0 -1 1077944320 23515043 0 0 0 191494 2777 0 0 20 0 9 0 436654695 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140723898328736 140052059066103 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
/proc/13213/statm: 4437976 4367695 886 493 0 4431281 0
[pid=13213/tid=13215] ppid=13210 vsize=17751904 memory=3996 CPUtime=242.04 cores=0-7
/proc/13213/task/13215/stat : 13215 (cosoco) R 13210 13213 11464 0 -1 4202560 2341306 0 0 0 23898 306 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051463097360 5397368 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13216] ppid=13210 vsize=17751904 memory=716 CPUtime=241.94 cores=0-7
/proc/13213/task/13216/stat : 13216 (cosoco) R 13210 13213 11464 0 -1 4202560 2369426 0 0 0 24023 171 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051454704536 5167538 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13217] ppid=13210 vsize=17751904 memory=-7003737579269690708 CPUtime=241.76 cores=0-7
/proc/13213/task/13217/stat : 13217 (cosoco) R 13210 13213 11464 0 -1 4202560 2382374 0 0 0 24018 158 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051446311816 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13218] ppid=13210 vsize=17751904 memory=3624 CPUtime=241.33 cores=0-7
/proc/13213/task/13218/stat : 13218 (cosoco) R 13210 13213 11464 0 -1 4202560 2195785 0 0 0 23790 343 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051437919152 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13219] ppid=13210 vsize=17751904 memory=30532 CPUtime=241.12 cores=0-7
/proc/13213/task/13219/stat : 13219 (cosoco) R 13210 13213 11464 0 -1 4202560 2279035 0 0 0 23947 165 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051429526544 5168192 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13220] ppid=13210 vsize=17751904 memory=6935054825532540783 CPUtime=242.13 cores=0-7
/proc/13213/task/13220/stat : 13220 (cosoco) R 13210 13213 11464 0 -1 4202560 1729576 0 0 0 23951 262 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051421133840 5397375 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13221] ppid=13210 vsize=17751904 memory=3996 CPUtime=240.95 cores=0-7
/proc/13213/task/13221/stat : 13221 (cosoco) R 13210 13213 11464 0 -1 4202560 2334860 0 0 0 23603 492 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051412741208 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
[pid=13213/tid=13222] ppid=13210 vsize=17751904 memory=17470780 CPUtime=242.07 cores=0-7
/proc/13213/task/13222/stat : 13222 (cosoco) R 13210 13213 11464 0 -1 4202560 2339045 0 0 0 23889 318 0 0 20 0 9 0 436655626 18177949696 4367695 33554432000 4194304 6211092 140723898330480 140051404348432 5167538 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13783040 140723898336278 140723898336370 140723898336370 140723898339278 0
Current children cumulated CPU time: 1942.71 s
Current children cumulated vsize: 17751904 KiB
Current children cumulated memory: 17470780 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+253.182 s]
# the end of solver process 13213 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1915.05 s, system=28.9318 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+252.8 s]
/proc/loadavg: 8.73 8.40 8.38 3/198 13238
/proc/meminfo: memFree=15903940/32770624 swapFree=66970412/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+253 s]*
/proc/loadavg: 8.73 8.40 8.38 2/198 13238
/proc/meminfo: memFree=29187524/32770624 swapFree=66970412/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+253.11 s]
/proc/loadavg: 8.73 8.40 8.38 2/198 13238
/proc/meminfo: memFree=29187524/32770624 swapFree=66970412/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 253.182
CPU time (s): 1943.98
CPU user time (s): 1915.05
CPU system time (s): 28.9318
CPU usage (%): 767.821
Max. virtual memory (cumulated for all children) (KiB): 17784676
Max. memory (cumulated for all children) (KiB): 17470780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1915.05
system time used= 28.9318
maximum resident set size= 17470888
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23517754
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 222634
involuntary context switches= 17922


# summary of solver processes directly reported to runsolver:
#   pid: 13213
#   total CPU time (s): 1943.98
#   total CPU user time (s): 1915.05
#   total CPU system time (s): 28.9318

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.27294 second user time and 2.32632 second system time

The end

Launcher Data 

Begin job on node135 at 2019-09-16 05:20:11
IDJOB=4398745
IDBENCH=115615
IDSOLVER=2852
FILE ID=node135/4398745-1568604052
RUNJOBID= node135-1568595834-11491
PBS_JOBID= 21703393
Free space on /tmp= 61372 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-fs-taillard/Taillard-fs-200-10-1.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398745-1568604052/watcher-4398745-1568604052 -o /tmp/evaluation-result-4398745-1568604052/solver-4398745-1568604052 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node135-1568595834-11491 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4398745-1568604052.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4dc4d699091ca89690279c2093d69f52
RANDOM SEED=1993039015

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31821328 kB
MemAvailable:   31864204 kB
Buffers:           26500 kB
Cached:           303768 kB
SwapCached:        32728 kB
Active:           169808 kB
Inactive:         198004 kB
Active(anon):       4000 kB
Inactive(anon):    76500 kB
Active(file):     165808 kB
Inactive(file):   121504 kB
Unevictable:      109492 kB
Mlocked:          109492 kB
SwapTotal:      67108860 kB
SwapFree:       66970412 kB
Dirty:              2832 kB
Writeback:            12 kB
AnonPages:        115040 kB
Mapped:            41432 kB
Shmem:             34468 kB
Slab:             173440 kB
SReclaimable:     142800 kB
SUnreclaim:        30640 kB
KernelStack:        3472 kB
PageTables:         5172 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506368 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61368 MiB
End job on node135 at 2019-09-16 05:24:25