Trace number 4410005

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallel? (TO) 1945.34 253.179

General information on the benchmark

NameScheduling/Scheduling-fs-taillard/
Taillard-fs-200-10-1.xml
MD5SUM4dc4d699091ca89690279c2093d69f52
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2200
Number of constraints2210
Number of domains1
Minimum domain size10594
Maximum domain size10594
Distribution of domain sizes[{"size":10594,"count":2200}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":200},{"degree":3,"count":2000}]
Minimum constraint arity1
Maximum constraint arity200
Distribution of constraint arities[{"arity":1,"count":200},{"arity":2,"count":2000},{"arity":200,"count":10}]
Number of extensional constraints0
Number of intensional constraints2200
Distribution of constraint types[{"type":"intension","count":2200},{"type":"noOverlap","count":10}]
Optimization problemYES
Type of objectivemin MAXIMUM

Solver Data 

1944.07/252.02	c
1944.07/252.02	c This is cosoco 2.00 --  
1944.07/252.02	c
1944.07/252.02	c command line: cosoco -model -nbcores=8 HOME/instance-4410005-1569826817.xml 
1944.07/252.02	c enable optimization
1944.07/252.02	c ========================================[ Problem Statistics ]===========================================
1944.07/252.02	c |                                                                                                       
1944.07/252.02	c |  Parse time        :         3.71 s 
1944.07/252.02	c |
1944.07/252.02	c |               Variables: 2200
1944.07/252.02	c |            Domain Sizes: 10594..10594
1944.07/252.02	c |
1944.07/252.02	c |             Constraints: 201201
1944.07/252.02	c |                   Arity: 1..200  -- Unary: 200  -- Binary: 201000
1944.07/252.02	c | 
1944.07/252.02	c |                   Types: 
1944.07/252.02	c |                          (X -Y <= k): 1800
1944.07/252.02	c |                          Disjunctive: 199000
1944.07/252.02	c |                          Intension: 200
1944.07/252.02	c |                          Max constant: 1
1944.07/252.02	c |                          Unary: 200
1944.07/252.02	c |                          
1944.07/252.02	c |               Objective: Minimize Max constant
1944.07/252.02	
1944.07/252.02	c =========================================================================================================
1944.07/252.02	c Parallel mode: Portfolio
1944.07/252.02	c [pFactory][Group N°0] created (threads:8).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
1944.07/252.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
1944.07/252.02	c [pFactory][Group N°0] concurrent mode: enabled.
1944.07/252.02	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
1944.07/252.02	c [pFactory][Group N°0] task 7 launched on thread 0.
1944.07/252.02	c [pFactory][Group N°0] task 6 launched on thread 1.
1944.07/252.02	c [pFactory][Group N°0] task 5 launched on thread 2.
1944.07/252.02	c [pFactory][Group N°0] task 4 launched on thread 3.
1944.07/252.02	c [pFactory][Group N°0] task 3 launched on thread 6.
1944.07/252.02	c [pFactory][Group N°0] task 2 launched on thread 5.
1944.07/252.02	c [pFactory][Group N°0] task 1 launched on thread 4.
1944.07/252.02	c [pFactory][Group N°0] task 0 launched on thread 7.
1944.07/252.02	
1944.07/252.02	c *** INTERRUPTED ***
1944.07/252.02	c call to solver        : 0
1944.07/252.02	c
1944.07/252.02	c restarts              : 558         
1944.07/252.02	c conflicts             : 5771         (3 /sec)
1944.07/252.02	c decisions             : 6726         (4 /sec)
1944.07/252.02	c propagations          : 58585892    (30591 /sec)
1944.07/252.02	c root propagations     : 991220      
1944.07/252.02	c filter calls          : 59889365       (31272 /sec)
1944.07/252.02	c useless filter calls  : 58819074       (98 %)
1944.07/252.02	c Memory used           : 17336.80 MB
1944.07/252.02	c Best bound time (wc)  : -1.56983e+09 s
1944.07/252.02	c CPU time              : 1915.14 s
1944.07/252.02	c real time             : 252.018 s
1944.07/252.02	
1944.07/252.02	c No Bound found!
1944.07/252.02	
1944.07/252.02	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15289 MiB free)
  memory of node 1: 16384 MiB (15597 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4410005-1569826817/watcher-4410005-1569826817 -o /tmp/evaluation-result-4410005-1569826817/solver-4410005-1569826817 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569816665-22934 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4410005-1569826817.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=24059, runsolver pid=24056

[startup+0.100168 s]*
/proc/loadavg: 8.01 8.15 8.22 2/191 24060
/proc/meminfo: memFree=31483004/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=186292 memory=162320 CPUtime=0.1 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 40771 0 0 0 5 5 0 0 20 0 1 0 558934715 190763008 40580 33554432000 4194304 6211132 140729895328752 140729895325288 140512274525157 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 46573 40580 752 493 0 39878 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 186292 KiB
Current children cumulated memory: 162320 KiB

[startup+0.209318 s]*
/proc/loadavg: 8.01 8.15 8.22 2/191 24060
/proc/meminfo: memFree=31305188/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=363976 memory=339992 CPUtime=0.2 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 85169 0 0 0 10 10 0 0 20 0 1 0 558934715 372711424 84998 33554432000 4194304 6211132 140729895328752 140729895325288 5231349 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 90994 84998 752 493 0 84299 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 363976 KiB
Current children cumulated memory: 339992 KiB

[startup+0.309422 s]*
/proc/loadavg: 8.01 8.15 8.22 2/191 24060
/proc/meminfo: memFree=31141880/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=526580 memory=502616 CPUtime=0.3 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 125849 0 0 0 15 15 0 0 20 0 1 0 558934715 539217920 125654 33554432000 4194304 6211132 140729895328752 140729895325288 5231269 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 131687 125654 752 493 0 124992 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 526580 KiB
Current children cumulated memory: 502616 KiB

[startup+0.700394 s]
/proc/loadavg: 7.45 8.03 8.19 2/191 24060
/proc/meminfo: memFree=30815264/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=1151944 memory=1128032 CPUtime=0.69 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 282186 0 0 0 35 34 0 0 20 0 1 0 558934715 1179590656 282008 33554432000 4194304 6211132 140729895328752 140729895325288 5231349 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 288028 282008 752 493 0 281333 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 1151944 KiB
Current children cumulated memory: 1128032 KiB

[startup+1.50037 s]
/proc/loadavg: 7.45 8.03 8.19 2/191 24060
/proc/meminfo: memFree=30000956/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=2125464 memory=2101748 CPUtime=1.49 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 525615 0 0 0 86 63 0 0 20 0 1 0 558934715 2176475136 525437 33554432000 4194304 6211132 140729895328752 140729895323256 140512274525157 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 531366 525437 827 493 0 524671 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2125464 KiB
Current children cumulated memory: 2101748 KiB

[startup+3.10945 s]
/proc/loadavg: 7.45 8.03 8.19 2/191 24060
/proc/meminfo: memFree=26429192/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=5486080 memory=5461780 CPUtime=3.1 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 1371408 0 0 0 149 161 0 0 20 0 1 0 558934715 5617745920 1365379 33554432000 4194304 6211132 140729895328752 140729895324344 140512274573216 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 1371554 1365445 838 493 0 1364859 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 5486080 KiB
Current children cumulated memory: 5461780 KiB

[startup+6.30038 s]
/proc/loadavg: 6.93 7.92 8.15 2/191 24060
/proc/meminfo: memFree=18941448/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=13440236 memory=13415084 CPUtime=6.28 cores=0-7
/proc/24059/stat : 24059 (cosoco) R 24056 24059 22907 0 -1 4202496 3367042 0 0 0 231 397 0 0 20 0 1 0 558934715 13762801664 3353705 33554432000 4194304 6211132 140729895328752 140729895324344 140512274573216 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 3360093 3353771 838 493 0 3353398 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 13440236 KiB
Current children cumulated memory: 13415084 KiB

[startup+12.7007 s]
/proc/loadavg: 7.02 7.92 8.15 9/199 24068
/proc/meminfo: memFree=14983188/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17225964 memory=16620768 CPUtime=36.54 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 5601187 0 0 0 3075 579 0 0 20 0 9 0 558934715 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4306491 4155192 879 493 0 4299796 0
[pid=24059/tid=24061] ppid=24056 vsize=17225964 memory=3504 CPUtime=3.4 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 7919 0 0 0 338 2 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511694596888 5046864 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17225964 memory=139753819022975 CPUtime=3.41 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 21421 0 0 0 339 2 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511686204184 5046873 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17225964 memory=0 CPUtime=3.4 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 21899 0 0 0 327 13 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511677811480 5392352 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17225964 memory=0 CPUtime=3.36 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 8543 0 0 0 336 0 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511669418776 5046873 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17225964 memory=6944656425123422848 CPUtime=3.41 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 8857 0 0 0 338 3 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511661026072 5046864 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17225964 memory=0 CPUtime=3.4 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 8658 0 0 0 338 2 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511652633368 5046864 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17225964 memory=4420 CPUtime=3.4 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 5203 0 0 0 340 0 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511644240568 5046873 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17225964 memory=6628 CPUtime=3.4 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 5171 0 0 0 339 1 0 0 20 0 9 0 558935643 17639387136 4155192 33554432000 4194304 6211132 140729895328752 140511635847864 5046864 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 36.54 s
Current children cumulated vsize: 17225964 KiB
Current children cumulated memory: 16620768 KiB

[startup+25.5007 s]
/proc/loadavg: 7.09 7.90 8.14 9/199 24068
/proc/meminfo: memFree=14120392/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478860 CPUtime=136.04 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 8531680 0 0 0 12351 1253 0 0 20 0 9 0 558934715 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369715 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=17478860 CPUtime=15.76 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 364361 0 0 0 1461 115 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511694597136 5168401 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=1568 CPUtime=15.93 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 396901 0 0 0 1533 60 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511686204432 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=0 CPUtime=15.82 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 355429 0 0 0 1481 101 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511677811800 5441106 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=6935054825532540783 CPUtime=15.79 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 324790 0 0 0 1536 43 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511669419024 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=648 CPUtime=15.88 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 374524 0 0 0 1454 134 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511661026320 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=17170884 CPUtime=15.84 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 386348 0 0 0 1438 146 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511652633688 5168257 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=0 CPUtime=15.73 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 369140 0 0 0 1533 40 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511644240912 5168392 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=4294967715 CPUtime=15.92 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 446671 0 0 0 1536 56 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511635848320 5392352 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 136.04 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478860 KiB

[startup+51.1107 s]
/proc/loadavg: 7.63 7.96 8.15 9/200 24078
/proc/meminfo: memFree=14118536/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478860 CPUtime=340.39 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 12197737 0 0 0 32290 1749 0 0 20 0 9 0 558934715 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369715 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=17478860 CPUtime=41.37 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 831805 0 0 0 3922 215 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511694597136 5168257 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=17478860 CPUtime=41.5 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 864613 0 0 0 4062 88 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511686204312 5167924 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=17478860 CPUtime=41.41 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 825612 0 0 0 3929 212 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511677811800 5392384 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=17478860 CPUtime=41.4 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 861208 0 0 0 4071 69 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511669418888 5446280 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=139749377521848 CPUtime=41.48 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 827578 0 0 0 3918 230 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511661026224 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=139749377684139 CPUtime=41.42 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 828878 0 0 0 3910 232 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511652633688 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=2417 CPUtime=40.94 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 853481 0 0 0 4026 68 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511644240912 5167591 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=0 CPUtime=41.52 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 791046 0 0 0 4073 79 0 0 20 0 9 0 558935643 18178945024 4369715 33554432000 4194304 6211132 140729895328752 140511635848320 5046873 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 340.39 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478860 KiB

[startup+102.301 s]
/proc/loadavg: 8.29 8.09 8.18 9/200 24081
/proc/meminfo: memFree=14117828/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478888 CPUtime=749.03 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 16212465 0 0 0 72688 2215 0 0 20 0 9 0 558934715 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369722 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=1060 CPUtime=92.55 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 1343527 0 0 0 9007 248 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511694597136 5168392 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=17478888 CPUtime=92.69 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 1376716 0 0 0 9151 118 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511686204312 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=6935054825532540783 CPUtime=92 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 1235022 0 0 0 8809 391 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511677811800 5166701 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=9239 CPUtime=92.58 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 1306310 0 0 0 9168 90 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511669418888 5046864 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=2308 CPUtime=92.63 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 1355529 0 0 0 9003 260 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511661026224 5168224 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=132 CPUtime=92.57 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 1343563 0 0 0 8995 262 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511652633688 5167920 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=0 CPUtime=91.97 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 1362691 0 0 0 9016 181 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511644240912 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=33 CPUtime=92.71 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 1375591 0 0 0 9162 109 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511635848320 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 749.03 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478888 KiB

[startup+162.301 s]
/proc/loadavg: 8.69 8.24 8.23 9/201 24107
/proc/meminfo: memFree=14115096/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478888 CPUtime=1227.95 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 18666845 0 0 0 120325 2470 0 0 20 0 9 0 558934715 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369722 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=17478888 CPUtime=152.52 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 1649582 0 0 0 14987 265 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511694597136 5168248 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=17478888 CPUtime=152.24 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 1682923 0 0 0 15086 138 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511686204312 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=17478888 CPUtime=151.68 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 1508559 0 0 0 14707 461 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511677811800 5046873 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=17478888 CPUtime=152.54 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 1553815 0 0 0 15150 104 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511669418888 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=17478888 CPUtime=152.61 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 1693368 0 0 0 14984 277 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511661026224 5166881 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=676 CPUtime=152.5 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 1664851 0 0 0 14971 279 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511652633688 5168401 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=17478888 CPUtime=151.95 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 1665756 0 0 0 14934 261 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511644240912 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=17478888 CPUtime=152.56 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 1734475 0 0 0 15127 129 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511635848320 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 1227.95 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478888 KiB

[startup+222.301 s]
/proc/loadavg: 8.36 8.23 8.23 9/201 24112
/proc/meminfo: memFree=14116136/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478888 CPUtime=1706.9 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 20768623 0 0 0 167892 2798 0 0 20 0 9 0 558934715 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369722 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=776 CPUtime=212.49 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 1974532 0 0 0 20961 288 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511694597136 5167553 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=10416 CPUtime=212.2 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 1992143 0 0 0 21064 156 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511686204312 5168257 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=17478888 CPUtime=211.65 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 1872684 0 0 0 20587 578 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511677811800 5392375 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=17478888 CPUtime=212.36 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 1641209 0 0 0 21127 109 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511669418888 5168368 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=17478888 CPUtime=212.58 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 1923393 0 0 0 20970 288 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511661026224 5166701 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=676 CPUtime=212.48 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 1947912 0 0 0 20951 297 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511652633688 5167561 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=1060 CPUtime=211.79 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 1928262 0 0 0 20798 381 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511644240912 5168368 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=10416 CPUtime=211.99 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 1974972 0 0 0 21055 144 0 0 20 0 9 0 558935643 18178945024 4369722 33554432000 4194304 6211132 140729895328752 140511635848320 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 1706.9 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478888 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252.001 s]*
/proc/loadavg: 8.35 8.24 8.23 9/201 24112
/proc/meminfo: memFree=14116496/32770624 swapFree=66999256/67108860
[pid=24059] ppid=24056 vsize=17752876 memory=17478892 CPUtime=1944.07 cores=0-7
/proc/24059/stat : 24059 (cosoco) S 24056 24059 22907 0 -1 1077944320 22109460 0 0 0 191503 2904 0 0 20 0 9 0 558934715 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140729895327008 140512290565879 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
/proc/24059/statm: 4438219 4369723 883 493 0 4431524 0
[pid=24059/tid=24061] ppid=24056 vsize=17752876 memory=1980 CPUtime=242.19 cores=0-7
/proc/24059/task/24061/stat : 24061 (cosoco) R 24056 24059 22907 0 -1 4202560 2151345 0 0 0 23920 299 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511694597136 5167536 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24062] ppid=24056 vsize=17752876 memory=2512 CPUtime=241.9 cores=0-7
/proc/24059/task/24062/stat : 24062 (cosoco) R 24056 24059 22907 0 -1 4202560 2135347 0 0 0 24026 164 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511686204312 5167960 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24063] ppid=24056 vsize=17752876 memory=1436 CPUtime=241.35 cores=0-7
/proc/24059/task/24063/stat : 24063 (cosoco) R 24056 24059 22907 0 -1 4202560 1940863 0 0 0 23551 584 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511677811800 5167219 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24064] ppid=24056 vsize=17752876 memory=1398722017469774279 CPUtime=241.63 cores=0-7
/proc/24059/task/24064/stat : 24064 (cosoco) R 24056 24059 22907 0 -1 4202560 1795932 0 0 0 24047 116 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511669418888 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24065] ppid=24056 vsize=17752876 memory=288230596050944315 CPUtime=242.28 cores=0-7
/proc/24059/task/24065/stat : 24065 (cosoco) R 24056 24059 22907 0 -1 4202560 2162961 0 0 0 23927 301 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511661026224 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24066] ppid=24056 vsize=17752876 memory=13848573129264102 CPUtime=242.19 cores=0-7
/proc/24059/task/24066/stat : 24066 (cosoco) R 24056 24059 22907 0 -1 4202560 2153707 0 0 0 23910 309 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511652633688 5167591 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24067] ppid=24056 vsize=17752876 memory=111628 CPUtime=241.5 cores=0-7
/proc/24059/task/24067/stat : 24067 (cosoco) R 24056 24059 22907 0 -1 4202560 2118092 0 0 0 23726 424 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511644240912 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
[pid=24059/tid=24068] ppid=24056 vsize=17752876 memory=796 CPUtime=241.68 cores=0-7
/proc/24059/task/24068/stat : 24068 (cosoco) R 24056 24059 22907 0 -1 4202560 2137697 0 0 0 24017 151 0 0 20 0 9 0 558935643 18178945024 4369723 33554432000 4194304 6211132 140729895328752 140511635848320 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 39776256 140729895330838 140729895330930 140729895330930 140729895333838 0
Current children cumulated CPU time: 1944.07 s
Current children cumulated vsize: 17752876 KiB
Current children cumulated memory: 17478892 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+253.179 s]
# the end of solver process 24059 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1915.14 s, system=30.2013 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+252.8 s]
/proc/loadavg: 8.35 8.24 8.23 2/194 24112
/proc/meminfo: memFree=15804756/32770624 swapFree=66999256/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+253 s]*
/proc/loadavg: 8.35 8.24 8.23 2/194 24112
/proc/meminfo: memFree=29066348/32770624 swapFree=66999256/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+253.109 s]
/proc/loadavg: 8.35 8.24 8.23 2/194 24112
/proc/meminfo: memFree=29066348/32770624 swapFree=66999256/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 253.179
CPU time (s): 1945.34
CPU user time (s): 1915.14
CPU system time (s): 30.2013
CPU usage (%): 768.365
Max. virtual memory (cumulated for all children) (KiB): 17752876
Max. memory (cumulated for all children) (KiB): 17478892

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1915.14
system time used= 30.2013
maximum resident set size= 17489056
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22109851
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 209452
involuntary context switches= 16192


# summary of solver processes directly reported to runsolver:
#   pid: 24059
#   total CPU time (s): 1945.34
#   total CPU user time (s): 1915.14
#   total CPU system time (s): 30.2013

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.25547 second user time and 2.33738 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-30 08:59:17
IDJOB=4410005
IDBENCH=115615
IDSOLVER=2878
FILE ID=node103/4410005-1569826817
RUNJOBID= node103-1569816665-22934
PBS_JOBID= 21705909
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Scheduling/Scheduling-fs-taillard/Taillard-fs-200-10-1.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4410005-1569826817/watcher-4410005-1569826817 -o /tmp/evaluation-result-4410005-1569826817/solver-4410005-1569826817 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node103-1569816665-22934 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4410005-1569826817.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4dc4d699091ca89690279c2093d69f52
RANDOM SEED=624143697

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31627604 kB
MemAvailable:   31871712 kB
Buffers:          179020 kB
Cached:           409700 kB
SwapCached:         7000 kB
Active:           332636 kB
Inactive:         269392 kB
Active(anon):      21120 kB
Inactive(anon):    74244 kB
Active(file):     311516 kB
Inactive(file):   195148 kB
Unevictable:      107704 kB
Mlocked:          107704 kB
SwapTotal:      67108860 kB
SwapFree:       66999256 kB
Dirty:              2744 kB
Writeback:             0 kB
AnonPages:        115124 kB
Mapped:            26416 kB
Shmem:             73656 kB
Slab:             134988 kB
SReclaimable:     106560 kB
SUnreclaim:        28428 kB
KernelStack:        3328 kB
PageTables:         5296 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538428 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 62028 MiB
End job on node103 at 2019-09-30 09:03:31