Trace number 4293987

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 1.12SAT (TO)76 2519.97 2520.01

General information on the benchmark

NameCrosswordDesign/
CrosswordDesign-12-4-rom_c18.xml
MD5SUM81778793cf44fcc277d17f448f65fa63
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark76
Best CPU time to get the best result obtained on this benchmark2519.97
Satisfiable
(Un)Satisfiability was proved
Number of variables432
Number of constraints96
Number of domains5
Minimum domain size2
Maximum domain size124353
Distribution of domain sizes[{"size":2,"count":24},{"size":13,"count":168},{"size":27,"count":144},{"size":124353,"count":96}]
Minimum variable degree1
Maximum variable degree8
Distribution of variable degrees[{"degree":1,"count":120},{"degree":2,"count":168},{"degree":8,"count":144}]
Minimum constraint arity15
Maximum constraint arity16
Distribution of constraint arities[{"arity":15,"count":24},{"arity":16,"count":72}]
Number of extensional constraints96
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":96}]
Optimization problemYES
Type of objectivemax SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

23.00/23.05	c best=?? lower=0 upper=1152 
37.68/37.75	c
37.68/37.75	c This is cosoco 1.12 --  
37.68/37.75	c
37.68/37.75	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4293987-1532384615.xml 
37.68/37.75	c enable optimization
37.68/37.75	c ========================================[ Problem Statistics ]===========================================
37.68/37.75	c |                                                                                                       
37.68/37.75	c |  Parse time        :        22.85 s 
37.68/37.75	c |
37.68/37.75	c |               Variables: 432
37.68/37.75	c |            Domain Sizes: 2..124353
37.68/37.75	c |
37.68/37.75	c |             Constraints: 97
37.68/37.75	c |                   Arity: 15..96
37.68/37.75	c | 
37.68/37.75	c |                   Types: 
37.68/37.75	c |                          Extension: 96  (nb tuples: 39175..330226) -- (shared: 88)
37.68/37.75	c |                          Sum: 1
37.68/37.75	c |                          
37.68/37.75	c |               Objective: Maximize Sum
37.68/37.75	
37.68/37.75	c =========================================================================================================
37.68/37.75	o 8
37.68/37.75	c    1 calls to solver: best=8 lower=9 upper=1152 
47.48/47.55	o 10
57.69/57.79	o 11
57.69/57.79	c    3 calls to solver: best=11 lower=12 upper=1152 
68.18/68.23	o 12
78.69/78.77	o 13
78.69/78.77	c    5 calls to solver: best=13 lower=14 upper=1152 
99.88/99.94	o 15
118.19/118.29	o 16
118.19/118.29	c    7 calls to solver: best=16 lower=17 upper=1152 
127.29/127.33	o 18
136.28/136.36	o 19
136.28/136.36	c    9 calls to solver: best=19 lower=20 upper=1152 
145.28/145.35	o 20
154.49/154.55	o 22
154.49/154.55	c   11 calls to solver: best=22 lower=23 upper=1152 
164.58/164.60	o 23
195.78/195.89	o 24
195.78/195.89	c   13 calls to solver: best=24 lower=25 upper=1152 
248.78/248.88	o 25
258.98/259.03	o 26
258.98/259.03	c   15 calls to solver: best=26 lower=27 upper=1152 
286.88/287.00	o 27
323.08/323.12	o 28
323.08/323.12	c   17 calls to solver: best=28 lower=29 upper=1152 
333.47/333.50	o 29
343.27/343.38	o 30
343.27/343.38	c   19 calls to solver: best=30 lower=31 upper=1152 
352.27/352.30	o 31
360.77/360.80	o 32
360.77/360.80	c   21 calls to solver: best=32 lower=33 upper=1152 
368.86/368.92	o 33
376.86/376.97	o 34
376.86/376.97	c   23 calls to solver: best=34 lower=35 upper=1152 
385.36/385.46	o 35
394.16/394.26	o 36
394.16/394.26	c   25 calls to solver: best=36 lower=37 upper=1152 
404.86/404.90	o 37
421.86/421.92	o 39
421.86/421.92	c   27 calls to solver: best=39 lower=40 upper=1152 
430.37/430.49	o 40
583.26/583.37	o 41
583.26/583.37	c   29 calls to solver: best=41 lower=42 upper=1152 
592.86/592.98	o 42
602.56/602.63	o 43
602.56/602.63	c   31 calls to solver: best=43 lower=44 upper=1152 
612.16/612.28	o 44
645.36/645.44	o 45
645.36/645.44	c   33 calls to solver: best=45 lower=46 upper=1152 
655.46/655.53	o 46
778.46/778.53	o 47
778.46/778.53	c   35 calls to solver: best=47 lower=48 upper=1152 
787.16/787.29	o 48
795.16/795.23	o 49
795.16/795.23	c   37 calls to solver: best=49 lower=50 upper=1152 
805.76/805.82	o 50
815.45/815.54	o 51
815.45/815.54	c   39 calls to solver: best=51 lower=52 upper=1152 
824.96/825.10	o 52
832.45/832.57	o 53
832.45/832.57	c   41 calls to solver: best=53 lower=54 upper=1152 
843.06/843.12	o 54
852.35/852.48	o 55
852.35/852.48	c   43 calls to solver: best=55 lower=56 upper=1152 
860.06/860.13	o 56
878.25/878.32	o 57
878.25/878.32	c   45 calls to solver: best=57 lower=58 upper=1152 
886.96/887.09	o 58
895.96/896.06	o 59
895.96/896.06	c   47 calls to solver: best=59 lower=60 upper=1152 
906.46/906.51	o 60
914.56/914.68	o 61
914.56/914.68	c   49 calls to solver: best=61 lower=62 upper=1152 
925.66/925.73	o 62
937.16/937.28	o 63
937.16/937.28	c   51 calls to solver: best=63 lower=64 upper=1152 
945.76/945.83	o 64
1389.46/1389.51	o 65
1389.46/1389.51	c   53 calls to solver: best=65 lower=66 upper=1152 
1398.56/1398.60	o 66
1409.16/1409.28	o 67
1409.16/1409.28	c   55 calls to solver: best=67 lower=68 upper=1152 
1416.66/1416.78	o 68
1424.26/1424.38	o 69
1424.26/1424.38	c   57 calls to solver: best=69 lower=70 upper=1152 
1431.86/1432.00	o 70
1439.36/1439.49	o 71
1439.36/1439.49	c   59 calls to solver: best=71 lower=72 upper=1152 
1446.26/1446.37	o 72
1476.46/1476.50	o 73
1476.46/1476.50	c   61 calls to solver: best=73 lower=74 upper=1152 
1488.66/1488.77	o 74
1499.36/1499.44	o 75
1499.36/1499.44	c   63 calls to solver: best=75 lower=76 upper=1152 
1507.85/1507.98	o 76
2519.96/2520.01	
2519.96/2520.01	c *** INTERRUPTED ***
2519.96/2520.01	c restarts              : 25          
2519.96/2520.01	c conflicts             : 9860         (4 /sec)
2519.96/2520.01	c decisions             : 65418        (26 /sec)
2519.96/2520.01	c propagations          : 3885777747  (1542323 /sec)
2519.96/2520.01	c root propagations     : 4440312     
2519.96/2520.01	c filter calls          : 1613059        (640 /sec)
2519.96/2520.01	c useless filter calls  : 890513         (55 %)
2519.96/2520.01	c Memory used           : 492.35 MB
2519.96/2520.01	c CPU time              : 2519.43 s
2519.96/2520.01	
2519.96/2520.01	c nb Solutions = 64
2519.96/2520.01	s SATISFIABLE
2519.96/2520.01	c Best value found: 76
2519.96/2520.01	
2519.96/2520.01	
2519.96/2520.01	v <instantiation type='solution' cost='76'>
2519.96/2520.01	v <list>bc[0][0] bc[0][1] bc[0][2] bc[0][3] bc[10][0] bc[10][1] bc[10][2] bc[10][3] bc[11][0] bc[11][1] bc[11][2] bc[11][3] bc[1][0] bc[1][1] bc[1][2] bc[1][3] bc[2][0] bc[2][1] bc[2][2] bc[2][3] bc[3][0] bc[3][1] bc[3][2] bc[3][3] bc[4][0] bc[4][1] bc[4][2] bc[4][3] bc[5][0] bc[5][1] bc[5][2] bc[5][3] bc[6][0] bc[6][1] bc[6][2] bc[6][3] bc[7][0] bc[7][1] bc[7][2] bc[7][3] bc[8][0] bc[8][1] bc[8][2] bc[8][3] bc[9][0] bc[9][1] bc[9][2] bc[9][3] br[0][0] br[0][1] br[0][2] br[0][3] br[10][0] br[10][1] br[10][2] br[10][3] br[11][0] br[11][1] br[11][2] br[11][3] br[1][0] br[1][1] br[1][2] br[1][3] br[2][0] br[2][1] br[2][2] br[2][3] br[3][0] br[3][1] br[3][2] br[3][3] br[4][0] br[4][1] br[4][2] br[4][3] br[5][0] br[5][1] br[5][2] br[5][3] br[6][0] br[6][1] br[6][2] br[6][3] br[7][0] br[7][1] br[7][2] br[7][3] br[8][0] br[8][1] br[8][2] br[8][3] br[9][0] br[9][1] br[9][2] br[9][3] c[0][0] c[0][1] c[0][2] c[0][3] c[10][0] c[10][1] c[10][2] c[10][3] c[11][0] c[11][1] c[11][2] c[11][3] c[1][0] c[1][1] c[1][2] c[1][3] c[2][0] c[2][1] c[2][2] c[2][3] c[3][0] c[3][1] c[3][2] c[3][3] c[4][0] c[4][1] c[4][2] c[4][3] c[5][0] c[5][1] c[5][2] c[5][3] c[6][0] c[6][1] c[6][2] c[6][3] c[7][0] c[7][1] c[7][2] c[7][3] c[8][0] c[8][1] c[8][2] c[8][3] c[9][0] c[9][1] c[9][2] c[9][3] pc[0][0] pc[0][1] pc[0][2] pc[0][3] pc[10][0] pc[10][1] pc[10][2] pc[10][3] pc[11][0] pc[11][1] pc[11][2] pc[11][3] pc[1][0] pc[1][1] pc[1][2] pc[1][3] pc[2][0] pc[2][1] pc[2][2] pc[2][3] pc[3][0] pc[3][1] pc[3][2] pc[3][3] pc[4][0] pc[4][1] pc[4][2] pc[4][3] pc[5][0] pc[5][1] pc[5][2] pc[5][3] pc[6][0] pc[6][1] pc[6][2] pc[6][3] pc[7][0] pc[7][1] pc[7][2] pc[7][3] pc[8][0] pc[8][1] pc[8][2] pc[8][3] pc[9][0] pc[9][1] pc[9][2] pc[9][3] pr[0][0] pr[0][1] pr[0][2] pr[0][3] pr[10][0] pr[10][1] pr[10][2] pr[10][3] pr[11][0] pr[11][1] pr[11][2] pr[11][3] pr[1][0] pr[1][1] pr[1][2] pr[1][3] pr[2][0] pr[2][1] pr[2][2] pr[2][3] pr[3][0] pr[3][1] pr[3][2] pr[3][3] pr[4][0] pr[4][1] pr[4][2] pr[4][3] pr[5][0] pr[5][1] pr[5][2] pr[5][3] pr[6][0] pr[6][1] pr[6][2] pr[6][3] pr[7][0] pr[7][1] pr[7][2] pr[7][3] pr[8][0] pr[8][1] pr[8][2] pr[8][3] pr[9][0] pr[9][1] pr[9][2] pr[9][3] r[0][0] r[0][1] r[0][2] r[0][3] r[10][0] r[10][1] r[10][2] r[10][3] r[11][0] r[11][1] r[11][2] r[11][3] r[1][0] r[1][1] r[1][2] r[1][3] r[2][0] r[2][1] r[2][2] r[2][3] r[3][0] r[3][1] r[3][2] r[3][3] r[4][0] r[4][1] r[4][2] r[4][3] r[5][0] r[5][1] r[5][2] r[5][3] r[6][0] r[6][1] r[6][2] r[6][3] r[7][0] r[7][1] r[7][2] r[7][3] r[8][0] r[8][1] r[8][2] r[8][3] r[9][0] r[9][1] r[9][2] r[9][3] x[0][0] x[0][10] x[0][11] x[0][1] x[0][2] x[0][3] x[0][4] x[0][5] x[0][6] x[0][7] x[0][8] x[0][9] x[10][0] x[10][10] x[10][11] x[10][1] x[10][2] x[10][3] x[10][4] x[10][5] x[10][6] x[10][7] x[10][8] x[10][9] x[11][0] x[11][10] x[11][11] x[11][1] x[11][2] x[11][3] x[11][4] x[11][5] x[11][6] x[11][7] x[11][8] x[11][9] x[1][0] x[1][10] x[1][11] x[1][1] x[1][2] x[1][3] x[1][4] x[1][5] x[1][6] x[1][7] x[1][8] x[1][9] x[2][0] x[2][10] x[2][11] x[2][1] x[2][2] x[2][3] x[2][4] x[2][5] x[2][6] x[2][7] x[2][8] x[2][9] x[3][0] x[3][10] x[3][11] x[3][1] x[3][2] x[3][3] x[3][4] x[3][5] x[3][6] x[3][7] x[3][8] x[3][9] x[4][0] x[4][10] x[4][11] x[4][1] x[4][2] x[4][3] x[4][4] x[4][5] x[4][6] x[4][7] x[4][8] x[4][9] x[5][0] x[5][10] x[5][11] x[5][1] x[5][2] x[5][3] x[5][4] x[5][5] x[5][6] x[5][7] x[5][8] x[5][9] x[6][0] x[6][10] x[6][11] x[6][1] x[6][2] x[6][3] x[6][4] x[6][5] x[6][6] x[6][7] x[6][8] x[6][9] x[7][0] x[7][10] x[7][11] x[7][1] x[7][2] x[7][3] x[7][4] x[7][5] x[7][6] x[7][7] x[7][8] x[7][9] x[8][0] x[8][10] x[8][11] x[8][1] x[8][2] x[8][3] x[8][4] x[8][5] x[8][6] x[8][7] x[8][8] x[8][9] x[9][0] x[9][10] x[9][11] x[9][1] x[9][2] x[9][3] x[9][4] x[9][5] x[9][6] x[9][7] x[9][8] x[9][9] </list>
2519.96/2520.01	v <values>9 0 0 0 9 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 9 0 0 0 71404 8777 -1 -1 122367 1 -1 -1 112785 50451 -1 -1 17981 0 -1 -1 99026 94573 50394 92198 41112 3060 92862 -1 0 59717 66938 -1 14557 75636 122636 -1 35098 1 71880 -1 59880 79501 117811 60437 8331 75907 -1 -1 2166 118153 59881 -1 0 10 -1 -1 0 10 -1 -1 1 5 -1 -1 1 11 -1 -1 0 2 5 7 0 6 11 -1 0 2 4 -1 0 8 11 -1 0 3 6 -1 0 2 4 8 1 11 -1 -1 0 5 9 -1 0 2 9 -1 0 2 4 6 0 10 -1 -1 0 3 5 8 0 7 -1 -1 0 5 8 -1 0 3 10 -1 0 4 7 -1 0 3 -1 -1 0 3 6 8 0 10 -1 -1 1 11 -1 -1 71363 103454 8978 -1 0 0 71363 14273 119853 0 -1 -1 390 50394 1 2104 18477 92198 -1 -1 49715 59881 105645 -1 114164 118129 117692 -1 58608 35754 58334 -1 47043 8004 -1 -1 2494 60852 0 60437 62242 71364 -1 -1 71404 99026 -1 -1 13 22 26 26 18 5 0 2 4 11 26 0 0 0 8 26 0 26 13 26 2 0 26 0 21 0 26 0 17 17 0 25 0 13 14 26 0 0 19 2 26 8 26 0 0 26 0 6 2 17 4 4 17 18 10 8 26 15 20 8 7 1 0 11 4 8 26 11 0 26 18 14 19 20 26 8 26 20 12 11 0 20 19 26 8 17 8 20 8 26 4 8 26 8 17 20 6 19 0 18 26 0 19 4 13 20 0 13 0 14 17 10 26 11 4 26 0 26 11 0 11 13 0 8 18 8 0 13 18 10 8 26 26 26 18 13 0 2 7 19 8 6 0 11 </values>
2519.96/2520.01	v </instantiation>
2519.96/2520.01

Verifier Data 

OK	76

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12800 MiB free)
  memory of node 1: 16384 MiB (13673 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293987-1532384615/watcher-4293987-1532384615 -o /tmp/evaluation-result-4293987-1532384615/solver-4293987-1532384615 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1532369368-20797 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4293987-1532384615.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22476, runsolver pid=22473

[startup+0.100169 s]*
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=27015500/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=121512 memory=97584 CPUtime=0.09 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 24605 0 0 0 7 2 0 0 20 0 1 0 56024825 124428288 24396 33554432000 4194304 6142532 140731350567328 140731350563960 140526584474597 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 30378 24396 783 476 0 23700 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 121512 KiB
Current children cumulated memory: 97584 KiB

[startup+0.210082 s]*
/proc/loadavg: 2.02 2.05 2.05 4/192 22477
/proc/meminfo: memFree=27014756/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=122428 memory=98548 CPUtime=0.2 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 24843 0 0 0 18 2 0 0 20 0 1 0 56024825 125366272 24637 33554432000 4194304 6142532 140731350567328 140731350563960 5802594 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 30607 24637 783 476 0 23929 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 122428 KiB
Current children cumulated memory: 98548 KiB

[startup+0.30925 s]*
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=27013640/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=123340 memory=99120 CPUtime=0.31 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 25111 0 0 0 28 3 0 0 20 0 1 0 56024825 126300160 24780 33554432000 4194304 6142532 140731350567328 140731350563960 140526584474597 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 30835 24780 783 476 0 24157 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 123340 KiB
Current children cumulated memory: 99120 KiB

[startup+0.700285 s]
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=27012624/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=126088 memory=101836 CPUtime=0.69 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 25964 0 0 0 66 3 0 0 20 0 1 0 56024825 129114112 25459 33554432000 4194304 6142532 140731350567328 140731350563976 5489263 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 31522 25459 783 476 0 24844 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 126088 KiB
Current children cumulated memory: 101836 KiB

[startup+1.50028 s]
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=27009276/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=131848 memory=107200 CPUtime=1.48 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 27212 0 0 0 145 3 0 0 20 0 1 0 56024825 135012352 26800 33554432000 4194304 6142532 140731350567328 140731350563976 5489275 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 32962 26800 783 476 0 26284 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 131848 KiB
Current children cumulated memory: 107200 KiB

[startup+3.10971 s]
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=26996376/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=143236 memory=117976 CPUtime=3.1 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 29955 0 0 0 306 4 0 0 20 0 1 0 56024825 146673664 29494 33554432000 4194304 6142532 140731350567328 140731350563976 5801854 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 35809 29494 783 476 0 29131 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 143236 KiB
Current children cumulated memory: 117976 KiB

[startup+6.30027 s]
/proc/loadavg: 2.02 2.05 2.05 3/192 22477
/proc/meminfo: memFree=26955360/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=181640 memory=157480 CPUtime=6.28 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 47777 0 0 0 619 9 0 0 20 0 1 0 56024825 185999360 39370 33554432000 4194304 6142532 140731350567328 140731350563976 5489252 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 45410 39370 792 476 0 38732 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 181640 KiB
Current children cumulated memory: 157480 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 2.03 2.04 3/192 22477
/proc/meminfo: memFree=26904812/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=233376 memory=207872 CPUtime=12.69 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 69807 0 0 0 1257 12 0 0 20 0 1 0 56024825 238977024 51968 33554432000 4194304 6142532 140731350567328 140731350563976 5802079 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 58344 51968 792 476 0 51666 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 233376 KiB
Current children cumulated memory: 207872 KiB

[startup+25.5004 s]
/proc/loadavg: 1.95 2.03 2.04 3/192 22477
/proc/meminfo: memFree=26635476/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=476888 CPUtime=25.49 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 221848 0 0 0 2525 24 0 0 20 0 1 0 56024825 516263936 119222 33554432000 4194304 6142532 140731350567328 140731350554616 5017775 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119222 844 476 0 119363 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 476888 KiB

[startup+51.1102 s]
/proc/loadavg: 1.97 2.02 2.04 3/192 22477
/proc/meminfo: memFree=26634192/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=476896 CPUtime=51.1 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 321917 0 0 0 5081 29 0 0 20 0 1 0 56024825 516263936 119224 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119224 846 476 0 119363 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 476896 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.02 2.04 3/191 22479
/proc/meminfo: memFree=26632856/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=476896 CPUtime=102.29 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 429706 0 0 0 10195 34 0 0 20 0 1 0 56024825 516263936 119224 33554432000 4194304 6142532 140731350567328 140731350554600 5017902 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119224 846 476 0 119363 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 476896 KiB

[startup+162.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/192 22482
/proc/meminfo: memFree=26632052/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=476896 CPUtime=162.28 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 523131 0 0 0 16190 38 0 0 20 0 1 0 56024825 516263936 119224 33554432000 4194304 6142532 140731350567328 140731350554600 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119224 846 476 0 119363 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 476896 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/192 22483
/proc/meminfo: memFree=26631072/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=477464 CPUtime=222.28 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 594945 0 0 0 22185 43 0 0 20 0 1 0 56024825 516263936 119366 33554432000 4194304 6142532 140731350567328 140731350554600 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119366 846 476 0 119363 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 477464 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/192 22485
/proc/meminfo: memFree=26629672/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=478780 CPUtime=282.28 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 642878 0 0 0 28183 45 0 0 20 0 1 0 56024825 516263936 119695 33554432000 4194304 6142532 140731350567328 140731350554600 5017816 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119695 846 476 0 119363 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 478780 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 22486
/proc/meminfo: memFree=26629748/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=478780 CPUtime=342.27 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 682020 0 0 0 34180 47 0 0 20 0 1 0 56024825 516263936 119695 33554432000 4194304 6142532 140731350567328 140731350564856 5017782 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 119695 846 476 0 119363 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 478780 KiB

[startup+402.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/192 22494
/proc/meminfo: memFree=26627340/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=402.26 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 702415 0 0 0 40178 48 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350554600 5016542 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/190 22495
/proc/meminfo: memFree=26628712/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=462.27 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 704145 0 0 0 46178 49 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB


################
# More data... #
################

/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.05 2.09 3/191 22535
/proc/meminfo: memFree=26627880/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=1782.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 744786 0 0 0 178174 51 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+1842.3 s]
/proc/loadavg: 2.08 2.06 2.09 3/191 22536
/proc/meminfo: memFree=26628172/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=1842.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 746417 0 0 0 184174 51 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+1902.3 s]
/proc/loadavg: 2.03 2.05 2.08 3/190 22538
/proc/meminfo: memFree=26628400/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=1902.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 748148 0 0 0 190173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5333269 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 1902.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.04 2.08 3/191 22540
/proc/meminfo: memFree=26628200/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=1962.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 749841 0 0 0 196173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017759 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.07 3/191 22541
/proc/meminfo: memFree=26628124/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2022.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 751468 0 0 0 202173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2022.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.07 3/191 22543
/proc/meminfo: memFree=26628316/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2082.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 753158 0 0 0 208173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5016422 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2082.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.06 3/191 22544
/proc/meminfo: memFree=26628120/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2142.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 754836 0 0 0 214173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017909 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2142.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2202.3 s]
/proc/loadavg: 2.04 2.03 2.06 3/192 22553
/proc/meminfo: memFree=26627108/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2202.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 756480 0 0 0 220173 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2202.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/191 22579
/proc/meminfo: memFree=26625576/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2262.24 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 758069 0 0 0 226172 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/191 22580
/proc/meminfo: memFree=26626052/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2322.24 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 760302 0 0 0 232172 52 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5016509 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/191 22581
/proc/meminfo: memFree=26626708/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2382.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 761929 0 0 0 238172 53 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017997 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2382.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 22583
/proc/meminfo: memFree=26626864/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2442.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 763962 0 0 0 244172 53 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017759 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2442.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 22709
/proc/meminfo: memFree=26653788/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2502.25 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 765565 0 0 0 250172 53 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2502.25 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/191 22709
/proc/meminfo: memFree=26491468/32770624 swapFree=67108860/67108860
[pid=22476] ppid=22473 vsize=504164 memory=480104 CPUtime=2519.96 cores=1,3,5,7
/proc/22476/stat : 22476 (cosoco) R 22473 22476 20765 0 -1 4202496 765643 0 0 0 251943 53 0 0 20 0 1 0 56024825 516263936 120026 33554432000 4194304 6142532 140731350567328 140731350564856 5017803 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 29958144 140731350570118 140731350570248 140731350570248 140731350573006 0
/proc/22476/statm: 126041 120026 846 476 0 119363 0
Current children cumulated CPU time: 2519.96 s
Current children cumulated vsize: 504164 KiB
Current children cumulated memory: 480104 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22476 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.43 s, system=0.535994 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.97
CPU user time (s): 2519.43
CPU system time (s): 0.535994
CPU usage (%): 99.9982
Max. virtual memory (cumulated for all children) (KiB): 504164
Max. memory (cumulated for all children) (KiB): 480104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.43
system time used= 0.535994
maximum resident set size= 480168
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 765695
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 671


# summary of solver processes directly reported to runsolver:
#   pid: 22476
#   total CPU time (s): 2519.97
#   total CPU user time (s): 2519.43
#   total CPU system time (s): 0.535994

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.00972 second user time and 22.1466 second system time

The end

Launcher Data 

Begin job on node134 at 2018-07-24 00:23:36
IDJOB=4293987
IDBENCH=141307
IDSOLVER=2752
FILE ID=node134/4293987-1532384615
RUNJOBID= node134-1532369368-20797
PBS_JOBID= 21021570
Free space on /tmp= 55904 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/CrosswordDesign/CrosswordDesign-12-4-rom_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293987-1532384615/watcher-4293987-1532384615 -o /tmp/evaluation-result-4293987-1532384615/solver-4293987-1532384615 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1532369368-20797 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4293987-1532384615.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 81778793cf44fcc277d17f448f65fa63
RANDOM SEED=857579300

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27110012 kB
MemAvailable:   31729716 kB
Buffers:          198344 kB
Cached:          4684724 kB
SwapCached:            0 kB
Active:          1771884 kB
Inactive:        3414324 kB
Active(anon):     252676 kB
Inactive(anon):    70292 kB
Active(file):    1519208 kB
Inactive(file):  3344032 kB
Unevictable:        7396 kB
Mlocked:            7396 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             65720 kB
Writeback:             0 kB
AnonPages:        310740 kB
Mapped:            39400 kB
Shmem:             17056 kB
Slab:             173072 kB
SReclaimable:     144600 kB
SUnreclaim:        28472 kB
KernelStack:        3376 kB
PageTables:         5580 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     594956 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     47104 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 55812 MiB
End job on node134 at 2018-07-24 01:05:36