Trace number 4396877

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.02 2520.01

General information on the benchmark

NameLangford/Langford-m1-k3/
Langford-3-45.xml
MD5SUMc29e6924973099ab0a0c802e448a5f67
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark185.253
Satisfiable
(Un)Satisfiability was proved
Number of variables135
Number of constraints91
Number of domains1
Minimum domain size135
Maximum domain size135
Distribution of domain sizes[{"size":135,"count":135}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":90},{"degree":3,"count":45}]
Minimum constraint arity2
Maximum constraint arity135
Distribution of constraint arities[{"arity":2,"count":90},{"arity":135,"count":1}]
Number of extensional constraints0
Number of intensional constraints90
Distribution of constraint types[{"type":"intension","count":90},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396877-1568578406.xml 
0.00/0.01	c intension  eq(add(x[0][0],2),x[1][0]) -> extension (support ? 1) - 133tuples
0.00/0.02	c intension  eq(add(x[0][1],3),x[1][1]) -> extension (support ? 1) - 132tuples
0.00/0.03	c intension  eq(add(x[0][2],4),x[1][2]) -> extension (support ? 1) - 131tuples
0.00/0.03	c intension  eq(add(x[0][3],5),x[1][3]) -> extension (support ? 1) - 130tuples
0.00/0.04	c intension  eq(add(x[0][4],6),x[1][4]) -> extension (support ? 1) - 129tuples
0.00/0.05	c intension  eq(add(x[0][5],7),x[1][5]) -> extension (support ? 1) - 128tuples
0.00/0.06	c intension  eq(add(x[0][6],8),x[1][6]) -> extension (support ? 1) - 127tuples
0.00/0.07	c intension  eq(add(x[0][7],9),x[1][7]) -> extension (support ? 1) - 126tuples
0.00/0.07	c intension  eq(add(x[0][8],10),x[1][8]) -> extension (support ? 1) - 125tuples
0.00/0.08	c intension  eq(add(x[0][9],11),x[1][9]) -> extension (support ? 1) - 124tuples
0.00/0.09	c intension  eq(add(x[0][10],12),x[1][10]) -> extension (support ? 1) - 123tuples
0.00/0.10	c intension  eq(add(x[0][11],13),x[1][11]) -> extension (support ? 1) - 122tuples
0.00/0.10	c intension  eq(add(x[0][12],14),x[1][12]) -> extension (support ? 1) - 121tuples
0.10/0.11	c intension  eq(add(x[0][13],15),x[1][13]) -> extension (support ? 1) - 120tuples
0.10/0.12	c intension  eq(add(x[0][14],16),x[1][14]) -> extension (support ? 1) - 119tuples
0.10/0.13	c intension  eq(add(x[0][15],17),x[1][15]) -> extension (support ? 1) - 118tuples
0.10/0.13	c intension  eq(add(x[0][16],18),x[1][16]) -> extension (support ? 1) - 117tuples
0.10/0.14	c intension  eq(add(x[0][17],19),x[1][17]) -> extension (support ? 1) - 116tuples
0.10/0.15	c intension  eq(add(x[0][18],20),x[1][18]) -> extension (support ? 1) - 115tuples
0.10/0.16	c intension  eq(add(x[0][19],21),x[1][19]) -> extension (support ? 1) - 114tuples
0.10/0.17	c intension  eq(add(x[0][20],22),x[1][20]) -> extension (support ? 1) - 113tuples
0.10/0.17	c intension  eq(add(x[0][21],23),x[1][21]) -> extension (support ? 1) - 112tuples
0.10/0.18	c intension  eq(add(x[0][22],24),x[1][22]) -> extension (support ? 1) - 111tuples
0.10/0.19	c intension  eq(add(x[0][23],25),x[1][23]) -> extension (support ? 1) - 110tuples
0.10/0.20	c intension  eq(add(x[0][24],26),x[1][24]) -> extension (support ? 1) - 109tuples
0.10/0.20	c intension  eq(add(x[0][25],27),x[1][25]) -> extension (support ? 1) - 108tuples
0.10/0.21	c intension  eq(add(x[0][26],28),x[1][26]) -> extension (support ? 1) - 107tuples
0.21/0.22	c intension  eq(add(x[0][27],29),x[1][27]) -> extension (support ? 1) - 106tuples
0.21/0.23	c intension  eq(add(x[0][28],30),x[1][28]) -> extension (support ? 1) - 105tuples
0.21/0.24	c intension  eq(add(x[0][29],31),x[1][29]) -> extension (support ? 1) - 104tuples
0.21/0.24	c intension  eq(add(x[0][30],32),x[1][30]) -> extension (support ? 1) - 103tuples
0.21/0.25	c intension  eq(add(x[0][31],33),x[1][31]) -> extension (support ? 1) - 102tuples
0.21/0.26	c intension  eq(add(x[0][32],34),x[1][32]) -> extension (support ? 1) - 101tuples
0.21/0.27	c intension  eq(add(x[0][33],35),x[1][33]) -> extension (support ? 1) - 100tuples
0.21/0.27	c intension  eq(add(x[0][34],36),x[1][34]) -> extension (support ? 1) - 99tuples
0.21/0.28	c intension  eq(add(x[0][35],37),x[1][35]) -> extension (support ? 1) - 98tuples
0.21/0.29	c intension  eq(add(x[0][36],38),x[1][36]) -> extension (support ? 1) - 97tuples
0.21/0.30	c intension  eq(add(x[0][37],39),x[1][37]) -> extension (support ? 1) - 96tuples
0.21/0.30	c intension  eq(add(x[0][38],40),x[1][38]) -> extension (support ? 1) - 95tuples
0.21/0.31	c intension  eq(add(x[0][39],41),x[1][39]) -> extension (support ? 1) - 94tuples
0.31/0.32	c intension  eq(add(x[0][40],42),x[1][40]) -> extension (support ? 1) - 93tuples
0.31/0.33	c intension  eq(add(x[0][41],43),x[1][41]) -> extension (support ? 1) - 92tuples
0.31/0.34	c intension  eq(add(x[0][42],44),x[1][42]) -> extension (support ? 1) - 91tuples
0.31/0.34	c intension  eq(add(x[0][43],45),x[1][43]) -> extension (support ? 1) - 90tuples
0.31/0.35	c intension  eq(add(x[0][44],46),x[1][44]) -> extension (support ? 1) - 89tuples
0.31/0.36	c intension  eq(add(x[1][0],2),x[2][0]) -> extension (support ? 1) - 133tuples
0.31/0.37	c intension  eq(add(x[1][1],3),x[2][1]) -> extension (support ? 1) - 132tuples
0.31/0.37	c intension  eq(add(x[1][2],4),x[2][2]) -> extension (support ? 1) - 131tuples
0.31/0.38	c intension  eq(add(x[1][3],5),x[2][3]) -> extension (support ? 1) - 130tuples
0.31/0.39	c intension  eq(add(x[1][4],6),x[2][4]) -> extension (support ? 1) - 129tuples
0.31/0.40	c intension  eq(add(x[1][5],7),x[2][5]) -> extension (support ? 1) - 128tuples
0.31/0.41	c intension  eq(add(x[1][6],8),x[2][6]) -> extension (support ? 1) - 127tuples
0.41/0.41	c intension  eq(add(x[1][7],9),x[2][7]) -> extension (support ? 1) - 126tuples
0.41/0.42	c intension  eq(add(x[1][8],10),x[2][8]) -> extension (support ? 1) - 125tuples
0.41/0.43	c intension  eq(add(x[1][9],11),x[2][9]) -> extension (support ? 1) - 124tuples
0.41/0.44	c intension  eq(add(x[1][10],12),x[2][10]) -> extension (support ? 1) - 123tuples
0.41/0.45	c intension  eq(add(x[1][11],13),x[2][11]) -> extension (support ? 1) - 122tuples
0.41/0.45	c intension  eq(add(x[1][12],14),x[2][12]) -> extension (support ? 1) - 121tuples
0.41/0.46	c intension  eq(add(x[1][13],15),x[2][13]) -> extension (support ? 1) - 120tuples
0.41/0.47	c intension  eq(add(x[1][14],16),x[2][14]) -> extension (support ? 1) - 119tuples
0.41/0.48	c intension  eq(add(x[1][15],17),x[2][15]) -> extension (support ? 1) - 118tuples
0.41/0.48	c intension  eq(add(x[1][16],18),x[2][16]) -> extension (support ? 1) - 117tuples
0.41/0.49	c intension  eq(add(x[1][17],19),x[2][17]) -> extension (support ? 1) - 116tuples
0.41/0.50	c intension  eq(add(x[1][18],20),x[2][18]) -> extension (support ? 1) - 115tuples
0.41/0.51	c intension  eq(add(x[1][19],21),x[2][19]) -> extension (support ? 1) - 114tuples
0.50/0.51	c intension  eq(add(x[1][20],22),x[2][20]) -> extension (support ? 1) - 113tuples
0.50/0.52	c intension  eq(add(x[1][21],23),x[2][21]) -> extension (support ? 1) - 112tuples
0.50/0.53	c intension  eq(add(x[1][22],24),x[2][22]) -> extension (support ? 1) - 111tuples
0.50/0.54	c intension  eq(add(x[1][23],25),x[2][23]) -> extension (support ? 1) - 110tuples
0.50/0.55	c intension  eq(add(x[1][24],26),x[2][24]) -> extension (support ? 1) - 109tuples
0.50/0.55	c intension  eq(add(x[1][25],27),x[2][25]) -> extension (support ? 1) - 108tuples
0.50/0.56	c intension  eq(add(x[1][26],28),x[2][26]) -> extension (support ? 1) - 107tuples
0.50/0.57	c intension  eq(add(x[1][27],29),x[2][27]) -> extension (support ? 1) - 106tuples
0.50/0.58	c intension  eq(add(x[1][28],30),x[2][28]) -> extension (support ? 1) - 105tuples
0.50/0.58	c intension  eq(add(x[1][29],31),x[2][29]) -> extension (support ? 1) - 104tuples
0.50/0.59	c intension  eq(add(x[1][30],32),x[2][30]) -> extension (support ? 1) - 103tuples
0.50/0.60	c intension  eq(add(x[1][31],33),x[2][31]) -> extension (support ? 1) - 102tuples
0.60/0.61	c intension  eq(add(x[1][32],34),x[2][32]) -> extension (support ? 1) - 101tuples
0.60/0.61	c intension  eq(add(x[1][33],35),x[2][33]) -> extension (support ? 1) - 100tuples
0.60/0.62	c intension  eq(add(x[1][34],36),x[2][34]) -> extension (support ? 1) - 99tuples
0.60/0.63	c intension  eq(add(x[1][35],37),x[2][35]) -> extension (support ? 1) - 98tuples
0.60/0.64	c intension  eq(add(x[1][36],38),x[2][36]) -> extension (support ? 1) - 97tuples
0.60/0.65	c intension  eq(add(x[1][37],39),x[2][37]) -> extension (support ? 1) - 96tuples
0.60/0.65	c intension  eq(add(x[1][38],40),x[2][38]) -> extension (support ? 1) - 95tuples
0.60/0.66	c intension  eq(add(x[1][39],41),x[2][39]) -> extension (support ? 1) - 94tuples
0.60/0.67	c intension  eq(add(x[1][40],42),x[2][40]) -> extension (support ? 1) - 93tuples
0.60/0.68	c intension  eq(add(x[1][41],43),x[2][41]) -> extension (support ? 1) - 92tuples
0.60/0.68	c intension  eq(add(x[1][42],44),x[2][42]) -> extension (support ? 1) - 91tuples
0.60/0.69	c intension  eq(add(x[1][43],45),x[2][43]) -> extension (support ? 1) - 90tuples
0.69/0.70	c intension  eq(add(x[1][44],46),x[2][44]) -> extension (support ? 1) - 89tuples
0.69/0.70	c root propagations     : 6480        
0.69/0.70	c restarts enabled, print stats at every restarts
0.69/0.70	c
0.69/0.70	c
0.69/0.70	c ========================================[ Problem Statistics ]===========================================
0.69/0.70	c |                                                                                                       
0.69/0.70	c |  Parse time        :         0.69 s 
0.69/0.70	c |
0.69/0.70	c |               Variables: 135
0.69/0.70	c |            Domain Sizes: 135..135
0.69/0.70	c |
0.69/0.70	c |             Constraints: 91
0.69/0.70	c |                   Arity: 2..135  -- Binary: 90
0.69/0.70	c | 
0.69/0.70	c |                   Types: 
0.69/0.70	c |                          All Different: 1
0.69/0.70	c |                          Extension: 90  (nb tuples: 89..133) -- (shared: 0)
0.69/0.70	c |                          
0.69/0.70	c =========================================================================================================
0.69/0.70	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.79/0.88	c 101            470            15910          125633         135            0              61   79   68   
1.00/1.05	c 211            1000           31311          253353         135            0              37   85   77   
1.19/1.25	c 332            1457           48500          379198         135            0              40   88   76   
1.49/1.50	c 465            2007           70475          543758         135            0              43   91   77   
1.69/1.71	c 611            2627           89695          671925         135            0              70   88   78   
2.00/2.03	c 771            3399           117173         877449         135            0              73   94   79   
2.29/2.35	c 947            4208           145717         1082229        135            0              70   91   79   
2.59/2.66	c 1140           5034           172744         1292338        135            0              70   91   78   
2.89/2.98	c 1352           5936           201548         1481566        135            0              73   94   80   
3.39/3.46	c 1585           6967           243496         1771362        135            0              67   91   79   
3.99/4.09	c 1841           8117           298633         2134704        135            0              70   94   80   
4.59/4.69	c 2122           9385           351481         2542213        135            0              67   94   79   
5.28/5.32	c 2431           10819          406052         2957746        135            0              64   91   78   
5.88/5.95	c 2770           12235          461006         3383378        135            0              70   91   77   
6.58/6.66	c 3142           14044          523352         3867073        135            0              46   88   76   
7.38/7.48	c 3551           15950          594028         4397329        135            0              67   88   77   
8.18/8.29	c 4000           17932          664844         4950673        135            0              58   97   81   
9.28/9.33	c 4493           20240          755899         5587444        135            0              55   97   81   
10.38/10.49	c 5035           22597          856493         6338536        135            0              58   91   78   
11.68/11.70	c 5631           25245          960695         7142016        135            0              64   88   77   
12.78/12.87	c 6286           28357          1063015        7862774        135            0              67   91   78   
14.28/14.32	c 7006           31396          1190204        8803513        135            0              70   91   78   
15.99/16.04	c 7798           34576          1338797        9788703        135            0              70   91   78   
17.88/17.96	c 8669           38381          1504758        10930782       135            0              67   91   79   
20.09/20.11	c 9627           42318          1691422        12234217       135            0              64   94   78   
22.28/22.35	c 10680          46698          1886999        13617341       135            0              67   91   78   
25.29/25.35	c 11838          52446          2145277        15321408       135            0              58   100   78  
27.89/27.99	c 13111          58417          2372880        17006902       135            0              58   94   78   
31.19/31.21	c 14511          64728          2653757        18889755       135            0              58   94   81   
34.18/34.20	c 16051          71668          2914651        20911293       135            0              61   94   78   
38.09/38.13	c 17745          79137          3253649        23369498       135            0              67   91   79   
42.38/42.43	c 19608          87492          3627675        25958629       135            0              70   97   80   
46.99/47.05	c 21657          97464          4029057        28938454       135            0              67   100   80  
51.38/51.42	c 23910          107385         4415413        31679443       135            0              67   97   82   
57.78/57.89	c 26388          118542         4966467        35524588       135            0              64   94   77   
63.68/63.71	c 29113          131134         5466934        39309001       135            0              64   91   77   
70.27/70.36	c 32110          144859         6044240        43369782       135            0              67   97   80   
77.37/77.41	c 35406          159594         6652888        48074223       135            0              64   94   78   
84.77/84.82	c 39031          176467         7301793        52310441       135            0              58   97   80   
93.47/93.57	c 43018          194245         8055629        57815562       135            0              61   97   79   
102.87/102.90	c 47403          212979         8864726        64054480       135            0              64   97   79   
111.66/111.72	c 52226          234386         9639710        70033938       135            0              64   100   79  
122.97/123.10	c 57531          258582         10631065       76880607       135            0              64   97   79   
134.07/134.12	c 63366          285252         11600855       84088297       135            0              61   97   80   
146.45/146.58	c 69784          312922         12671883       91746396       135            0              64   100   78  
162.06/162.13	c 76843          345025         14029965       100931065      135            0              64   100   80  
178.55/178.67	c 84607          379882         15464278       110545766      135            0              64   100   79  
196.95/197.10	c 93147          417891         17076647       121720567      135            0              64   97   79   
216.64/216.78	c 102541         462520         18785786       133393778      135            0              58   97   79   
237.23/237.37	c 112874         507029         20578665       146298599      135            0              64   94   77   
259.03/259.13	c 124240         554371         22489742       159976565      135            0              67   100   81  
285.92/286.01	c 136742         609740         24820372       175818076      135            0              64   100   80  
313.21/313.35	c 150494         673685         27216294       192045821      135            0              67   103   82  
345.60/345.76	c 165621         748371         30020960       211931713      135            0              64   106   80  
380.79/380.96	c 182260         825124         33064667       234472601      135            0              64   100   78  
423.08/423.29	c 200562         910917         36766729       260195241      135            0              64   103   81  
465.57/465.78	c 220694         1007531        40452207       288734006      135            0              64   103   81  
513.56/513.76	c 242839         1112395        44642056       317849387      135            0              64   103   82  
567.74/567.92	c 267198         1230783        49373547       350642410      135            0              64   103   82  
632.14/632.35	c 293992         1349950        55049898       387366514      135            0              67   103   83  
697.95/698.13	c 323465         1488203        60825934       427108033      135            0              64   106   81  
765.65/765.86	c 355885         1638085        66796771       472885112      135            0              64   103   82  
848.15/848.36	c 391547         1808510        74157329       522802197      135            0              64   103   83  
924.56/924.76	c 430775         1989236        80896637       572765883      135            0              64   103   79  
1018.88/1019.03	c 473925         2192121        89125230       631003260      135            0              61   100   78  
1117.18/1117.34	c 521390         2407976        97785391       690313467      135            0              64   109   81  
1239.69/1239.89	c 573601         2638855        108554242      760794343      135            0              67   103   82  
1360.40/1360.55	c 631033         2909584        119131128      834773200      135            0              64   106   81  
1486.11/1486.23	c 694208         3193163        130219534      911206032      135            0              64   103   82  
1626.62/1626.74	c 763700         3526004        142499320      999709455      135            0              64   103   80  
1789.04/1789.17	c 840141         3896643        156606069      1102014512     135            0              55   103   79  
1969.95/1970.05	c 924226         4295068        172335145      1211428293     135            0              61   103   80  
2168.07/2168.18	c 1016719        4725361        189776407      1335052977     135            0              64   106   82  
2390.58/2390.60	c 1118461        5195869        209470317      1468606769     135            0              64   109   82  
2520.00/2520.00	
2520.00/2520.00	c *** INTERRUPTED ***
2520.00/2520.00	c restarts              : 74          
2520.00/2520.00	c conflicts             : 1177685      (467 /sec)
2520.00/2520.00	c decisions             : 5483025      (2176 /sec)
2520.00/2520.00	c propagations          : 1550272262  (615188 /sec)
2520.00/2520.00	c root propagations     : 6480        
2520.00/2520.00	c filter calls          : 220734991      (87593 /sec)
2520.00/2520.00	c useless filter calls  : 32552145       (14 %)
2520.00/2520.00	c Memory used           : 30.38 MB
2520.00/2520.00	c CPU time              : 2520 s
2520.00/2520.00	c real time             : 2520 s
2520.00/2520.00	
2520.00/2520.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15164 MiB free)
  memory of node 1: 16384 MiB (14252 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396877-1568578406/watcher-4396877-1568578406 -o /tmp/evaluation-result-4396877-1568578406/solver-4396877-1568578406 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568569089-22859 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396877-1568578406.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=24037, runsolver pid=24034

[startup+0.100122 s]*
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30121252/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=28960 memory=5280 CPUtime=0.1 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 1558 0 0 0 10 0 0 0 20 0 1 0 434098889 29655040 1320 33554432000 4194304 6211092 140722532134560 140722532131096 140000882147093 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7240 1320 832 493 0 545 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28960 KiB
Current children cumulated memory: 5280 KiB

[startup+0.209402 s]*
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30120600/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=29488 memory=5544 CPUtime=0.21 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 1679 0 0 0 21 0 0 0 20 0 1 0 434098889 30195712 1386 33554432000 4194304 6211092 140722532134560 140722532129464 5446226 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7372 1386 832 493 0 677 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29488 KiB
Current children cumulated memory: 5544 KiB

[startup+0.30885 s]*
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30120104/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=29112 memory=5628 CPUtime=0.31 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 1865 0 0 0 31 0 0 0 20 0 1 0 434098889 29810688 1407 33554432000 4194304 6211092 140722532134560 140722532129464 140000876277150 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7278 1407 832 493 0 583 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 29112 KiB
Current children cumulated memory: 5628 KiB

[startup+0.700229 s]
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30118740/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7344 CPUtime=0.69 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 3534 0 0 0 69 0 0 0 20 0 1 0 434098889 31854592 1836 33554432000 4194304 6211092 140722532134560 140722532129464 5013059 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1836 832 493 0 1082 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7344 KiB

[startup+1.50024 s]
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30117804/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7608 CPUtime=1.49 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 3599 0 0 0 149 0 0 0 20 0 1 0 434098889 31854592 1902 33554432000 4194304 6211092 140722532134560 140722532132520 5079432 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1902 854 493 0 1082 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7608 KiB

[startup+3.10903 s]
/proc/loadavg: 2.15 2.16 2.10 3/198 24038
/proc/meminfo: memFree=30117804/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=3.1 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 4199 0 0 0 310 0 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082762 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+6.30022 s]
/proc/loadavg: 2.14 2.15 2.10 3/198 24038
/proc/meminfo: memFree=30117520/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=6.28 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 4803 0 0 0 628 0 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082397 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+12.7002 s]
/proc/loadavg: 2.13 2.15 2.10 3/199 24041
/proc/meminfo: memFree=30117024/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=12.68 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 5405 0 0 0 1268 0 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082762 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+25.5002 s]
/proc/loadavg: 2.10 2.14 2.10 3/198 24041
/proc/meminfo: memFree=30117300/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=25.49 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 6600 0 0 0 2548 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5079440 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+51.1089 s]
/proc/loadavg: 2.06 2.13 2.10 3/198 24041
/proc/meminfo: memFree=30116344/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=51.09 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 7208 0 0 0 5108 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081184 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.11 2.09 3/199 24047
/proc/meminfo: memFree=30113416/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=102.27 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 7815 0 0 0 10226 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5079248 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.09 2.09 3/198 24051
/proc/meminfo: memFree=30106388/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=162.25 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 8422 0 0 0 16224 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5074429 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.07 2.08 3/198 24055
/proc/meminfo: memFree=30097616/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=222.23 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 9023 0 0 0 22222 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081706 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.06 2.08 3/199 24061
/proc/meminfo: memFree=30087716/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=282.22 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 9626 0 0 0 28221 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081355 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+342.3 s]
/proc/loadavg: 2.06 2.07 2.08 3/198 24065
/proc/meminfo: memFree=30078880/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=342.2 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 10222 0 0 0 34219 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081690 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+402.3 s]
/proc/loadavg: 2.08 2.07 2.08 3/198 24069
/proc/meminfo: memFree=30073784/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=402.19 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 10812 0 0 0 40218 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081371 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+462.3 s]
/proc/loadavg: 2.07 2.07 2.07 3/199 24075
/proc/meminfo: memFree=30061644/32770624 swapFree=66938744/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=462.17 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 11401 0 0 0 46216 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081337 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB


################
# More data... #
################

/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 1722.23 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24203
/proc/meminfo: memFree=30039808/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=1782.23 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 15255 0 0 0 178222 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5017679 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 1782.23 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24207
/proc/meminfo: memFree=30040016/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=1842.24 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 15529 0 0 0 184223 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081329 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24213
/proc/meminfo: memFree=30040236/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=1902.24 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 15529 0 0 0 190223 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082827 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24217
/proc/meminfo: memFree=30040224/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=1962.25 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 15738 0 0 0 196224 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5193696 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 24221
/proc/meminfo: memFree=30040664/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2022.25 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 15801 0 0 0 202224 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5079336 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2022.25 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24227
/proc/meminfo: memFree=30040316/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2082.26 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16011 0 0 0 208225 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5078752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2082.26 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 24231
/proc/meminfo: memFree=30040360/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2142.26 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16011 0 0 0 214225 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082427 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2142.26 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 24235
/proc/meminfo: memFree=30039760/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2202.27 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16284 0 0 0 220226 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5078728 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2202.27 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24241
/proc/meminfo: memFree=30040140/32770624 swapFree=66938760/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2262.27 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16284 0 0 0 226226 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081320 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2262.27 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 24252
/proc/meminfo: memFree=30039628/32770624 swapFree=66938764/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2322.27 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16488 0 0 0 232226 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082717 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2322.27 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 24256
/proc/meminfo: memFree=30039320/32770624 swapFree=66938764/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2382.28 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16488 0 0 0 238227 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5078752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2382.28 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2442.3 s]
/proc/loadavg: 2.16 2.06 2.06 3/199 25218
/proc/meminfo: memFree=30951996/32770624 swapFree=66938764/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2442.28 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16768 0 0 0 244227 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5082376 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2442.28 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

[startup+2502.3 s]
/proc/loadavg: 2.06 2.05 2.05 3/198 25222
/proc/meminfo: memFree=30952220/32770624 swapFree=66938764/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2502.29 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16768 0 0 0 250228 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081767 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2502.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.04 2.04 2.05 3/198 25222
/proc/meminfo: memFree=30952444/32770624 swapFree=66938764/67108860
[pid=24037] ppid=24034 vsize=31108 memory=7676 CPUtime=2520 cores=0,2,4,6
/proc/24037/stat : 24037 (cosoco) R 24034 24037 22828 0 -1 4202496 16970 0 0 0 251999 1 0 0 20 0 1 0 434098889 31854592 1919 33554432000 4194304 6211092 140722532134560 140722532132520 5081382 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9007104 140722532140043 140722532140145 140722532140145 140722532143054 0
/proc/24037/statm: 7777 1919 870 493 0 1082 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7676 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 24037 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.02 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.02
CPU user time (s): 2520
CPU system time (s): 0.02
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 31108
Max. memory (cumulated for all children) (KiB): 7676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.02
maximum resident set size= 7740
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17019
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 6016


# summary of solver processes directly reported to runsolver:
#   pid: 24037
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.02

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.40752 second user time and 17.0115 second system time

The end

Launcher Data

Begin job on node105 at 2019-09-15 21:11:50
IDJOB=4396877
IDBENCH=124268
IDSOLVER=2848
FILE ID=node105/4396877-1568578406
RUNJOBID= node105-1568569089-22859
PBS_JOBID= 21703335
Free space on /tmp= 61028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Langford/Langford-m1-k3/Langford-3-45.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396877-1568578406/watcher-4396877-1568578406 -o /tmp/evaluation-result-4396877-1568578406/solver-4396877-1568578406 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568569089-22859 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396877-1568578406.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c29e6924973099ab0a0c802e448a5f67
RANDOM SEED=2079047598

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30122904 kB
MemAvailable:   30786452 kB
Buffers:          207316 kB
Cached:           756368 kB
SwapCached:        66496 kB
Active:          1488788 kB
Inactive:         606240 kB
Active(anon):    1073508 kB
Inactive(anon):   100616 kB
Active(file):     415280 kB
Inactive(file):   505624 kB
Unevictable:      109060 kB
Mlocked:          109060 kB
SwapTotal:      67108860 kB
SwapFree:       66938744 kB
Dirty:              2612 kB
Writeback:             0 kB
AnonPages:       1191928 kB
Mapped:            43580 kB
Shmem:             34552 kB
Slab:             146024 kB
SReclaimable:     116960 kB
SUnreclaim:        29064 kB
KernelStack:        3744 kB
PageTables:         7836 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1665864 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    296960 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61024 MiB
End job on node105 at 2019-09-15 21:53:50