Trace number 4390065

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.03 2400.2

General information on the benchmark

NameLangford/Langford-m1-k3/
Langford-3-45.xml
MD5SUMc29e6924973099ab0a0c802e448a5f67
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark65.653
Satisfiable
(Un)Satisfiability was proved
Number of variables135
Number of constraints91
Number of domains1
Minimum domain size135
Maximum domain size135
Distribution of domain sizes[{"size":135,"count":135}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":90},{"degree":3,"count":45}]
Minimum constraint arity2
Maximum constraint arity135
Distribution of constraint arities[{"arity":2,"count":90},{"arity":135,"count":1}]
Number of extensional constraints0
Number of intensional constraints90
Distribution of constraint types[{"type":"intension","count":90},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390065-1568333182.xml 
0.00/0.01	c intension  eq(add(x[0][0],2),x[1][0]) -> extension (support ? 1) - 133tuples
0.00/0.02	c intension  eq(add(x[0][1],3),x[1][1]) -> extension (support ? 1) - 132tuples
0.00/0.03	c intension  eq(add(x[0][2],4),x[1][2]) -> extension (support ? 1) - 131tuples
0.00/0.03	c intension  eq(add(x[0][3],5),x[1][3]) -> extension (support ? 1) - 130tuples
0.00/0.04	c intension  eq(add(x[0][4],6),x[1][4]) -> extension (support ? 1) - 129tuples
0.00/0.05	c intension  eq(add(x[0][5],7),x[1][5]) -> extension (support ? 1) - 128tuples
0.00/0.06	c intension  eq(add(x[0][6],8),x[1][6]) -> extension (support ? 1) - 127tuples
0.00/0.06	c intension  eq(add(x[0][7],9),x[1][7]) -> extension (support ? 1) - 126tuples
0.00/0.07	c intension  eq(add(x[0][8],10),x[1][8]) -> extension (support ? 1) - 125tuples
0.00/0.08	c intension  eq(add(x[0][9],11),x[1][9]) -> extension (support ? 1) - 124tuples
0.00/0.09	c intension  eq(add(x[0][10],12),x[1][10]) -> extension (support ? 1) - 123tuples
0.00/0.10	c intension  eq(add(x[0][11],13),x[1][11]) -> extension (support ? 1) - 122tuples
0.10/0.11	c intension  eq(add(x[0][12],14),x[1][12]) -> extension (support ? 1) - 121tuples
0.10/0.12	c intension  eq(add(x[0][13],15),x[1][13]) -> extension (support ? 1) - 120tuples
0.10/0.12	c intension  eq(add(x[0][14],16),x[1][14]) -> extension (support ? 1) - 119tuples
0.10/0.13	c intension  eq(add(x[0][15],17),x[1][15]) -> extension (support ? 1) - 118tuples
0.10/0.14	c intension  eq(add(x[0][16],18),x[1][16]) -> extension (support ? 1) - 117tuples
0.10/0.15	c intension  eq(add(x[0][17],19),x[1][17]) -> extension (support ? 1) - 116tuples
0.10/0.15	c intension  eq(add(x[0][18],20),x[1][18]) -> extension (support ? 1) - 115tuples
0.10/0.16	c intension  eq(add(x[0][19],21),x[1][19]) -> extension (support ? 1) - 114tuples
0.10/0.17	c intension  eq(add(x[0][20],22),x[1][20]) -> extension (support ? 1) - 113tuples
0.10/0.18	c intension  eq(add(x[0][21],23),x[1][21]) -> extension (support ? 1) - 112tuples
0.10/0.18	c intension  eq(add(x[0][22],24),x[1][22]) -> extension (support ? 1) - 111tuples
0.10/0.19	c intension  eq(add(x[0][23],25),x[1][23]) -> extension (support ? 1) - 110tuples
0.10/0.20	c intension  eq(add(x[0][24],26),x[1][24]) -> extension (support ? 1) - 109tuples
0.10/0.21	c intension  eq(add(x[0][25],27),x[1][25]) -> extension (support ? 1) - 108tuples
0.20/0.21	c intension  eq(add(x[0][26],28),x[1][26]) -> extension (support ? 1) - 107tuples
0.20/0.22	c intension  eq(add(x[0][27],29),x[1][27]) -> extension (support ? 1) - 106tuples
0.20/0.23	c intension  eq(add(x[0][28],30),x[1][28]) -> extension (support ? 1) - 105tuples
0.20/0.24	c intension  eq(add(x[0][29],31),x[1][29]) -> extension (support ? 1) - 104tuples
0.20/0.25	c intension  eq(add(x[0][30],32),x[1][30]) -> extension (support ? 1) - 103tuples
0.20/0.25	c intension  eq(add(x[0][31],33),x[1][31]) -> extension (support ? 1) - 102tuples
0.20/0.26	c intension  eq(add(x[0][32],34),x[1][32]) -> extension (support ? 1) - 101tuples
0.20/0.27	c intension  eq(add(x[0][33],35),x[1][33]) -> extension (support ? 1) - 100tuples
0.20/0.28	c intension  eq(add(x[0][34],36),x[1][34]) -> extension (support ? 1) - 99tuples
0.20/0.28	c intension  eq(add(x[0][35],37),x[1][35]) -> extension (support ? 1) - 98tuples
0.20/0.29	c intension  eq(add(x[0][36],38),x[1][36]) -> extension (support ? 1) - 97tuples
0.20/0.30	c intension  eq(add(x[0][37],39),x[1][37]) -> extension (support ? 1) - 96tuples
0.20/0.31	c intension  eq(add(x[0][38],40),x[1][38]) -> extension (support ? 1) - 95tuples
0.30/0.32	c intension  eq(add(x[0][39],41),x[1][39]) -> extension (support ? 1) - 94tuples
0.30/0.32	c intension  eq(add(x[0][40],42),x[1][40]) -> extension (support ? 1) - 93tuples
0.30/0.33	c intension  eq(add(x[0][41],43),x[1][41]) -> extension (support ? 1) - 92tuples
0.30/0.34	c intension  eq(add(x[0][42],44),x[1][42]) -> extension (support ? 1) - 91tuples
0.30/0.35	c intension  eq(add(x[0][43],45),x[1][43]) -> extension (support ? 1) - 90tuples
0.30/0.35	c intension  eq(add(x[0][44],46),x[1][44]) -> extension (support ? 1) - 89tuples
0.30/0.36	c intension  eq(add(x[1][0],2),x[2][0]) -> extension (support ? 1) - 133tuples
0.30/0.37	c intension  eq(add(x[1][1],3),x[2][1]) -> extension (support ? 1) - 132tuples
0.30/0.38	c intension  eq(add(x[1][2],4),x[2][2]) -> extension (support ? 1) - 131tuples
0.30/0.39	c intension  eq(add(x[1][3],5),x[2][3]) -> extension (support ? 1) - 130tuples
0.30/0.39	c intension  eq(add(x[1][4],6),x[2][4]) -> extension (support ? 1) - 129tuples
0.30/0.40	c intension  eq(add(x[1][5],7),x[2][5]) -> extension (support ? 1) - 128tuples
0.30/0.41	c intension  eq(add(x[1][6],8),x[2][6]) -> extension (support ? 1) - 127tuples
0.40/0.42	c intension  eq(add(x[1][7],9),x[2][7]) -> extension (support ? 1) - 126tuples
0.40/0.43	c intension  eq(add(x[1][8],10),x[2][8]) -> extension (support ? 1) - 125tuples
0.40/0.43	c intension  eq(add(x[1][9],11),x[2][9]) -> extension (support ? 1) - 124tuples
0.40/0.44	c intension  eq(add(x[1][10],12),x[2][10]) -> extension (support ? 1) - 123tuples
0.40/0.45	c intension  eq(add(x[1][11],13),x[2][11]) -> extension (support ? 1) - 122tuples
0.40/0.46	c intension  eq(add(x[1][12],14),x[2][12]) -> extension (support ? 1) - 121tuples
0.40/0.46	c intension  eq(add(x[1][13],15),x[2][13]) -> extension (support ? 1) - 120tuples
0.40/0.47	c intension  eq(add(x[1][14],16),x[2][14]) -> extension (support ? 1) - 119tuples
0.40/0.48	c intension  eq(add(x[1][15],17),x[2][15]) -> extension (support ? 1) - 118tuples
0.40/0.49	c intension  eq(add(x[1][16],18),x[2][16]) -> extension (support ? 1) - 117tuples
0.40/0.49	c intension  eq(add(x[1][17],19),x[2][17]) -> extension (support ? 1) - 116tuples
0.40/0.50	c intension  eq(add(x[1][18],20),x[2][18]) -> extension (support ? 1) - 115tuples
0.40/0.51	c intension  eq(add(x[1][19],21),x[2][19]) -> extension (support ? 1) - 114tuples
0.50/0.52	c intension  eq(add(x[1][20],22),x[2][20]) -> extension (support ? 1) - 113tuples
0.50/0.53	c intension  eq(add(x[1][21],23),x[2][21]) -> extension (support ? 1) - 112tuples
0.50/0.53	c intension  eq(add(x[1][22],24),x[2][22]) -> extension (support ? 1) - 111tuples
0.50/0.54	c intension  eq(add(x[1][23],25),x[2][23]) -> extension (support ? 1) - 110tuples
0.50/0.55	c intension  eq(add(x[1][24],26),x[2][24]) -> extension (support ? 1) - 109tuples
0.50/0.56	c intension  eq(add(x[1][25],27),x[2][25]) -> extension (support ? 1) - 108tuples
0.50/0.56	c intension  eq(add(x[1][26],28),x[2][26]) -> extension (support ? 1) - 107tuples
0.50/0.57	c intension  eq(add(x[1][27],29),x[2][27]) -> extension (support ? 1) - 106tuples
0.50/0.58	c intension  eq(add(x[1][28],30),x[2][28]) -> extension (support ? 1) - 105tuples
0.50/0.59	c intension  eq(add(x[1][29],31),x[2][29]) -> extension (support ? 1) - 104tuples
0.50/0.59	c intension  eq(add(x[1][30],32),x[2][30]) -> extension (support ? 1) - 103tuples
0.50/0.60	c intension  eq(add(x[1][31],33),x[2][31]) -> extension (support ? 1) - 102tuples
0.60/0.61	c intension  eq(add(x[1][32],34),x[2][32]) -> extension (support ? 1) - 101tuples
0.60/0.62	c intension  eq(add(x[1][33],35),x[2][33]) -> extension (support ? 1) - 100tuples
0.60/0.63	c intension  eq(add(x[1][34],36),x[2][34]) -> extension (support ? 1) - 99tuples
0.60/0.63	c intension  eq(add(x[1][35],37),x[2][35]) -> extension (support ? 1) - 98tuples
0.60/0.64	c intension  eq(add(x[1][36],38),x[2][36]) -> extension (support ? 1) - 97tuples
0.60/0.65	c intension  eq(add(x[1][37],39),x[2][37]) -> extension (support ? 1) - 96tuples
0.60/0.66	c intension  eq(add(x[1][38],40),x[2][38]) -> extension (support ? 1) - 95tuples
0.60/0.66	c intension  eq(add(x[1][39],41),x[2][39]) -> extension (support ? 1) - 94tuples
0.60/0.67	c intension  eq(add(x[1][40],42),x[2][40]) -> extension (support ? 1) - 93tuples
0.60/0.68	c intension  eq(add(x[1][41],43),x[2][41]) -> extension (support ? 1) - 92tuples
0.60/0.69	c intension  eq(add(x[1][42],44),x[2][42]) -> extension (support ? 1) - 91tuples
0.60/0.69	c intension  eq(add(x[1][43],45),x[2][43]) -> extension (support ? 1) - 90tuples
0.69/0.70	c intension  eq(add(x[1][44],46),x[2][44]) -> extension (support ? 1) - 89tuples
0.69/0.71	c root propagations     : 6480        
0.69/0.71	c restarts enabled, print stats at every restarts
0.69/0.71	c
0.69/0.71	c
0.69/0.71	c ========================================[ Problem Statistics ]===========================================
0.69/0.71	c |                                                                                                       
0.69/0.71	c |  Parse time        :         0.69 s 
0.69/0.71	c |
0.69/0.71	c |               Variables: 135
0.69/0.71	c |            Domain Sizes: 135..135
0.69/0.71	c |
0.69/0.71	c |             Constraints: 91
0.69/0.71	c |                   Arity: 2..135  -- Binary: 90
0.69/0.71	c | 
0.69/0.71	c |                   Types: 
0.69/0.71	c |                          All Different: 1
0.69/0.71	c |                          Extension: 90  (nb tuples: 89..133) -- (shared: 0)
0.69/0.71	c |                          
0.69/0.71	c =========================================================================================================
0.69/0.71	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.79/0.88	c 101            470            15910          125633         135            0              61   79   68   
1.00/1.06	c 211            1000           31311          253353         135            0              37   85   77   
1.19/1.26	c 332            1457           48500          379198         135            0              40   88   76   
1.49/1.51	c 465            2007           70475          543758         135            0              43   91   77   
1.69/1.73	c 611            2627           89695          671925         135            0              70   88   78   
2.00/2.04	c 771            3399           117173         877449         135            0              73   94   79   
2.29/2.37	c 947            4208           145717         1082229        135            0              70   91   79   
2.59/2.69	c 1140           5034           172744         1292338        135            0              70   91   78   
3.00/3.01	c 1352           5936           201548         1481566        135            0              73   94   80   
3.49/3.50	c 1585           6967           243496         1771362        135            0              67   91   79   
4.10/4.13	c 1841           8117           298633         2134704        135            0              70   94   80   
4.68/4.74	c 2122           9385           351481         2542213        135            0              67   94   79   
5.28/5.37	c 2431           10819          406052         2957746        135            0              64   91   78   
5.99/6.01	c 2770           12235          461006         3383378        135            0              70   91   77   
6.68/6.73	c 3142           14044          523352         3867073        135            0              46   88   76   
7.48/7.56	c 3551           15950          594028         4397329        135            0              67   88   77   
8.28/8.37	c 4000           17932          664844         4950673        135            0              58   97   81   
9.38/9.43	c 4493           20240          755899         5587444        135            0              55   97   81   
10.58/10.60	c 5035           22597          856493         6338536        135            0              58   91   78   
11.78/11.82	c 5631           25245          960695         7142016        135            0              64   88   77   
12.88/13.00	c 6286           28357          1063015        7862774        135            0              67   91   78   
14.38/14.47	c 7006           31396          1190204        8803513        135            0              70   91   78   
16.18/16.21	c 7798           34576          1338797        9788703        135            0              70   91   78   
18.09/18.15	c 8669           38381          1504758        10930782       135            0              67   91   79   
20.28/20.32	c 9627           42318          1691422        12234217       135            0              64   94   78   
22.48/22.59	c 10680          46698          1886999        13617341       135            0              67   91   78   
25.58/25.62	c 11838          52446          2145277        15321408       135            0              58   100   78  
28.18/28.28	c 13111          58417          2372880        17006902       135            0              58   94   78   
31.48/31.54	c 14511          64728          2653757        18889755       135            0              58   94   81   
34.48/34.56	c 16051          71668          2914651        20911293       135            0              61   94   78   
38.48/38.52	c 17745          79137          3253649        23369498       135            0              67   91   79   
42.77/42.87	c 19608          87492          3627675        25958629       135            0              70   97   80   
47.47/47.53	c 21657          97464          4029057        28938454       135            0              67   100   80  
51.87/51.95	c 23910          107385         4415413        31679443       135            0              67   97   82   
58.37/58.49	c 26388          118542         4966467        35524588       135            0              64   94   77   
64.27/64.36	c 29113          131134         5466934        39309001       135            0              64   91   77   
70.98/71.09	c 32110          144859         6044240        43369782       135            0              67   97   80   
78.17/78.21	c 35406          159594         6652888        48074223       135            0              64   94   78   
85.57/85.68	c 39031          176467         7301793        52310441       135            0              58   97   80   
94.47/94.53	c 43018          194245         8055629        57815562       135            0              61   97   79   
103.86/103.96	c 47403          212979         8864726        64054480       135            0              64   97   79   
112.76/112.89	c 52226          234386         9639710        70033938       135            0              64   100   79  
124.26/124.38	c 57531          258582         10631065       76880607       135            0              64   97   79   
135.46/135.51	c 63366          285252         11600855       84088297       135            0              61   97   80   
148.07/148.11	c 69784          312922         12671883       91746396       135            0              64   100   78  
163.75/163.83	c 76843          345025         14029965       100931065      135            0              64   100   80  
180.45/180.54	c 84607          379882         15464278       110545766      135            0              64   100   79  
199.06/199.16	c 93147          417891         17076647       121720567      135            0              64   97   79   
218.95/219.05	c 102541         462520         18785786       133393778      135            0              58   97   79   
239.74/239.84	c 112874         507029         20578665       146298599      135            0              64   94   77   
261.74/261.81	c 124240         554371         22489742       159976565      135            0              67   100   81  
288.83/288.98	c 136742         609740         24820372       175818076      135            0              64   100   80  
316.43/316.59	c 150494         673685         27216294       192045821      135            0              67   103   82  
349.22/349.34	c 165621         748371         30020960       211931713      135            0              64   106   80  
384.81/384.91	c 182260         825124         33064667       234472601      135            0              64   100   78  
427.61/427.70	c 200562         910917         36766729       260195241      135            0              64   103   81  
470.50/470.62	c 220694         1007531        40452207       288734006      135            0              64   103   81  
518.90/519.10	c 242839         1112395        44642056       317849387      135            0              64   103   82  
573.40/573.53	c 267198         1230783        49373547       350642410      135            0              64   103   82  
638.30/638.47	c 293992         1349950        55049898       387366514      135            0              67   103   83  
704.79/704.97	c 323465         1488203        60825934       427108033      135            0              64   106   81  
773.19/773.38	c 355885         1638085        66796771       472885112      135            0              64   103   82  
856.59/856.77	c 391547         1808510        74157329       522802197      135            0              64   103   83  
933.89/934.02	c 430775         1989236        80896637       572765883      135            0              64   103   79  
1029.18/1029.30	c 473925         2192121        89125230       631003260      135            0              61   100   78  
1128.47/1128.62	c 521390         2407976        97785391       690313467      135            0              64   109   81  
1252.17/1252.31	c 573601         2638855        108554242      760794343      135            0              67   103   82  
1374.07/1374.29	c 631033         2909584        119131128      834773200      135            0              64   106   81  
1501.06/1501.26	c 694208         3193163        130219534      911206032      135            0              64   103   82  
1642.96/1643.18	c 763700         3526004        142499320      999709455      135            0              64   103   80  
1807.05/1807.29	c 840141         3896643        156606069      1102014512     135            0              55   103   79  
1989.85/1990.05	c 924226         4295068        172335145      1211428293     135            0              61   103   80  
2190.13/2190.30	c 1016719        4725361        189776407      1335052977     135            0              64   106   82  
2400.02/2400.20	
2400.02/2400.20	c *** INTERRUPTED ***
2400.02/2400.20	c restarts              : 73          
2400.02/2400.20	c conflicts             : 1111426      (463 /sec)
2400.02/2400.20	c decisions             : 5163524      (2151 /sec)
2400.02/2400.20	c propagations          : 1459452455  (608104 /sec)
2400.02/2400.20	c root propagations     : 6480        
2400.02/2400.20	c filter calls          : 208127529      (86720 /sec)
2400.02/2400.20	c useless filter calls  : 30654967       (14 %)
2400.02/2400.20	c Memory used           : 30.38 MB
2400.02/2400.20	c CPU time              : 2400 s
2400.02/2400.20	c real time             : 2400.2 s
2400.02/2400.20	
2400.02/2400.20	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8467 MiB free)
  memory of node 1: 16384 MiB (15752 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390065-1568333182/watcher-4390065-1568333182 -o /tmp/evaluation-result-4390065-1568333182/solver-4390065-1568333182 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568323911-7048 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390065-1568333182.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=9621, runsolver pid=9618
Current StackSize limit: 8192 KiB


[startup+0.100829 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24799956/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=28960 memory=5268 CPUtime=0.1 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 1554 0 0 0 10 0 0 0 20 0 1 0 409590816 29655040 1317 33554432000 4194304 6210612 140736853838048 140736853832952 5442940 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7240 1317 829 493 0 545 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28960 KiB
Current children cumulated memory: 5268 KiB

[startup+0.209516 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24799212/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=29488 memory=5532 CPUtime=0.2 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 1675 0 0 0 20 0 0 0 20 0 1 0 409590816 30195712 1383 33554432000 4194304 6210612 140736853838048 140736853832952 5478261 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7372 1383 829 493 0 677 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 29488 KiB
Current children cumulated memory: 5532 KiB

[startup+0.308946 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24799212/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=29280 memory=5612 CPUtime=0.3 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 1761 0 0 0 30 0 0 0 20 0 1 0 409590816 29982720 1403 33554432000 4194304 6210612 140736853838048 140736853832952 5012488 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7320 1403 829 493 0 625 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 29280 KiB
Current children cumulated memory: 5612 KiB

[startup+0.700229 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24798592/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7328 CPUtime=0.69 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 3530 0 0 0 68 1 0 0 20 0 1 0 409590816 31854592 1832 33554432000 4194304 6210612 140736853838048 140736853832952 5453762 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1832 829 493 0 1082 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7328 KiB

[startup+1.50022 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24797696/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7592 CPUtime=1.49 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 3594 0 0 0 148 1 0 0 20 0 1 0 409590816 31854592 1898 33554432000 4194304 6210612 140736853838048 140736853832952 5082067 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1898 851 493 0 1082 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7592 KiB

[startup+3.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24796656/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=3.1 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 4192 0 0 0 309 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5082435 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9622
/proc/meminfo: memFree=24796432/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=6.28 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 4447 0 0 0 627 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5017249 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9623
/proc/meminfo: memFree=24796756/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=12.68 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 4700 0 0 0 1267 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078380 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9625
/proc/meminfo: memFree=24796856/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=25.48 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 5121 0 0 0 2547 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5081403 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9625
/proc/meminfo: memFree=24796788/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=51.08 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 5459 0 0 0 5107 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078384 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 9630
/proc/meminfo: memFree=24796600/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=102.26 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 5714 0 0 0 10225 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5075213 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 9636
/proc/meminfo: memFree=24796004/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=162.25 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 5970 0 0 0 16224 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5192912 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 9640
/proc/meminfo: memFree=24795732/32770624 swapFree=67018284/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=222.24 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 6224 0 0 0 22223 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5079072 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 9652
/proc/meminfo: memFree=24795940/32770624 swapFree=67018300/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=282.23 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 6478 0 0 0 28222 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5074734 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 9658
/proc/meminfo: memFree=24794348/32770624 swapFree=67018300/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=342.22 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 6729 0 0 0 34221 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5074032 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+402.3 s]
/proc/loadavg: 2.29 2.08 2.07 3/200 9662
/proc/meminfo: memFree=24794472/32770624 swapFree=67018300/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=402.21 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 6980 0 0 0 40220 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5080992 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 402.21 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+462.3 s]
/proc/loadavg: 2.29 2.14 2.09 3/200 9666
/proc/meminfo: memFree=24794724/32770624 swapFree=67018300/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=462.2 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 7230 0 0 0 46219 1 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5075465 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB


################
# More data... #
################

/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1602.16 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9777
/proc/meminfo: memFree=24794416/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1662.15 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 11705 0 0 0 166213 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5075195 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1662.15 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9781
/proc/meminfo: memFree=24794168/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1722.15 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 11884 0 0 0 172213 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5080912 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9787
/proc/meminfo: memFree=24793492/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1782.15 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 12063 0 0 0 178213 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5082432 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1782.15 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9791
/proc/meminfo: memFree=24793040/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1842.15 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 12313 0 0 0 184213 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5075168 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1842.15 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9795
/proc/meminfo: memFree=24793300/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1902.14 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 12485 0 0 0 190212 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1902.14 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 9801
/proc/meminfo: memFree=24793216/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=1962.14 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 12657 0 0 0 196212 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078397 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1962.14 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2022.3 s]
/proc/loadavg: 2.09 2.04 2.05 3/199 9869
/proc/meminfo: memFree=24640240/32770624 swapFree=67018332/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2022.14 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 12907 0 0 0 202212 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5074866 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2022.14 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2082.3 s]
/proc/loadavg: 2.07 2.05 2.05 3/199 9880
/proc/meminfo: memFree=24640320/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2082.14 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 13080 0 0 0 208212 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5079072 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2082.14 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/199 9886
/proc/meminfo: memFree=24640652/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2142.13 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 13242 0 0 0 214211 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5079072 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2142.13 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/199 9951
/proc/meminfo: memFree=24729060/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2202.13 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 13499 0 0 0 220211 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5080969 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2202.13 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 9956
/proc/meminfo: memFree=24729608/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2262.13 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 13670 0 0 0 226211 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078394 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2262.13 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2322.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/200 10087
/proc/meminfo: memFree=24603216/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2322.12 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 13845 0 0 0 232210 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5082459 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2322.12 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 10091
/proc/meminfo: memFree=24603576/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2382.12 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 14020 0 0 0 238210 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2382.12 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 10093
/proc/meminfo: memFree=24601608/32770624 swapFree=67018348/67108860
[pid=9621] ppid=9618 vsize=31108 memory=7656 CPUtime=2400.02 cores=0,2,4,6
/proc/9621/stat : 9621 (cosoco) R 9618 9621 7017 0 -1 4202496 14187 0 0 0 240000 2 0 0 20 0 1 0 409590816 31854592 1914 33554432000 4194304 6210612 140736853838048 140736853836008 5078940 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 15740928 140736853840907 140736853841009 140736853841009 140736853843918 0
/proc/9621/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 9621 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.01 s, system=0.025998 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.2
CPU time (s): 2400.03
CPU user time (s): 2400.01
CPU system time (s): 0.025998
CPU usage (%): 99.9929
Max. virtual memory (cumulated for all children) (KiB): 31108
Max. memory (cumulated for all children) (KiB): 7656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.01
system time used= 0.025998
maximum resident set size= 7724
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14237
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1236


# summary of solver processes directly reported to runsolver:
#   pid: 9621
#   total CPU time (s): 2400.03
#   total CPU user time (s): 2400.01
#   total CPU system time (s): 0.025998

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.43418 second user time and 14.5965 second system time

The end

Launcher Data

Begin job on node150 at 2019-09-13 02:05:42
IDJOB=4390065
IDBENCH=124268
IDSOLVER=2830
FILE ID=node150/4390065-1568333182
RUNJOBID= node150-1568323911-7048
PBS_JOBID= 21701149
Free space on /tmp= 55028 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Langford/Langford-m1-k3/Langford-3-45.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390065-1568333182/watcher-4390065-1568333182 -o /tmp/evaluation-result-4390065-1568333182/solver-4390065-1568333182 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568323911-7048 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390065-1568333182.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c29e6924973099ab0a0c802e448a5f67
RANDOM SEED=651950945

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24801228 kB
MemAvailable:   31835616 kB
Buffers:          160056 kB
Cached:          7022640 kB
SwapCached:        10680 kB
Active:          1155704 kB
Inactive:        6076364 kB
Active(anon):      16344 kB
Inactive(anon):    55016 kB
Active(file):    1139360 kB
Inactive(file):  6021348 kB
Unevictable:      109524 kB
Mlocked:          109524 kB
SwapTotal:      67108860 kB
SwapFree:       67018284 kB
Dirty:              2504 kB
Writeback:             0 kB
AnonPages:        148384 kB
Mapped:            37224 kB
Shmem:             13632 kB
Slab:             332264 kB
SReclaimable:     302140 kB
SUnreclaim:        30124 kB
KernelStack:        3568 kB
PageTables:         5660 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     532232 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       99712 kB
DirectMap2M:    33445888 kB

Free space on /tmp at the end= 54992 MiB
End job on node150 at 2019-09-13 02:45:43