Trace number 4389597

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.03 2520

General information on the benchmark

NameLangford/Langford-m1-k3/
Langford-3-45.xml
MD5SUMc29e6924973099ab0a0c802e448a5f67
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark185.253
Satisfiable
(Un)Satisfiability was proved
Number of variables135
Number of constraints91
Number of domains1
Minimum domain size135
Maximum domain size135
Distribution of domain sizes[{"size":135,"count":135}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":90},{"degree":3,"count":45}]
Minimum constraint arity2
Maximum constraint arity135
Distribution of constraint arities[{"arity":2,"count":90},{"arity":135,"count":1}]
Number of extensional constraints0
Number of intensional constraints90
Distribution of constraint types[{"type":"intension","count":90},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c
0.00/0.01	c This is cosoco 2.00 --  
0.00/0.01	c
0.00/0.01	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389597-1568327306.xml 
0.00/0.01	c intension  eq(add(x[0][0],2),x[1][0]) -> extension (support ? 1) - 133tuples
0.00/0.02	c intension  eq(add(x[0][1],3),x[1][1]) -> extension (support ? 1) - 132tuples
0.00/0.03	c intension  eq(add(x[0][2],4),x[1][2]) -> extension (support ? 1) - 131tuples
0.00/0.04	c intension  eq(add(x[0][3],5),x[1][3]) -> extension (support ? 1) - 130tuples
0.00/0.05	c intension  eq(add(x[0][4],6),x[1][4]) -> extension (support ? 1) - 129tuples
0.00/0.06	c intension  eq(add(x[0][5],7),x[1][5]) -> extension (support ? 1) - 128tuples
0.00/0.07	c intension  eq(add(x[0][6],8),x[1][6]) -> extension (support ? 1) - 127tuples
0.00/0.08	c intension  eq(add(x[0][7],9),x[1][7]) -> extension (support ? 1) - 126tuples
0.00/0.08	c intension  eq(add(x[0][8],10),x[1][8]) -> extension (support ? 1) - 125tuples
0.00/0.09	c intension  eq(add(x[0][9],11),x[1][9]) -> extension (support ? 1) - 124tuples
0.00/0.10	c intension  eq(add(x[0][10],12),x[1][10]) -> extension (support ? 1) - 123tuples
0.10/0.11	c intension  eq(add(x[0][11],13),x[1][11]) -> extension (support ? 1) - 122tuples
0.10/0.12	c intension  eq(add(x[0][12],14),x[1][12]) -> extension (support ? 1) - 121tuples
0.10/0.13	c intension  eq(add(x[0][13],15),x[1][13]) -> extension (support ? 1) - 120tuples
0.10/0.14	c intension  eq(add(x[0][14],16),x[1][14]) -> extension (support ? 1) - 119tuples
0.10/0.15	c intension  eq(add(x[0][15],17),x[1][15]) -> extension (support ? 1) - 118tuples
0.10/0.15	c intension  eq(add(x[0][16],18),x[1][16]) -> extension (support ? 1) - 117tuples
0.10/0.16	c intension  eq(add(x[0][17],19),x[1][17]) -> extension (support ? 1) - 116tuples
0.10/0.17	c intension  eq(add(x[0][18],20),x[1][18]) -> extension (support ? 1) - 115tuples
0.10/0.18	c intension  eq(add(x[0][19],21),x[1][19]) -> extension (support ? 1) - 114tuples
0.10/0.19	c intension  eq(add(x[0][20],22),x[1][20]) -> extension (support ? 1) - 113tuples
0.10/0.20	c intension  eq(add(x[0][21],23),x[1][21]) -> extension (support ? 1) - 112tuples
0.10/0.21	c intension  eq(add(x[0][22],24),x[1][22]) -> extension (support ? 1) - 111tuples
0.10/0.22	c intension  eq(add(x[0][23],25),x[1][23]) -> extension (support ? 1) - 110tuples
0.21/0.22	c intension  eq(add(x[0][24],26),x[1][24]) -> extension (support ? 1) - 109tuples
0.21/0.23	c intension  eq(add(x[0][25],27),x[1][25]) -> extension (support ? 1) - 108tuples
0.21/0.24	c intension  eq(add(x[0][26],28),x[1][26]) -> extension (support ? 1) - 107tuples
0.21/0.25	c intension  eq(add(x[0][27],29),x[1][27]) -> extension (support ? 1) - 106tuples
0.21/0.26	c intension  eq(add(x[0][28],30),x[1][28]) -> extension (support ? 1) - 105tuples
0.21/0.27	c intension  eq(add(x[0][29],31),x[1][29]) -> extension (support ? 1) - 104tuples
0.21/0.28	c intension  eq(add(x[0][30],32),x[1][30]) -> extension (support ? 1) - 103tuples
0.21/0.29	c intension  eq(add(x[0][31],33),x[1][31]) -> extension (support ? 1) - 102tuples
0.21/0.29	c intension  eq(add(x[0][32],34),x[1][32]) -> extension (support ? 1) - 101tuples
0.21/0.30	c intension  eq(add(x[0][33],35),x[1][33]) -> extension (support ? 1) - 100tuples
0.21/0.31	c intension  eq(add(x[0][34],36),x[1][34]) -> extension (support ? 1) - 99tuples
0.31/0.32	c intension  eq(add(x[0][35],37),x[1][35]) -> extension (support ? 1) - 98tuples
0.31/0.33	c intension  eq(add(x[0][36],38),x[1][36]) -> extension (support ? 1) - 97tuples
0.31/0.34	c intension  eq(add(x[0][37],39),x[1][37]) -> extension (support ? 1) - 96tuples
0.31/0.35	c intension  eq(add(x[0][38],40),x[1][38]) -> extension (support ? 1) - 95tuples
0.31/0.36	c intension  eq(add(x[0][39],41),x[1][39]) -> extension (support ? 1) - 94tuples
0.31/0.37	c intension  eq(add(x[0][40],42),x[1][40]) -> extension (support ? 1) - 93tuples
0.31/0.37	c intension  eq(add(x[0][41],43),x[1][41]) -> extension (support ? 1) - 92tuples
0.31/0.38	c intension  eq(add(x[0][42],44),x[1][42]) -> extension (support ? 1) - 91tuples
0.31/0.39	c intension  eq(add(x[0][43],45),x[1][43]) -> extension (support ? 1) - 90tuples
0.31/0.40	c intension  eq(add(x[0][44],46),x[1][44]) -> extension (support ? 1) - 89tuples
0.31/0.41	c intension  eq(add(x[1][0],2),x[2][0]) -> extension (support ? 1) - 133tuples
0.41/0.42	c intension  eq(add(x[1][1],3),x[2][1]) -> extension (support ? 1) - 132tuples
0.41/0.43	c intension  eq(add(x[1][2],4),x[2][2]) -> extension (support ? 1) - 131tuples
0.41/0.44	c intension  eq(add(x[1][3],5),x[2][3]) -> extension (support ? 1) - 130tuples
0.41/0.45	c intension  eq(add(x[1][4],6),x[2][4]) -> extension (support ? 1) - 129tuples
0.41/0.46	c intension  eq(add(x[1][5],7),x[2][5]) -> extension (support ? 1) - 128tuples
0.41/0.46	c intension  eq(add(x[1][6],8),x[2][6]) -> extension (support ? 1) - 127tuples
0.41/0.47	c intension  eq(add(x[1][7],9),x[2][7]) -> extension (support ? 1) - 126tuples
0.69/5.84	c intension  eq(add(x[1][8],10),x[2][8]) -> extension (support ? 1) - 125tuples
0.69/5.84	c intension  eq(add(x[1][9],11),x[2][9]) -> extension (support ? 1) - 124tuples
0.69/5.84	c intension  eq(add(x[1][10],12),x[2][10]) -> extension (support ? 1) - 123tuples
0.69/5.84	c intension  eq(add(x[1][11],13),x[2][11]) -> extension (support ? 1) - 122tuples
0.69/5.84	c intension  eq(add(x[1][12],14),x[2][12]) -> extension (support ? 1) - 121tuples
0.69/5.84	c intension  eq(add(x[1][13],15),x[2][13]) -> extension (support ? 1) - 120tuples
0.69/5.84	c intension  eq(add(x[1][14],16),x[2][14]) -> extension (support ? 1) - 119tuples
0.69/5.84	c intension  eq(add(x[1][15],17),x[2][15]) -> extension (support ? 1) - 118tuples
0.69/5.84	c intension  eq(add(x[1][16],18),x[2][16]) -> extension (support ? 1) - 117tuples
0.69/5.84	c intension  eq(add(x[1][17],19),x[2][17]) -> extension (support ? 1) - 116tuples
0.69/5.84	c intension  eq(add(x[1][18],20),x[2][18]) -> extension (support ? 1) - 115tuples
0.69/5.84	c intension  eq(add(x[1][19],21),x[2][19]) -> extension (support ? 1) - 114tuples
0.69/5.84	c intension  eq(add(x[1][20],22),x[2][20]) -> extension (support ? 1) - 113tuples
0.69/5.84	c intension  eq(add(x[1][21],23),x[2][21]) -> extension (support ? 1) - 112tuples
0.69/5.84	c intension  eq(add(x[1][22],24),x[2][22]) -> extension (support ? 1) - 111tuples
0.69/5.84	c intension  eq(add(x[1][23],25),x[2][23]) -> extension (support ? 1) - 110tuples
0.69/5.84	c intension  eq(add(x[1][24],26),x[2][24]) -> extension (support ? 1) - 109tuples
0.69/5.84	c intension  eq(add(x[1][25],27),x[2][25]) -> extension (support ? 1) - 108tuples
0.69/5.84	c intension  eq(add(x[1][26],28),x[2][26]) -> extension (support ? 1) - 107tuples
0.69/5.84	c intension  eq(add(x[1][27],29),x[2][27]) -> extension (support ? 1) - 106tuples
0.69/5.84	c intension  eq(add(x[1][28],30),x[2][28]) -> extension (support ? 1) - 105tuples
0.69/5.84	c intension  eq(add(x[1][29],31),x[2][29]) -> extension (support ? 1) - 104tuples
0.69/5.84	c intension  eq(add(x[1][30],32),x[2][30]) -> extension (support ? 1) - 103tuples
0.69/5.84	c intension  eq(add(x[1][31],33),x[2][31]) -> extension (support ? 1) - 102tuples
0.69/5.84	c intension  eq(add(x[1][32],34),x[2][32]) -> extension (support ? 1) - 101tuples
0.69/5.84	c intension  eq(add(x[1][33],35),x[2][33]) -> extension (support ? 1) - 100tuples
0.69/5.84	c intension  eq(add(x[1][34],36),x[2][34]) -> extension (support ? 1) - 99tuples
0.69/5.84	c intension  eq(add(x[1][35],37),x[2][35]) -> extension (support ? 1) - 98tuples
0.69/5.84	c intension  eq(add(x[1][36],38),x[2][36]) -> extension (support ? 1) - 97tuples
0.69/5.84	c intension  eq(add(x[1][37],39),x[2][37]) -> extension (support ? 1) - 96tuples
0.69/5.84	c intension  eq(add(x[1][38],40),x[2][38]) -> extension (support ? 1) - 95tuples
0.69/5.84	c intension  eq(add(x[1][39],41),x[2][39]) -> extension (support ? 1) - 94tuples
0.69/5.84	c intension  eq(add(x[1][40],42),x[2][40]) -> extension (support ? 1) - 93tuples
0.69/5.84	c intension  eq(add(x[1][41],43),x[2][41]) -> extension (support ? 1) - 92tuples
0.69/5.84	c intension  eq(add(x[1][42],44),x[2][42]) -> extension (support ? 1) - 91tuples
0.69/5.84	c intension  eq(add(x[1][43],45),x[2][43]) -> extension (support ? 1) - 90tuples
0.69/5.84	c intension  eq(add(x[1][44],46),x[2][44]) -> extension (support ? 1) - 89tuples
0.69/5.84	c root propagations     : 6480        
0.69/5.84	c restarts enabled, print stats at every restarts
0.69/5.84	c
0.69/5.84	c
0.69/5.84	c ========================================[ Problem Statistics ]===========================================
0.69/5.84	c |                                                                                                       
0.69/5.84	c |  Parse time        :         0.79 s 
0.69/5.84	c |
0.69/5.84	c |               Variables: 135
0.69/5.84	c |            Domain Sizes: 135..135
0.69/5.84	c |
0.69/5.84	c |             Constraints: 91
0.69/5.84	c |                   Arity: 2..135  -- Binary: 90
0.69/5.84	c | 
0.69/5.84	c |                   Types: 
0.69/5.84	c |                          All Different: 1
0.69/5.84	c |                          Extension: 90  (nb tuples: 89..133) -- (shared: 0)
0.69/5.84	c |                          
0.69/5.84	c =========================================================================================================
0.69/5.84	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.69/5.84	c 101            470            15910          125633         135            0              61   79   68   
0.69/5.84	c 211            1000           31311          253353         135            0              37   85   77   
0.69/5.84	c 332            1457           48500          379198         135            0              40   88   76   
0.69/5.84	c 465            2007           70475          543758         135            0              43   91   77   
0.69/5.84	c 611            2627           89695          671925         135            0              70   88   78   
0.69/5.84	c 771            3399           117173         877449         135            0              73   94   79   
0.69/5.84	c 947            4208           145717         1082229        135            0              70   91   79   
0.69/5.84	c 1140           5034           172744         1292338        135            0              70   91   78   
0.69/5.84	c 1352           5936           201548         1481566        135            0              73   94   80   
0.69/5.84	c 1585           6967           243496         1771362        135            0              67   91   79   
0.69/5.84	c 1841           8117           298633         2134704        135            0              70   94   80   
0.69/5.84	c 2122           9385           351481         2542213        135            0              67   94   79   
6.10/6.14	c 2431           10819          406052         2957746        135            0              64   91   78   
6.79/6.87	c 2770           12235          461006         3383378        135            0              70   91   77   
7.69/7.70	c 3142           14044          523352         3867073        135            0              46   88   76   
8.59/8.64	c 3551           15950          594028         4397329        135            0              67   88   77   
9.49/9.58	c 4000           17932          664844         4950673        135            0              58   97   81   
10.69/10.78	c 4493           20240          755899         5587444        135            0              55   97   81   
12.10/12.12	c 5035           22597          856493         6338536        135            0              58   91   78   
13.49/13.52	c 5631           25245          960695         7142016        135            0              64   88   77   
14.79/14.87	c 6286           28357          1063015        7862774        135            0              67   91   78   
16.49/16.56	c 7006           31396          1190204        8803513        135            0              70   91   78   
18.49/18.54	c 7798           34576          1338797        9788703        135            0              70   91   78   
20.69/20.76	c 8669           38381          1504758        10930782       135            0              67   91   79   
23.20/23.25	c 9627           42318          1691422        12234217       135            0              64   94   78   
25.79/25.84	c 10680          46698          1886999        13617341       135            0              67   91   78   
29.29/29.31	c 11838          52446          2145277        15321408       135            0              58   100   78  
32.29/32.36	c 13111          58417          2372880        17006902       135            0              58   94   78   
35.99/36.08	c 14511          64728          2653757        18889755       135            0              58   94   81   
39.49/39.54	c 16051          71668          2914651        20911293       135            0              61   94   78   
43.99/44.06	c 17745          79137          3253649        23369498       135            0              67   91   79   
48.99/49.02	c 19608          87492          3627675        25958629       135            0              70   97   80   
54.29/54.35	c 21657          97464          4029057        28938454       135            0              67   100   80  
59.39/59.40	c 23910          107385         4415413        31679443       135            0              67   97   82   
66.79/66.86	c 26388          118542         4966467        35524588       135            0              64   94   77   
73.49/73.57	c 29113          131134         5466934        39309001       135            0              64   91   77   
81.20/81.25	c 32110          144859         6044240        43369782       135            0              67   97   80   
89.29/89.39	c 35406          159594         6652888        48074223       135            0              64   94   78   
97.89/97.93	c 39031          176467         7301793        52310441       135            0              58   97   80   
107.99/108.03	c 43018          194245         8055629        57815562       135            0              61   97   79   
118.79/118.80	c 47403          212979         8864726        64054480       135            0              64   97   79   
128.99/129.00	c 52226          234386         9639710        70033938       135            0              64   100   79  
142.10/142.13	c 57531          258582         10631065       76880607       135            0              64   97   79   
154.79/154.84	c 63366          285252         11600855       84088297       135            0              61   97   80   
169.20/169.24	c 69784          312922         12671883       91746396       135            0              64   100   78  
187.10/187.20	c 76843          345025         14029965       100931065      135            0              64   100   80  
206.29/206.30	c 84607          379882         15464278       110545766      135            0              64   100   79  
227.49/227.55	c 93147          417891         17076647       121720567      135            0              64   97   79   
250.20/250.28	c 102541         462520         18785786       133393778      135            0              58   97   79   
273.99/274.04	c 112874         507029         20578665       146298599      135            0              64   94   77   
299.10/299.12	c 124240         554371         22489742       159976565      135            0              67   100   81  
330.10/330.16	c 136742         609740         24820372       175818076      135            0              64   100   80  
361.59/361.69	c 150494         673685         27216294       192045821      135            0              67   103   82  
398.99/399.09	c 165621         748371         30020960       211931713      135            0              64   106   80  
439.69/439.70	c 182260         825124         33064667       234472601      135            0              64   100   78  
488.49/488.59	c 200562         910917         36766729       260195241      135            0              64   103   81  
537.59/537.61	c 220694         1007531        40452207       288734006      135            0              64   103   81  
592.89/592.97	c 242839         1112395        44642056       317849387      135            0              64   103   82  
655.39/655.48	c 267198         1230783        49373547       350642410      135            0              64   103   82  
730.10/730.20	c 293992         1349950        55049898       387366514      135            0              67   103   83  
806.59/806.66	c 323465         1488203        60825934       427108033      135            0              64   106   81  
885.30/885.35	c 355885         1638085        66796771       472885112      135            0              64   103   82  
981.21/981.23	c 391547         1808510        74157329       522802197      135            0              64   103   83  
1070.00/1070.08	c 430775         1989236        80896637       572765883      135            0              64   103   79  
1179.71/1179.73	c 473925         2192121        89125230       631003260      135            0              61   100   78  
1294.01/1294.03	c 521390         2407976        97785391       690313467      135            0              64   109   81  
1436.40/1436.40	c 573601         2638855        108554242      760794343      135            0              67   103   82  
1576.71/1576.74	c 631033         2909584        119131128      834773200      135            0              64   106   81  
1722.81/1722.89	c 694208         3193163        130219534      911206032      135            0              64   103   82  
1886.12/1886.20	c 763700         3526004        142499320      999709455      135            0              64   103   80  
2075.01/2075.07	c 840141         3896643        156606069      1102014512     135            0              55   103   79  
2285.31/2285.33	c 924226         4295068        172335145      1211428293     135            0              61   103   80  
2515.62/2515.63	c 1016719        4725361        189776407      1335052977     135            0              64   106   82  
2520.02/2520.00	
2520.02/2520.00	c *** INTERRUPTED ***
2520.02/2520.00	c restarts              : 73          
2520.02/2520.00	c conflicts             : 1018572      (404 /sec)
2520.02/2520.00	c decisions             : 4734187      (1879 /sec)
2520.02/2520.00	c propagations          : 1337418563  (530719 /sec)
2520.02/2520.00	c root propagations     : 6480        
2520.02/2520.00	c filter calls          : 190112368      (75441 /sec)
2520.02/2520.00	c useless filter calls  : 28071512       (14 %)
2520.02/2520.00	c Memory used           : 30.38 MB
2520.02/2520.00	c CPU time              : 2520.01 s
2520.02/2520.00	c real time             : 2519.99 s
2520.02/2520.00	
2520.02/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13585 MiB free)
  memory of node 1: 16384 MiB (12641 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389597-1568327306/watcher-4389597-1568327306 -o /tmp/evaluation-result-4389597-1568327306/solver-4389597-1568327306 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389597-1568327306.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=12321, runsolver pid=12318
Current StackSize limit: 8192 KiB


[startup+0.100149 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26855188/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=28960 memory=5004 CPUtime=0.1 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 1545 0 0 0 10 0 0 0 20 0 1 0 408737084 29655040 1251 33554432000 4194304 6210612 140727892937456 140727892933992 5451286 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7240 1251 829 493 0 545 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28960 KiB
Current children cumulated memory: 5004 KiB

[startup+0.210856 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26855188/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=29092 memory=5268 CPUtime=0.21 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 1600 0 0 0 21 0 0 0 20 0 1 0 408737084 29790208 1317 33554432000 4194304 6210612 140727892937456 140727892933992 139989577231456 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7273 1317 829 493 0 578 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29092 KiB
Current children cumulated memory: 5268 KiB

[startup+0.310734 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26854444/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=29488 memory=5796 CPUtime=0.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 1705 0 0 0 31 0 0 0 20 0 1 0 408737084 30195712 1449 33554432000 4194304 6210612 140727892937456 140727892933992 139989576802285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7372 1449 829 493 0 677 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 29488 KiB
Current children cumulated memory: 5796 KiB

[startup+0.700341 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26854444/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=30968 memory=7064 CPUtime=0.69 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 3492 0 0 0 69 0 0 0 20 0 1 0 408737084 31711232 1766 33554432000 4194304 6210612 140727892937456 140727892933992 5446066 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7742 1766 829 493 0 1047 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 30968 KiB
Current children cumulated memory: 7064 KiB

[startup+5.94888 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26854444/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=5.94 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 4795 0 0 0 594 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5079072 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 5.94 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+6.00042 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12322
/proc/meminfo: memFree=26854444/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=5.99 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 4795 0 0 0 599 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082043 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 5.99 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+6.30031 s]
/proc/loadavg: 2.40 2.10 2.07 3/200 12322
/proc/meminfo: memFree=26842968/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=6.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 4797 0 0 0 629 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082119 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+12.7003 s]
/proc/loadavg: 2.56 2.14 2.09 3/199 12325
/proc/meminfo: memFree=27767768/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=12.69 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 5400 0 0 0 1269 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082010 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+25.5003 s]
/proc/loadavg: 2.48 2.14 2.09 3/199 12327
/proc/meminfo: memFree=27767492/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=25.49 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 6588 0 0 0 2549 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5017315 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+51.1003 s]*
/proc/loadavg: 2.31 2.13 2.08 3/199 12327
/proc/meminfo: memFree=27766992/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=51.1 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 6845 0 0 0 5110 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5075229 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+102.3 s]
/proc/loadavg: 2.13 2.11 2.08 3/201 12340
/proc/meminfo: memFree=27767508/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=102.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 7087 0 0 0 10229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5075992 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 2.09 2.07 3/201 12346
/proc/meminfo: memFree=27767436/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=162.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 7329 0 0 0 16229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074988 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/201 12350
/proc/meminfo: memFree=27766836/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=222.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 7569 0 0 0 22229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5078890 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/201 12354
/proc/meminfo: memFree=27766792/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=282.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 7810 0 0 0 28229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5017311 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/201 12360
/proc/meminfo: memFree=27767168/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=342.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 8050 0 0 0 34229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5081875 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 12365
/proc/meminfo: memFree=27767364/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=402.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 8289 0 0 0 40229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074907 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 12369
/proc/meminfo: memFree=27767392/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=462.29 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 8526 0 0 0 46229 0 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5017320 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB


################
# More data... #
################

/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12576
/proc/meminfo: memFree=27841956/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=1842.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 13211 0 0 0 184230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082442 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12588
/proc/meminfo: memFree=27841988/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=1902.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 13448 0 0 0 190230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5017249 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12594
/proc/meminfo: memFree=27841804/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=1962.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 13614 0 0 0 196230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074469 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 1962.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12598
/proc/meminfo: memFree=27841536/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2022.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 13780 0 0 0 202230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5079072 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12602
/proc/meminfo: memFree=27841700/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2082.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14017 0 0 0 208230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074027 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12608
/proc/meminfo: memFree=27841576/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2142.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14170 0 0 0 214230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5080969 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2142.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12613
/proc/meminfo: memFree=27841196/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2202.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14329 0 0 0 220230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5079064 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2202.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12617
/proc/meminfo: memFree=27841588/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2262.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14488 0 0 0 226230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5081860 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2262.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12623
/proc/meminfo: memFree=27841744/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2322.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14725 0 0 0 232230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5078384 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2322.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12628
/proc/meminfo: memFree=27841648/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2382.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 14885 0 0 0 238230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082450 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2382.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12632
/proc/meminfo: memFree=27841136/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2442.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 15034 0 0 0 244230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5082127 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2442.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12646
/proc/meminfo: memFree=27840688/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2502.31 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 15189 0 0 0 250230 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5078394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2502.31 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12647
/proc/meminfo: memFree=27840996/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2520.02 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 15424 0 0 0 252001 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074405 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2520.02 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520 s]
# the end of solver process 12321 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.01 s, system=0.018 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12647
/proc/meminfo: memFree=27840996/32770688 swapFree=66919992/67108860
[pid=12321] ppid=12318 vsize=31108 memory=7656 CPUtime=2520.02 cores=0-3
/proc/12321/stat : 12321 (cosoco) R 12318 12321 9478 0 -1 4202496 15424 0 0 0 252001 1 0 0 20 0 1 0 408737084 31854592 1914 33554432000 4194304 6210612 140727892937456 140727892935416 5074405 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 19992576 140727892943883 140727892943985 140727892943985 140727892946894 0
/proc/12321/statm: 7777 1914 866 493 0 1082 0
Current children cumulated CPU time: 2520.02 s
Current children cumulated vsize: 31108 KiB
Current children cumulated memory: 7656 KiB

Child status: 1
Real time (s): 2520
CPU time (s): 2520.03
CPU user time (s): 2520.01
CPU system time (s): 0.018
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 31108
Max. memory (cumulated for all children) (KiB): 7656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.01
system time used= 0.018
maximum resident set size= 7724
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15474
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 638


# summary of solver processes directly reported to runsolver:
#   pid: 12321
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2520.01
#   total CPU system time (s): 0.018

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.2345 second user time and 16.8269 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-14 06:48:50
IDJOB=4389597
IDBENCH=124268
IDSOLVER=2829
FILE ID=node120/4389597-1568327306
RUNJOBID= node120-1323826654-9509
PBS_JOBID= 21701129
Free space on /tmp= 58712 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Langford/Langford-m1-k3/Langford-3-45.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389597-1568327306/watcher-4389597-1568327306 -o /tmp/evaluation-result-4389597-1568327306/solver-4389597-1568327306 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389597-1568327306.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c29e6924973099ab0a0c802e448a5f67
RANDOM SEED=863722788

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        26857356 kB
MemAvailable:   31730324 kB
Buffers:          147056 kB
Cached:          5012932 kB
SwapCached:        77548 kB
Active:          1292020 kB
Inactive:        4027040 kB
Active(anon):      80040 kB
Inactive(anon):   128808 kB
Active(file):    1211980 kB
Inactive(file):  3898232 kB
Unevictable:      108228 kB
Mlocked:          108228 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:            704396 kB
Writeback:         77516 kB
AnonPages:        191152 kB
Mapped:            49940 kB
Shmem:             41008 kB
Slab:             186304 kB
SReclaimable:     157180 kB
SUnreclaim:        29124 kB
KernelStack:        3472 kB
PageTables:         5952 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     623184 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 59148 MiB
End job on node120 at 2011-12-14 07:30:50