Trace number 4397437

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.02 2400.11

General information on the benchmark

NameLangford/Langford-m2-s1/
LangfordBin-70.xml
MD5SUM232b00b06301dc20842d0d34bf6a9f64
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables280
Number of constraints210
Number of domains2
Minimum domain size70
Maximum domain size140
Distribution of domain sizes[{"size":70,"count":140},{"size":140,"count":140}]
Minimum variable degree2
Maximum variable degree140
Distribution of variable degrees[{"degree":2,"count":140},{"degree":140,"count":140}]
Minimum constraint arity2
Maximum constraint arity141
Distribution of constraint arities[{"arity":2,"count":70},{"arity":141,"count":140}]
Number of extensional constraints0
Number of intensional constraints70
Distribution of constraint types[{"type":"intension","count":70},{"type":"element","count":140}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397437-1568575276.xml 
0.00/0.02	c intension  eq(add(p[1],2),p[0]) -> extension (support ? 1) - 138tuples
0.00/0.03	c intension  eq(add(p[3],3),p[2]) -> extension (support ? 1) - 137tuples
0.00/0.04	c intension  eq(add(p[5],4),p[4]) -> extension (support ? 1) - 136tuples
0.00/0.05	c intension  eq(add(p[7],5),p[6]) -> extension (support ? 1) - 135tuples
0.00/0.06	c intension  eq(add(p[9],6),p[8]) -> extension (support ? 1) - 134tuples
0.00/0.07	c intension  eq(add(p[11],7),p[10]) -> extension (support ? 1) - 133tuples
0.00/0.08	c intension  eq(add(p[13],8),p[12]) -> extension (support ? 1) - 132tuples
0.00/0.09	c intension  eq(add(p[15],9),p[14]) -> extension (support ? 1) - 131tuples
0.00/0.10	c intension  eq(add(p[17],10),p[16]) -> extension (support ? 1) - 130tuples
0.10/0.11	c intension  eq(add(p[19],11),p[18]) -> extension (support ? 1) - 129tuples
0.10/0.12	c intension  eq(add(p[21],12),p[20]) -> extension (support ? 1) - 128tuples
0.10/0.13	c intension  eq(add(p[23],13),p[22]) -> extension (support ? 1) - 127tuples
0.10/0.14	c intension  eq(add(p[25],14),p[24]) -> extension (support ? 1) - 126tuples
0.10/0.15	c intension  eq(add(p[27],15),p[26]) -> extension (support ? 1) - 125tuples
0.10/0.16	c intension  eq(add(p[29],16),p[28]) -> extension (support ? 1) - 124tuples
0.10/0.17	c intension  eq(add(p[31],17),p[30]) -> extension (support ? 1) - 123tuples
0.10/0.18	c intension  eq(add(p[33],18),p[32]) -> extension (support ? 1) - 122tuples
0.10/0.19	c intension  eq(add(p[35],19),p[34]) -> extension (support ? 1) - 121tuples
0.10/0.20	c intension  eq(add(p[37],20),p[36]) -> extension (support ? 1) - 120tuples
0.10/0.21	c intension  eq(add(p[39],21),p[38]) -> extension (support ? 1) - 119tuples
0.20/0.22	c intension  eq(add(p[41],22),p[40]) -> extension (support ? 1) - 118tuples
0.20/0.23	c intension  eq(add(p[43],23),p[42]) -> extension (support ? 1) - 117tuples
0.20/0.24	c intension  eq(add(p[45],24),p[44]) -> extension (support ? 1) - 116tuples
0.20/0.25	c intension  eq(add(p[47],25),p[46]) -> extension (support ? 1) - 115tuples
0.20/0.26	c intension  eq(add(p[49],26),p[48]) -> extension (support ? 1) - 114tuples
0.20/0.27	c intension  eq(add(p[51],27),p[50]) -> extension (support ? 1) - 113tuples
0.20/0.28	c intension  eq(add(p[53],28),p[52]) -> extension (support ? 1) - 112tuples
0.20/0.29	c intension  eq(add(p[55],29),p[54]) -> extension (support ? 1) - 111tuples
0.20/0.30	c intension  eq(add(p[57],30),p[56]) -> extension (support ? 1) - 110tuples
0.20/0.31	c intension  eq(add(p[59],31),p[58]) -> extension (support ? 1) - 109tuples
0.30/0.32	c intension  eq(add(p[61],32),p[60]) -> extension (support ? 1) - 108tuples
0.30/0.33	c intension  eq(add(p[63],33),p[62]) -> extension (support ? 1) - 107tuples
0.30/0.34	c intension  eq(add(p[65],34),p[64]) -> extension (support ? 1) - 106tuples
0.30/0.35	c intension  eq(add(p[67],35),p[66]) -> extension (support ? 1) - 105tuples
0.30/0.36	c intension  eq(add(p[69],36),p[68]) -> extension (support ? 1) - 104tuples
0.30/0.37	c intension  eq(add(p[71],37),p[70]) -> extension (support ? 1) - 103tuples
0.30/0.38	c intension  eq(add(p[73],38),p[72]) -> extension (support ? 1) - 102tuples
0.30/0.39	c intension  eq(add(p[75],39),p[74]) -> extension (support ? 1) - 101tuples
0.30/0.40	c intension  eq(add(p[77],40),p[76]) -> extension (support ? 1) - 100tuples
0.30/0.41	c intension  eq(add(p[79],41),p[78]) -> extension (support ? 1) - 99tuples
0.40/0.42	c intension  eq(add(p[81],42),p[80]) -> extension (support ? 1) - 98tuples
0.40/0.43	c intension  eq(add(p[83],43),p[82]) -> extension (support ? 1) - 97tuples
0.40/0.44	c intension  eq(add(p[85],44),p[84]) -> extension (support ? 1) - 96tuples
0.40/0.45	c intension  eq(add(p[87],45),p[86]) -> extension (support ? 1) - 95tuples
0.40/0.46	c intension  eq(add(p[89],46),p[88]) -> extension (support ? 1) - 94tuples
0.40/0.47	c intension  eq(add(p[91],47),p[90]) -> extension (support ? 1) - 93tuples
0.40/0.48	c intension  eq(add(p[93],48),p[92]) -> extension (support ? 1) - 92tuples
0.40/0.49	c intension  eq(add(p[95],49),p[94]) -> extension (support ? 1) - 91tuples
0.40/0.50	c intension  eq(add(p[97],50),p[96]) -> extension (support ? 1) - 90tuples
0.40/0.51	c intension  eq(add(p[99],51),p[98]) -> extension (support ? 1) - 89tuples
0.50/0.52	c intension  eq(add(p[101],52),p[100]) -> extension (support ? 1) - 88tuples
0.50/0.53	c intension  eq(add(p[103],53),p[102]) -> extension (support ? 1) - 87tuples
0.50/0.54	c intension  eq(add(p[105],54),p[104]) -> extension (support ? 1) - 86tuples
0.50/0.55	c intension  eq(add(p[107],55),p[106]) -> extension (support ? 1) - 85tuples
0.50/0.56	c intension  eq(add(p[109],56),p[108]) -> extension (support ? 1) - 84tuples
0.50/0.57	c intension  eq(add(p[111],57),p[110]) -> extension (support ? 1) - 83tuples
0.50/0.58	c intension  eq(add(p[113],58),p[112]) -> extension (support ? 1) - 82tuples
0.50/0.59	c intension  eq(add(p[115],59),p[114]) -> extension (support ? 1) - 81tuples
0.50/0.60	c intension  eq(add(p[117],60),p[116]) -> extension (support ? 1) - 80tuples
0.59/0.61	c intension  eq(add(p[119],61),p[118]) -> extension (support ? 1) - 79tuples
0.59/0.62	c intension  eq(add(p[121],62),p[120]) -> extension (support ? 1) - 78tuples
0.59/0.63	c intension  eq(add(p[123],63),p[122]) -> extension (support ? 1) - 77tuples
0.59/0.64	c intension  eq(add(p[125],64),p[124]) -> extension (support ? 1) - 76tuples
0.59/0.65	c intension  eq(add(p[127],65),p[126]) -> extension (support ? 1) - 75tuples
0.59/0.66	c intension  eq(add(p[129],66),p[128]) -> extension (support ? 1) - 74tuples
0.59/0.67	c intension  eq(add(p[131],67),p[130]) -> extension (support ? 1) - 73tuples
0.59/0.68	c intension  eq(add(p[133],68),p[132]) -> extension (support ? 1) - 72tuples
0.59/0.69	c intension  eq(add(p[135],69),p[134]) -> extension (support ? 1) - 71tuples
0.68/0.70	c intension  eq(add(p[137],70),p[136]) -> extension (support ? 1) - 70tuples
0.68/0.71	c intension  eq(add(p[139],71),p[138]) -> extension (support ? 1) - 69tuples
0.68/0.71	c root propagations     : 5110        
0.68/0.71	c restarts enabled, print stats at every restarts
0.68/0.71	c
0.68/0.71	c
0.68/0.71	c ========================================[ Problem Statistics ]===========================================
0.68/0.71	c |                                                                                                       
0.68/0.71	c |  Parse time        :         0.70 s 
0.68/0.71	c |
0.68/0.71	c |               Variables: 280
0.68/0.71	c |            Domain Sizes: 70..140
0.68/0.71	c |
0.68/0.71	c |             Constraints: 210
0.68/0.71	c |                   Arity: 2..141  -- Binary: 70
0.68/0.71	c | 
0.68/0.71	c |                   Types: 
0.68/0.71	c |                          Element Constant: 140
0.68/0.71	c |                          Extension: 70  (nb tuples: 69..138) -- (shared: 0)
0.68/0.71	c |                          
0.68/0.71	c =========================================================================================================
0.68/0.71	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.68/0.74	c 101            635            138675         26074          140            0              232   255   239
0.68/0.77	c 211            901            278845         74664          140            0              110   122   109
0.78/0.81	c 332            1316           463042         139367         140            0              122   126   121
0.78/0.83	c 465            1671           561267         169108         140            0              160   161   158
0.78/0.86	c 611            2132           696771         213872         140            0              124   142   131
0.78/0.89	c 771            2902           898706         273016         140            0              125   143   134
0.88/0.94	c 947            3782           1182280        359094         140            0              120   142   126
0.88/0.98	c 1140           4396           1364716        422336         140            0              117   136   125
0.99/1.02	c 1352           5132           1631503        500347         140            0              124   129   126
0.99/1.07	c 1585           6632           2000436        597360         140            0              115   150   126
1.09/1.11	c 1841           7560           2241050        660466         140            0              122   141   128
1.09/1.17	c 2122           8898           2591044        751215         140            0              116   147   131
1.18/1.22	c 2431           10552          2977404        847906         140            0              119   144   129
1.18/1.27	c 2770           11458          3294157        932114         140            0              120   139   129
1.28/1.33	c 3142           12511          3777565        1073540        140            0              115   135   121
1.38/1.40	c 3551           14220          4271011        1201745        140            0              120   137   127
1.38/1.47	c 4000           15661          4778368        1334398        140            0              117   132   122
1.48/1.54	c 4493           17595          5308019        1472319        140            0              117   130   122
1.58/1.63	c 5035           19159          5979471        1669200        140            0              114   128   117
1.68/1.71	c 5631           21372          6659827        1860072        140            0              113   134   122
1.78/1.81	c 6286           23636          7453364        2056288        140            0              116   132   122
1.88/1.93	c 7006           26687          8454060        2295568        140            0              111   139   121
1.99/2.10	c 7798           31384          9913659        2671877        140            0              113   131   121
2.18/2.21	c 8669           33882          10856152       2907652        140            0              110   135   126
2.28/2.34	c 9627           36975          11867896       3172059        140            0              111   129   119
2.38/2.47	c 10680          40305          13050476       3470922        140            0              116   136   123
2.48/2.59	c 11838          42808          13995214       3754492        140            0              115   130   122
2.68/2.75	c 13111          46686          15485820       4166881        140            0              117   130   122
2.78/2.89	c 14511          49581          16754235       4495839        140            0              112   133   124
3.09/3.11	c 16051          56436          18790498       4973534        140            0              112   133   124
3.28/3.33	c 17745          62508          20876527       5476140        140            0              114   130   123
3.48/3.59	c 19608          70062          23170469       6066274        140            0              114   129   118
3.78/3.83	c 21657          76028          25342460       6599642        140            0              110   134   121
3.99/4.08	c 23910          81967          27468716       7198938        140            0              114   131   120
4.18/4.26	c 26388          86002          29091614       7670141        140            0              115   126   121
4.48/4.50	c 29113          91818          31280879       8188001        140            0              109   125   117
4.68/4.76	c 32110          96970          33671479       8947193        140            0              113   132   116
4.99/5.05	c 35406          104632         36246847       9699604        140            0              112   128   119
5.28/5.34	c 39031          112742         39001667       10285090       140            0              112   131   121
5.68/5.74	c 43018          123013         42674959       11227315       140            0              116   135   124
5.99/6.10	c 47403          132421         46030374       12132441       140            0              112   133   124
6.28/6.38	c 52226          139523         48756013       12750167       140            0              121   127   122
6.58/6.64	c 57531          148168         51220282       13343651       140            0              109   134   124
6.99/7.05	c 63366          159563         55228536       14244161       140            0              109   137   124
7.38/7.46	c 69784          176460         59555548       15068352       140            0              119   131   129
7.78/7.86	c 76843          186509         63602612       15996270       140            0              111   133   124
8.18/8.28	c 84607          197610         68029253       16900533       140            0              112   129   124
8.78/8.81	c 93147          214903         73746242       18252459       140            0              113   131   126
9.58/9.65	c 102541         239507         82198088       20279179       140            0              118   125   120
10.28/10.33	c 112874         255472         88902129       21851742       140            0              112   117   115
11.09/11.15	c 124240         268237         96167151       24223177       140            0              113   124   119
13.18/13.29	c 136742         317682         114620783      29600212       140            0              112   130   117
14.28/14.32	c 150494         338857         123950128      32499321       140            0              111   130   121
15.09/15.16	c 165621         358881         131563816      34913895       140            0              115   128   121
15.88/15.97	c 182260         395065         139179343      36928870       140            0              112   127   123
16.88/16.94	c 200562         425814         148108056      39556195       140            0              116   127   123
17.99/18.01	c 220694         462192         157522170      42430386       140            0              117   124   119
19.48/19.50	c 242839         498869         171865341      46588793       140            0              116   128   122
20.28/20.33	c 267198         529353         180181516      48397968       140            0              112   124   119
22.09/22.19	c 293992         570035         196285260      54671401       140            0              112   125   116
24.18/24.29	c 323465         616559         214184256      60419003       140            0              110   125   115
27.18/27.29	c 355885         683775         240452716      69750586       140            0              113   126   118
28.78/28.80	c 391547         728141         254952290      72897965       140            0              108   127   122
30.68/30.70	c 430775         784586         274351936      77481147       140            0              111   125   122
33.69/33.76	c 473925         882047         303698578      84800973       140            0              108   126   119
35.79/35.86	c 521390         931843         325218680      90726567       140            0              117   129   124
38.69/38.73	c 573601         1012251        353758657      98149473       140            0              113   126   120
41.39/41.40	c 631033         1086092        380676951      105174699      140            0              118   127   122
43.69/43.75	c 694208         1165482        403432176      111030367      140            0              113   126   120
46.29/46.34	c 763700         1252126        429654061      117184960      140            0              110   130   125
50.69/50.74	c 840141         1371290        470288173      128709252      140            0              111   128   118
53.19/53.29	c 924226         1478148        496115243      135338994      140            0              118   119   118
56.78/56.88	c 1016719        1578366        535408406      142911064      140            0              123   132   127
60.99/61.02	c 1118461        1698375        576818774      154052911      140            0              113   125   121
68.78/68.83	c 1230377        1930592        649697502      173493000      140            0              111   129   120
74.28/74.38	c 1353484        2069968        702940471      187109398      140            0              112   133   119
83.68/83.79	c 1488901        2293025        790608156      213293556      140            0              111   124   116
94.18/94.25	c 1637859        2529535        890823563      241414406      140            0              112   127   118
101.78/101.89	c 1801712        2717833        962782807      258205257      140            0              109   129   117
108.58/108.60	c 1981950        2920021        1032256547     274270269      140            0              114   125   119
118.58/118.65	c 2180211        3191549        1130316055     301671851      140            0              110   124   117
128.99/129.08	c 2398298        3513051        1235944407     327099274      140            0              114   126   121
139.68/139.70	c 2638193        3813954        1338051397     352535933      140            0              110   126   118
159.78/159.85	c 2902077        4292854        1515704538     412680786      140            0              112   121   114
169.28/169.39	c 3192349        4617828        1610246495     437848620      140            0              114   125   120
188.78/188.83	c 3511648        5286096        1795484759     486979544      140            0              115   125   120
202.38/202.45	c 3862876        5784460        1934017130     519343309      140            0              115   122   119
221.88/221.92	c 4249226        6431178        2129672748     573238731      140            0              116   121   118
238.78/238.81	c 4674211        7057149        2301183745     616291706      140            0              114   125   119
251.98/252.05	c 5141694        7569771        2439825400     645828801      140            0              119   127   125
278.27/278.32	c 5655925        8311379        2685713894     721138676      140            0              112   120   117
300.98/301.02	c 6221579        9055297        2911171888     777969466      140            0              109   126   119
322.87/322.92	c 6843798        9790594        3122476638     833033125      140            0              116   124   119
361.57/361.67	c 7528238        11113679       3523062466     921753271      140            0              113   124   118
395.47/395.59	c 8281122        12258628       3859698937     1004381352     140            0              110   122   117
435.67/435.71	c 9109294        13583294       4273791469     1097975089     140            0              110   123   117
473.86/473.94	c 10020283       14561431       4666979541     1175599561     140            0              110   119   116
513.46/513.51	c 11022370       16012506       5051252958     1268189020     140            0              103   130   122
569.97/570.07	c 12124665       17585430       5588993213     1424907433     140            0              114   124   121
623.57/623.67	c 13337189       19055446       6102208948     1581664818     140            0              110   128   125
705.37/705.44	c 14670965       21307249       6837369629     1867661902     140            0              113   122   119
835.86/835.95	c 16138118       23646634       7926339579     2267932933     140            0              109   123   114
922.66/922.77	c 17751986       25892620       8654088261     2546349445     140            0              113   122   117
980.15/980.26	c 19527240       27934267       9222381494     2706603220     140            0              109   132   125
1105.85/1105.91	c 21480019       31130436       10460669687    3048392107     140            0              109   128   121
1218.14/1218.29	c 23628075       34526913       11571078900    3354403089     140            0              112   122   118
1380.05/1380.13	c 25990936       38530733       13099801328    3832735374     140            0              111   127   116
1524.24/1524.39	c 28590083       42442848       14473873022    4247021699     140            0              114   119   116
1670.33/1670.44	c 31449144       46412395       15943983063    4625993422     140            0              108   128   118
1770.53/1770.68	c 34594111       49695850       16968732250    4853812343     140            0              108   122   119
1949.72/1949.83	c 38053574       55642701       18715907578    5423950483     140            0              109   122   118
2072.11/2072.20	c 41858983       60063267       19991765649    5757064016     140            0              109   125   119
2294.51/2294.64	c 46044932       67042490       22101634901    6410215690     140            0              111   122   117
2400.01/2400.10	
2400.01/2400.10	c *** INTERRUPTED ***
2400.01/2400.10	c restarts              : 113         
2400.01/2400.10	c conflicts             : 48488707     (20204 /sec)
2400.01/2400.10	c decisions             : 70206840     (29253 /sec)
2400.01/2400.10	c propagations          : 6674086514  (2780896 /sec)
2400.01/2400.10	c root propagations     : 5110        
2400.01/2400.10	c filter calls          : 23191117743    (9663057 /sec)
2400.01/2400.10	c useless filter calls  : 18462149893    (79 %)
2400.01/2400.10	c Memory used           : 30.74 MB
2400.01/2400.10	c CPU time              : 2399.98 s
2400.01/2400.10	c real time             : 2400.1 s
2400.01/2400.10	
2400.01/2400.10	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15042 MiB free)
  memory of node 1: 16384 MiB (14865 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397437-1568575276/watcher-4397437-1568575276 -o /tmp/evaluation-result-4397437-1568575276/solver-4397437-1568575276 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568572744-5581 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397437-1568575276.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=6367, runsolver pid=6364

[startup+0.100155 s]*
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30624492/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=28912 memory=5084 CPUtime=0.1 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 3393 0 0 0 10 0 0 0 20 0 1 0 433777170 29605888 1271 33554432000 4194304 6211092 140722813959504 140722813956040 5012856 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7228 1271 832 493 0 533 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28912 KiB
Current children cumulated memory: 5084 KiB

[startup+0.209813 s]*
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30624232/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=30020 memory=6168 CPUtime=0.2 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 3889 0 0 0 20 0 0 0 20 0 1 0 433777170 30740480 1542 33554432000 4194304 6211092 140722813959504 140722813956040 5446248 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7505 1542 832 493 0 810 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 30020 KiB
Current children cumulated memory: 6168 KiB

[startup+0.309396 s]*
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30623860/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=30152 memory=6432 CPUtime=0.3 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 3937 0 0 0 30 0 0 0 20 0 1 0 433777170 30875648 1608 33554432000 4194304 6211092 140722813959504 140722813956040 5451488 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7538 1608 832 493 0 843 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 30152 KiB
Current children cumulated memory: 6432 KiB

[startup+0.700257 s]
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30622744/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31340 memory=7752 CPUtime=0.68 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 4241 0 0 0 68 0 0 0 20 0 1 0 433777170 32092160 1938 33554432000 4194304 6211092 140722813959504 140722813954408 5440705 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7835 1938 832 493 0 1140 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 31340 KiB
Current children cumulated memory: 7752 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30622124/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=7752 CPUtime=1.48 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 4294 0 0 0 148 0 0 0 20 0 1 0 433777170 32227328 1938 33554432000 4194304 6211092 140722813959504 140722813957464 5099205 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 1938 832 493 0 1173 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 7752 KiB

[startup+3.10937 s]
/proc/loadavg: 2.00 2.00 1.88 3/203 6368
/proc/meminfo: memFree=30622156/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=7976 CPUtime=3.09 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 5155 0 0 0 309 0 0 0 20 0 1 0 433777170 32227328 1994 33554432000 4194304 6211092 140722813959504 140722813957464 5193728 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 1994 868 493 0 1173 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 7976 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.00 1.88 3/204 6370
/proc/meminfo: memFree=30621452/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=7976 CPUtime=6.28 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 6016 0 0 0 628 0 0 0 20 0 1 0 433777170 32227328 1994 33554432000 4194304 6211092 140722813959504 140722813957464 5099205 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 1994 868 493 0 1173 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 7976 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 1.88 3/203 6370
/proc/meminfo: memFree=30621408/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=7976 CPUtime=12.68 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 6877 0 0 0 1268 0 0 0 20 0 1 0 433777170 32227328 1994 33554432000 4194304 6211092 140722813959504 140722813957464 5008831 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 1994 868 493 0 1173 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 7976 KiB

[startup+25.5003 s]
/proc/loadavg: 1.92 1.98 1.87 3/203 6370
/proc/meminfo: memFree=30621380/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=7976 CPUtime=25.48 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 8594 0 0 0 2548 0 0 0 20 0 1 0 433777170 32227328 1994 33554432000 4194304 6211092 140722813959504 140722813957464 5099274 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 1994 868 493 0 1173 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 7976 KiB

[startup+51.1094 s]
/proc/loadavg: 1.95 1.98 1.88 3/205 6374
/proc/meminfo: memFree=30620328/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=51.1 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 9115 0 0 0 5109 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5390149 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 1.99 1.88 3/204 6378
/proc/meminfo: memFree=30620204/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=102.28 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 9630 0 0 0 10227 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5008971 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 1.89 3/204 6382
/proc/meminfo: memFree=30620156/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=162.28 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 10145 0 0 0 16227 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099224 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/204 6386
/proc/meminfo: memFree=30620004/32770624 swapFree=66970032/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=222.28 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 10660 0 0 0 22227 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5193699 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/203 6393
/proc/meminfo: memFree=30620296/32770624 swapFree=66970040/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=282.27 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 11175 0 0 0 28226 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/202 6397
/proc/meminfo: memFree=30620352/32770624 swapFree=66970040/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=342.27 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 11691 0 0 0 34226 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/202 6401
/proc/meminfo: memFree=30620476/32770624 swapFree=66970040/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=402.27 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 12207 0 0 0 40226 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5009164 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 2.00 1.92 3/202 6408
/proc/meminfo: memFree=30619952/32770624 swapFree=66970044/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=462.26 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 12722 0 0 0 46225 1 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5397352 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB


################
# More data... #
################

/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1662.23 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+1722.3 s]
/proc/loadavg: 2.37 2.21 2.05 3/204 6860
/proc/meminfo: memFree=30603836/32770624 swapFree=66970068/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=1722.23 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 22815 0 0 0 172220 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099205 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1722.23 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+1782.3 s]
/proc/loadavg: 2.63 2.28 2.08 3/205 6997
/proc/meminfo: memFree=30479428/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=1782.23 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 23331 0 0 0 178220 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099205 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1782.23 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+1842.3 s]
/proc/loadavg: 2.23 2.23 2.08 3/205 7001
/proc/meminfo: memFree=30480100/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=1842.22 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 23766 0 0 0 184219 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1842.22 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+1902.3 s]
/proc/loadavg: 2.09 2.19 2.07 3/204 7007
/proc/meminfo: memFree=30473732/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=1902.22 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 24204 0 0 0 190219 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5390065 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1902.22 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.15 2.06 3/203 7011
/proc/meminfo: memFree=30468120/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=1962.22 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 24719 0 0 0 196219 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 1962.22 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2022.3 s]
/proc/loadavg: 2.14 2.16 2.07 3/204 7016
/proc/meminfo: memFree=30469488/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2022.21 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 25094 0 0 0 202218 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5009164 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2082.3 s]
/proc/loadavg: 2.05 2.13 2.06 3/204 7024
/proc/meminfo: memFree=30470052/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2082.21 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 25609 0 0 0 208218 3 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.11 2.06 3/204 7028
/proc/meminfo: memFree=30470092/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2142.22 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 26034 0 0 0 214218 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.09 2.05 3/204 7032
/proc/meminfo: memFree=30469844/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2202.21 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 26464 0 0 0 220217 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2202.21 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.07 2.05 3/204 7039
/proc/meminfo: memFree=30467912/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2262.21 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 26899 0 0 0 226217 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5193696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2262.21 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/203 7043
/proc/meminfo: memFree=30468124/32770624 swapFree=66970072/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2322.21 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 27415 0 0 0 232217 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099159 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2322.21 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/204 7056
/proc/meminfo: memFree=30466820/32770624 swapFree=66970076/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2382.2 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 27848 0 0 0 238216 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2382.2 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 2.04 2.05 3/204 7058
/proc/meminfo: memFree=30467124/32770624 swapFree=66970076/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2400.01 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 28263 0 0 0 239997 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2400.01 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 6367 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.98 s, system=0.045998 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 2.04 2.05 3/204 7058
/proc/meminfo: memFree=30467124/32770624 swapFree=66970076/67108860
[pid=6367] ppid=6364 vsize=31472 memory=8032 CPUtime=2400.01 cores=1,3,5,7
/proc/6367/stat : 6367 (cosoco) R 6364 6367 5549 0 -1 4202496 28263 0 0 0 239997 4 0 0 20 0 1 0 433777170 32227328 2008 33554432000 4194304 6211092 140722813959504 140722813957464 5099152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 16969728 140722813965323 140722813965425 140722813965425 140722813968334 0
/proc/6367/statm: 7868 2008 868 493 0 1173 0
Current children cumulated CPU time: 2400.01 s
Current children cumulated vsize: 31472 KiB
Current children cumulated memory: 8032 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.02
CPU user time (s): 2399.98
CPU system time (s): 0.045998
CPU usage (%): 99.9964
Max. virtual memory (cumulated for all children) (KiB): 31472
Max. memory (cumulated for all children) (KiB): 8032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.98
system time used= 0.045998
maximum resident set size= 8096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28312
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 1503


# summary of solver processes directly reported to runsolver:
#   pid: 6367
#   total CPU time (s): 2400.02
#   total CPU user time (s): 2399.98
#   total CPU system time (s): 0.045998

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.75144 second user time and 15.6321 second system time

The end

Launcher Data 

Begin job on node135 at 2019-09-15 21:20:36
IDJOB=4397437
IDBENCH=124380
IDSOLVER=2849
FILE ID=node135/4397437-1568575276
RUNJOBID= node135-1568572744-5581
PBS_JOBID= 21703319
Free space on /tmp= 61360 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Langford/Langford-m2-s1/LangfordBin-70.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397437-1568575276/watcher-4397437-1568575276 -o /tmp/evaluation-result-4397437-1568575276/solver-4397437-1568575276 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568572744-5581 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397437-1568575276.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 232b00b06301dc20842d0d34bf6a9f64
RANDOM SEED=823908379

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30626328 kB
MemAvailable:   31809736 kB
Buffers:          184340 kB
Cached:          1277116 kB
SwapCached:        33316 kB
Active:           633236 kB
Inactive:         912740 kB
Active(anon):      57712 kB
Inactive(anon):    69428 kB
Active(file):     575524 kB
Inactive(file):   843312 kB
Unevictable:      109480 kB
Mlocked:          109480 kB
SwapTotal:      67108860 kB
SwapFree:       66970032 kB
Dirty:              2772 kB
Writeback:             0 kB
AnonPages:        191656 kB
Mapped:            42556 kB
Shmem:             34132 kB
Slab:             191356 kB
SReclaimable:     160812 kB
SUnreclaim:        30544 kB
KernelStack:        3616 kB
PageTables:         5928 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     581580 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    145408 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61332 MiB
End job on node135 at 2019-09-15 22:00:36