Trace number 4394664

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2SAT (TO)298 2400.05 2400.71

General information on the benchmark

NameGraphColoring/GraphColoring-m1-mono/
GraphColoring-dsjc-1000-9.xml
MD5SUM7e8c40b74266585f6434aeb3a0bbeb87
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark298
Best CPU time to get the best result obtained on this benchmark2400.05
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of constraints449449
Number of domains1
Minimum domain size1000
Maximum domain size1000
Distribution of domain sizes[{"size":1000,"count":1000}]
Minimum variable degree871
Maximum variable degree925
Distribution of variable degrees[{"degree":871,"count":2},{"degree":873,"count":1},{"degree":874,"count":3},{"degree":875,"count":3},{"degree":876,"count":2},{"degree":877,"count":3},{"degree":879,"count":5},{"degree":880,"count":3},{"degree":881,"count":2},{"degree":882,"count":6},{"degree":883,"count":13},{"degree":884,"count":11},{"degree":885,"count":11},{"degree":886,"count":12},{"degree":887,"count":29},{"degree":888,"count":21},{"degree":889,"count":31},{"degree":890,"count":18},{"degree":891,"count":21},{"degree":892,"count":24},{"degree":893,"count":29},{"degree":894,"count":36},{"degree":895,"count":34},{"degree":896,"count":37},{"degree":897,"count":35},"...",{"degree":900,"count":30}, {"degree":901,"count":55}, {"degree":902,"count":30}, {"degree":903,"count":34}, {"degree":904,"count":39}, {"degree":905,"count":31}, {"degree":906,"count":28}, {"degree":907,"count":30}, {"degree":908,"count":34}, {"degree":909,"count":26}, {"degree":910,"count":26}, {"degree":911,"count":35}, {"degree":912,"count":21}, {"degree":913,"count":15}, {"degree":914,"count":22}, {"degree":915,"count":10}, {"degree":916,"count":11}, {"degree":917,"count":11}, {"degree":918,"count":3}, {"degree":919,"count":10}, {"degree":920,"count":2}, {"degree":921,"count":4}, {"degree":922,"count":2}, {"degree":924,"count":1}, {"degree":925,"count":2}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":449449}]
Number of extensional constraints0
Number of intensional constraints449449
Distribution of constraint types[{"type":"intension","count":449449}]
Optimization problemYES
Type of objectivemin MAXIMUM

Solver Data

84.49/84.56	c
84.49/84.56	c This is cosoco 2.00 --  
84.49/84.56	c
84.49/84.56	c command line: cosoco -lc -model -restarts -stick HOME/instance-4394664-1568323957.xml 
84.49/84.56	c enable optimization
84.49/84.56	c ========================================[ Problem Statistics ]===========================================
84.49/84.56	c |                                                                                                       
84.49/84.56	c |  Parse time        :        67.82 s 
84.49/84.56	c |
84.49/84.56	c |               Variables: 1000
84.49/84.56	c |            Domain Sizes: 1000..1000
84.49/84.56	c |
84.49/84.56	c |             Constraints: 449450
84.49/84.56	c |                   Arity: 2..1000  -- Binary: 449449
84.49/84.56	c | 
84.49/84.56	c |                   Types: 
84.49/84.56	c |                          (X != Y): 449449
84.49/84.56	c |                          Max constant: 1
84.49/84.56	c |                          
84.49/84.56	c |               Objective: Minimize Max constant
84.49/84.56	
84.49/84.56	c =========================================================================================================
84.49/84.56	o 298
84.49/84.57	c    1 calls to solver(id=*d): best=0 lower=298 upper=0 
2400.03/2400.70	
2400.03/2400.70	c *** INTERRUPTED ***
2400.03/2400.70	c call to solver        : 1
2400.03/2400.70	c
2400.03/2400.70	c restarts              : 48          
2400.03/2400.70	c conflicts             : 101956       (43 /sec)
2400.03/2400.70	c decisions             : 690585       (289 /sec)
2400.03/2400.70	c propagations          : 68695712    (28705 /sec)
2400.03/2400.70	c root propagations     : 897965      
2400.03/2400.70	c filter calls          : 18800519745    (7855918 /sec)
2400.03/2400.70	c useless filter calls  : 18733971293    (99 %)
2400.03/2400.70	c Memory used           : 3504.54 MB
2400.03/2400.70	c Best bound time (wc)  : 84.5667 s
2400.03/2400.70	c CPU time              : 2393.17 s
2400.03/2400.70	c real time             : 2400.7 s
2400.03/2400.70	
2400.03/2400.70	c nb Solutions = 1
2400.03/2400.70	s SATISFIABLE
2400.03/2400.70	c Best value found: 298
2400.03/2400.70	
2400.03/2400.70	
2400.03/2400.70	v <instantiation type='solution' cost='298'>
2400.03/2400.70	v <list>x[0] x[100] x[101] x[102] x[103] x[104] x[105] x[106] x[107] x[108] x[109] x[10] x[110] x[111] x[112] x[113] x[114] x[115] x[116] x[117] x[118] x[119] x[11] x[120] x[121] x[122] x[123] x[124] x[125] x[126] x[127] x[128] x[129] x[12] x[130] x[131] x[132] x[133] x[134] x[135] x[136] x[137] x[138] x[139] x[13] x[140] x[141] x[142] x[143] x[144] x[145] x[146] x[147] x[148] x[149] x[14] x[150] x[151] x[152] x[153] x[154] x[155] x[156] x[157] x[158] x[159] x[15] x[160] x[161] x[162] x[163] x[164] x[165] x[166] x[167] x[168] x[169] x[16] x[170] x[171] x[172] x[173] x[174] x[175] x[176] x[177] x[178] x[179] x[17] x[180] x[181] x[182] x[183] x[184] x[185] x[186] x[187] x[188] x[189] x[18] x[190] x[191] x[192] x[193] x[194] x[195] x[196] x[197] x[198] x[199] x[19] x[1] x[200] x[201] x[202] x[203] x[204] x[205] x[206] x[207] x[208] x[209] x[20] x[210] x[211] x[212] x[213] x[214] x[215] x[216] x[217] x[218] x[219] x[21] x[220] x[221] x[222] x[223] x[224] x[225] x[226] x[227] x[228] x[229] x[22] x[230] x[231] x[232] x[233] x[234] x[235] x[236] x[237] x[238] x[239] x[23] x[240] x[241] x[242] x[243] x[244] x[245] x[246] x[247] x[248] x[249] x[24] x[250] x[251] x[252] x[253] x[254] x[255] x[256] x[257] x[258] x[259] x[25] x[260] x[261] x[262] x[263] x[264] x[265] x[266] x[267] x[268] x[269] x[26] x[270] x[271] x[272] x[273] x[274] x[275] x[276] x[277] x[278] x[279] x[27] x[280] x[281] x[282] x[283] x[284] x[285] x[286] x[287] x[288] x[289] x[28] x[290] x[291] x[292] x[293] x[294] x[295] x[296] x[297] x[298] x[299] x[29] x[2] x[300] x[301] x[302] x[303] x[304] x[305] x[306] x[307] x[308] x[309] x[30] x[310] x[311] x[312] x[313] x[314] x[315] x[316] x[317] x[318] x[319] x[31] x[320] x[321] x[322] x[323] x[324] x[325] x[326] x[327] x[328] x[329] x[32] x[330] x[331] x[332] x[333] x[334] x[335] x[336] x[337] x[338] x[339] x[33] x[340] x[341] x[342] x[343] x[344] x[345] x[346] x[347] x[348] x[349] x[34] x[350] x[351] x[352] x[353] x[354] x[355] x[356] x[357] x[358] x[359] x[35] x[360] x[361] x[362] x[363] x[364] x[365] x[366] x[367] x[368] x[369] x[36] x[370] x[371] x[372] x[373] x[374] x[375] x[376] x[377] x[378] x[379] x[37] x[380] x[381] x[382] x[383] x[384] x[385] x[386] x[387] x[388] x[389] x[38] x[390] x[391] x[392] x[393] x[394] x[395] x[396] x[397] x[398] x[399] x[39] x[3] x[400] x[401] x[402] x[403] x[404] x[405] x[406] x[407] x[408] x[409] x[40] x[410] x[411] x[412] x[413] x[414] x[415] x[416] x[417] x[418] x[419] x[41] x[420] x[421] x[422] x[423] x[424] x[425] x[426] x[427] x[428] x[429] x[42] x[430] x[431] x[432] x[433] x[434] x[435] x[436] x[437] x[438] x[439] x[43] x[440] x[441] x[442] x[443] x[444] x[445] x[446] x[447] x[448] x[449] x[44] x[450] x[451] x[452] x[453] x[454] x[455] x[456] x[457] x[458] x[459] x[45] x[460] x[461] x[462] x[463] x[464] x[465] x[466] x[467] x[468] x[469] x[46] x[470] x[471] x[472] x[473] x[474] x[475] x[476] x[477] x[478] x[479] x[47] x[480] x[481] x[482] x[483] x[484] x[485] x[486] x[487] x[488] x[489] x[48] x[490] x[491] x[492] x[493] x[494] x[495] x[496] x[497] x[498] x[499] x[49] x[4] x[500] x[501] x[502] x[503] x[504] x[505] x[506] x[507] x[508] x[509] x[50] x[510] x[511] x[512] x[513] x[514] x[515] x[516] x[517] x[518] x[519] x[51] x[520] x[521] x[522] x[523] x[524] x[525] x[526] x[527] x[528] x[529] x[52] x[530] x[531] x[532] x[533] x[534] x[535] x[536] x[537] x[538] x[539] x[53] x[540] x[541] x[542] x[543] x[544] x[545] x[546] x[547] x[548] x[549] x[54] x[550] x[551] x[552] x[553] x[554] x[555] x[556] x[557] x[558] x[559] x[55] x[560] x[561] x[562] x[563] x[564] x[565] x[566] x[567] x[568] x[569] x[56] x[570] x[571] x[572] x[573] x[574] x[575] x[576] x[577] x[578] x[579] x[57] x[580] x[581] x[582] x[583] x[584] x[585] x[586] x[587] x[588] x[589] x[58] x[590] x[591] x[592] x[593] x[594] x[595] x[596] x[597] x[598] x[599] x[59] x[5] x[600] x[601] x[602] x[603] x[604] x[605] x[606] x[607] x[608] x[609] x[60] x[610] x[611] x[612] x[613] x[614] x[615] x[616] x[617] x[618] x[619] x[61] x[620] x[621] x[622] x[623] x[624] x[625] x[626] x[627] x[628] x[629] x[62] x[630] x[631] x[632] x[633] x[634] x[635] x[636] x[637] x[638] x[639] x[63] x[640] x[641] x[642] x[643] x[644] x[645] x[646] x[647] x[648] x[649] x[64] x[650] x[651] x[652] x[653] x[654] x[655] x[656] x[657] x[658] x[659] x[65] x[660] x[661] x[662] x[663] x[664] x[665] x[666] x[667] x[668] x[669] x[66] x[670] x[671] x[672] x[673] x[674] x[675] x[676] x[677] x[678] x[679] x[67] x[680] x[681] x[682] x[683] x[684] x[685] x[686] x[687] x[688] x[689] x[68] x[690] x[691] x[692] x[693] x[694] x[695] x[696] x[697] x[698] x[699] x[69] x[6] x[700] x[701] x[702] x[703] x[704] x[705] x[706] x[707] x[708] x[709] x[70] x[710] x[711] x[712] x[713] x[714] x[715] x[716] x[717] x[718] x[719] x[71] x[720] x[721] x[722] x[723] x[724] x[725] x[726] x[727] x[728] x[729] x[72] x[730] x[731] x[732] x[733] x[734] x[735] x[736] x[737] x[738] x[739] x[73] x[740] x[741] x[742] x[743] x[744] x[745] x[746] x[747] x[748] x[749] x[74] x[750] x[751] x[752] x[753] x[754] x[755] x[756] x[757] x[758] x[759] x[75] x[760] x[761] x[762] x[763] x[764] x[765] x[766] x[767] x[768] x[769] x[76] x[770] x[771] x[772] x[773] x[774] x[775] x[776] x[777] x[778] x[779] x[77] x[780] x[781] x[782] x[783] x[784] x[785] x[786] x[787] x[788] x[789] x[78] x[790] x[791] x[792] x[793] x[794] x[795] x[796] x[797] x[798] x[799] x[79] x[7] x[800] x[801] x[802] x[803] x[804] x[805] x[806] x[807] x[808] x[809] x[80] x[810] x[811] x[812] x[813] x[814] x[815] x[816] x[817] x[818] x[819] x[81] x[820] x[821] x[822] x[823] x[824] x[825] x[826] x[827] x[828] x[829] x[82] x[830] x[831] x[832] x[833] x[834] x[835] x[836] x[837] x[838] x[839] x[83] x[840] x[841] x[842] x[843] x[844] x[845] x[846] x[847] x[848] x[849] x[84] x[850] x[851] x[852] x[853] x[854] x[855] x[856] x[857] x[858] x[859] x[85] x[860] x[861] x[862] x[863] x[864] x[865] x[866] x[867] x[868] x[869] x[86] x[870] x[871] x[872] x[873] x[874] x[875] x[876] x[877] x[878] x[879] x[87] x[880] x[881] x[882] x[883] x[884] x[885] x[886] x[887] x[888] x[889] x[88] x[890] x[891] x[892] x[893] x[894] x[895] x[896] x[897] x[898] x[899] x[89] x[8] x[900] x[901] x[902] x[903] x[904] x[905] x[906] x[907] x[908] x[909] x[90] x[910] x[911] x[912] x[913] x[914] x[915] x[916] x[917] x[918] x[919] x[91] x[920] x[921] x[922] x[923] x[924] x[925] x[926] x[927] x[928] x[929] x[92] x[930] x[931] x[932] x[933] x[934] x[935] x[936] x[937] x[938] x[939] x[93] x[940] x[941] x[942] x[943] x[944] x[945] x[946] x[947] x[948] x[949] x[94] x[950] x[951] x[952] x[953] x[954] x[955] x[956] x[957] x[958] x[959] x[95] x[960] x[961] x[962] x[963] x[964] x[965] x[966] x[967] x[968] x[969] x[96] x[970] x[971] x[972] x[973] x[974] x[975] x[976] x[977] x[978] x[979] x[97] x[980] x[981] x[982] x[983] x[984] x[985] x[986] x[987] x[988] x[989] x[98] x[990] x[991] x[992] x[993] x[994] x[995] x[996] x[997] x[998] x[999] x[99] x[9] </list>
2400.03/2400.70	v <values>0 46 0 119 286 10 12 37 26 28 162 22 158 29 67 19 38 79 249 43 10 51 18 295 20 291 114 154 135 118 228 26 17 171 27 77 56 274 27 29 146 81 26 220 44 255 194 118 50 56 200 115 48 226 167 76 43 204 33 73 74 178 115 28 201 52 52 285 87 187 213 86 92 148 55 59 111 19 169 91 82 78 227 89 28 84 27 130 75 175 178 4 91 23 236 29 1 269 30 70 50 143 246 23 16 16 163 24 83 106 203 6 153 113 258 111 279 101 17 162 105 107 105 63 159 66 148 281 107 122 149 138 134 2 127 83 142 3 26 100 14 288 152 164 68 229 242 253 257 275 251 21 31 13 207 103 134 216 226 58 296 127 93 67 130 253 248 210 110 264 269 268 24 91 46 260 294 243 295 5 140 45 108 217 120 109 220 239 104 139 93 142 281 275 172 223 266 46 248 45 133 4 7 119 41 254 120 32 182 170 112 35 294 211 238 65 156 95 176 98 135 15 7 261 30 224 132 14 277 196 125 175 18 42 101 82 40 221 249 159 184 32 22 58 20 70 166 76 1 241 211 220 205 12 163 38 102 80 239 121 72 45 248 126 192 128 21 26 59 33 273 149 171 55 167 50 247 39 166 153 235 139 21 146 198 102 240 276 22 270 234 131 244 194 185 233 249 247 116 144 64 197 259 20 34 107 179 77 155 190 9 266 116 179 121 41 249 235 202 199 265 88 215 231 152 123 205 172 216 271 35 115 275 279 274 244 285 267 8 73 117 180 209 120 20 150 36 37 171 262 185 187 118 122 165 44 259 232 38 194 217 273 79 94 251 132 176 245 216 262 65 168 57 40 165 106 75 90 151 162 172 134 240 71 203 0 278 277 253 186 49 77 238 144 205 155 262 143 244 23 193 109 109 297 283 27 39 288 79 65 191 206 85 230 270 208 33 222 62 241 147 8 218 214 187 46 219 113 206 142 180 242 193 230 57 274 61 211 264 17 112 245 213 62 11 227 186 129 198 177 174 76 145 148 282 36 193 164 199 236 121 232 139 222 127 233 201 240 298 280 184 99 194 171 276 61 267 85 157 188 208 236 103 95 218 241 87 154 137 169 195 40 250 252 96 198 206 141 221 157 186 174 214 221 145 212 154 94 164 282 60 226 27 158 179 181 19 141 124 119 25 54 199 253 96 243 148 190 188 123 124 234 63 84 108 257 63 286 85 264 183 215 74 2 276 280 173 80 41 175 47 66 202 126 24 165 250 122 212 55 229 82 42 180 260 228 239 161 86 228 245 266 106 103 3 227 241 58 150 149 88 284 138 183 217 189 278 170 90 97 219 81 231 200 51 126 185 97 254 73 152 59 268 284 216 282 53 158 65 60 33 129 129 102 61 173 144 93 110 292 72 287 227 193 195 15 151 87 197 260 190 189 295 136 267 52 98 43 136 90 64 161 192 290 272 111 225 254 173 246 105 224 82 256 167 245 225 49 137 222 52 232 210 237 48 71 13 149 151 178 51 159 173 224 290 267 114 53 173 47 183 191 117 37 53 2 99 160 70 119 291 200 255 146 95 117 277 285 207 25 75 289 53 204 246 19 283 128 125 166 35 263 272 271 210 177 78 287 206 83 159 5 116 261 92 218 252 136 250 74 44 237 125 161 120 112 131 115 230 62 100 212 156 72 123 100 196 247 203 54 243 268 156 88 96 37 242 98 229 269 265 99 207 55 130 121 252 97 69 132 258 145 131 110 128 49 34 14 66 256 238 259 86 49 135 131 7 265 133 71 231 222 30 292 127 192 290 271 98 213 105 161 124 80 12 273 198 57 223 150 97 11 184 24 201 69 174 92 42 155 184 32 114 11 280 100 44 141 50 153 232 15 35 86 181 89 134 153 31 256 147 191 204 68 6 237 168 104 234 69 219 265 177 182 157 34 104 197 160 113 67 94 143 257 64 42 84 63 8 158 258 261 296 18 80 160 30 152 284 39 185 57 81 179 101 75 31 61 16 233 169 293 77 76 83 170 259 64 101 14 288 126 188 214 136 51 68 189 78 4 158 102 204 138 281 62 48 89 48 223 110 176 130 112 58 40 45 0 176 60 289 140 229 60 177 137 70 263 25 215 225 235 108 79 132 47 106 108 113 54 3 166 208 186 6 270 218 181 140 56 251 195 293 196 139 74 146 182 16 133 34 168 9 246 66 25 163 263 18 255 17 13 15 22 1 12 147 283 10 9 8 128 209 5 4 3 2 1 140 36 </values>
2400.03/2400.70	v </instantiation>
2400.03/2400.70	

Verifier Data

OK	298

Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8456 MiB free)
  memory of node 1: 16384 MiB (15741 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4394664-1568323957/watcher-4394664-1568323957 -o /tmp/evaluation-result-4394664-1568323957/solver-4394664-1568323957 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568323911-7048 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4394664-1568323957.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=7261, runsolver pid=7258

[startup+0.100915 s]*
/proc/loadavg: 1.02 1.12 1.49 3/200 7262
/proc/meminfo: memFree=24766836/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=36220 memory=12360 CPUtime=0.1 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 3302 0 0 0 10 0 0 0 20 0 1 0 408668308 37089280 3090 33554432000 4194304 6210612 140725353355632 140725353352904 139707743472613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 9055 3090 807 493 0 2360 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 36220 KiB
Current children cumulated memory: 12360 KiB

[startup+0.209634 s]*
/proc/loadavg: 1.02 1.12 1.49 3/200 7262
/proc/meminfo: memFree=24761704/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=36868 memory=12804 CPUtime=0.21 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 3524 0 0 0 21 0 0 0 20 0 1 0 408668308 37752832 3201 33554432000 4194304 6210612 140725353355632 140725353352904 139707743472613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 9217 3201 807 493 0 2522 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 36868 KiB
Current children cumulated memory: 12804 KiB

[startup+0.308894 s]*
/proc/loadavg: 1.02 1.12 1.49 3/200 7262
/proc/meminfo: memFree=24756868/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=37132 memory=13064 CPUtime=0.31 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 3639 0 0 0 31 0 0 0 20 0 1 0 408668308 38023168 3266 33554432000 4194304 6210612 140725353355632 140725353352904 5816963 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 9283 3266 807 493 0 2588 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 37132 KiB
Current children cumulated memory: 13064 KiB

[startup+0.700275 s]
/proc/loadavg: 1.02 1.12 1.49 3/200 7262
/proc/meminfo: memFree=24747568/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=38956 memory=15016 CPUtime=0.69 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 4277 0 0 0 69 0 0 0 20 0 1 0 408668308 39890944 3754 33554432000 4194304 6210612 140725353355632 140725353352904 5505596 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 9739 3754 807 493 0 3044 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38956 KiB
Current children cumulated memory: 15016 KiB

[startup+1.50028 s]
/proc/loadavg: 1.02 1.12 1.49 3/200 7262
/proc/meminfo: memFree=24725520/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=42604 memory=18644 CPUtime=1.49 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 5080 0 0 0 148 1 0 0 20 0 1 0 408668308 43626496 4661 33554432000 4194304 6210612 140725353355632 140725353352904 5567401 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 10651 4661 807 493 0 3956 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 42604 KiB
Current children cumulated memory: 18644 KiB

[startup+3.10947 s]
/proc/loadavg: 1.02 1.12 1.49 4/213 7291
/proc/meminfo: memFree=24601356/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=62192 memory=28576 CPUtime=3.09 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 6905 0 0 0 308 1 0 0 20 0 1 0 408668308 63684608 7144 33554432000 4194304 6210612 140725353355632 140725353352904 5534499 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 15548 7144 807 493 0 8853 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 62192 KiB
Current children cumulated memory: 28576 KiB

[startup+6.30029 s]
/proc/loadavg: 1.02 1.11 1.49 3/200 7323
/proc/meminfo: memFree=24710516/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=115048 memory=89760 CPUtime=6.29 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 22940 0 0 0 625 4 0 0 20 0 1 0 408668308 117809152 22440 33554432000 4194304 6210612 140725353355632 140725353352904 139707743472613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 28762 22440 821 493 0 22067 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 115048 KiB
Current children cumulated memory: 89760 KiB

[startup+12.7003 s]
/proc/loadavg: 1.10 1.13 1.49 3/200 7323
/proc/meminfo: memFree=24378228/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=469140 memory=443852 CPUtime=12.69 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 113034 0 0 0 1248 21 0 0 20 0 1 0 408668308 480399360 110963 33554432000 4194304 6210612 140725353355632 140725353348520 139707743472613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 117285 110963 821 493 0 110590 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 469140 KiB
Current children cumulated memory: 443852 KiB

[startup+25.5003 s]
/proc/loadavg: 1.30 1.17 1.50 3/200 7386
/proc/meminfo: memFree=23654408/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=1178304 memory=1152800 CPUtime=25.49 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 291987 0 0 0 2495 54 0 0 20 0 1 0 408668308 1206583296 288200 33554432000 4194304 6210612 140725353355632 140725353348520 139707743472613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 294576 288200 821 493 0 287881 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 1178304 KiB
Current children cumulated memory: 1152800 KiB

[startup+51.1095 s]
/proc/loadavg: 1.54 1.24 1.51 3/200 7387
/proc/meminfo: memFree=22178844/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=2597440 memory=2571604 CPUtime=51.1 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 648456 0 0 0 4993 117 0 0 20 0 1 0 408668308 2659778560 642901 33554432000 4194304 6210612 140725353355632 140725353350072 139707743468350 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 649360 642901 821 493 0 642665 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2597440 KiB
Current children cumulated memory: 2571604 KiB

[startup+102.3 s]
/proc/loadavg: 1.80 1.35 1.54 3/201 7392
/proc/meminfo: memFree=21178200/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564168 CPUtime=102.28 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 1591201 0 0 0 10033 195 0 0 20 0 1 0 408668308 3674767360 891042 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891042 867 493 0 890465 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564168 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 1.49 1.57 3/201 7398
/proc/meminfo: memFree=21177924/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564192 CPUtime=162.25 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 2160798 0 0 0 16004 221 0 0 20 0 1 0 408668308 3674767360 891048 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891048 867 493 0 890465 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564192 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.58 1.60 3/200 7402
/proc/meminfo: memFree=21178072/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564204 CPUtime=222.23 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 2727725 0 0 0 21973 250 0 0 20 0 1 0 408668308 3674767360 891051 33554432000 4194304 6210612 140725353355632 140725353343512 5165253 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891051 867 493 0 890465 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564204 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.66 1.62 3/200 7406
/proc/meminfo: memFree=21178324/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564204 CPUtime=282.2 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 3301684 0 0 0 27942 278 0 0 20 0 1 0 408668308 3674767360 891051 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891051 867 493 0 890465 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564204 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 1.73 1.65 3/200 7412
/proc/meminfo: memFree=21176676/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564232 CPUtime=342.19 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 3857435 0 0 0 33913 306 0 0 20 0 1 0 408668308 3674767360 891058 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891058 867 493 0 890465 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564232 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 1.78 1.68 3/199 7416
/proc/meminfo: memFree=21177676/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564248 CPUtime=402.17 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 4403270 0 0 0 39886 331 0 0 20 0 1 0 408668308 3674767360 891062 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891062 867 493 0 890465 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564248 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 1.82 1.70 3/199 7420
/proc/meminfo: memFree=21177924/32770624 swapFree=67017936/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564280 CPUtime=462.15 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 4929581 0 0 0 45858 357 0 0 20 0 1 0 408668308 3674767360 891070 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891070 867 493 0 890465 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564280 KiB


################
# More data... #
################

/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1661.81 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/200 7556
/proc/meminfo: memFree=21175636/32770624 swapFree=67018016/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=1721.79 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 11571650 0 0 0 171513 666 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5397208 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1721.79 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/202 7589
/proc/meminfo: memFree=21173960/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=1781.77 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 11729741 0 0 0 177506 671 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5165355 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1781.77 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+1842.3 s]
/proc/loadavg: 2.40 2.10 1.97 3/202 7593
/proc/meminfo: memFree=21174744/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=1841.76 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 11793324 0 0 0 183502 674 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1841.76 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+1902.3 s]
/proc/loadavg: 2.37 2.17 2.00 3/202 7597
/proc/meminfo: memFree=21175272/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=1901.74 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 11842655 0 0 0 189498 676 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1901.74 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+1962.3 s]
/proc/loadavg: 2.14 2.14 2.00 3/202 7603
/proc/meminfo: memFree=21174992/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=1961.72 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 11930792 0 0 0 195492 680 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5008730 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 1961.72 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+2022.3 s]
/proc/loadavg: 2.05 2.11 2.00 3/201 7607
/proc/meminfo: memFree=21175432/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=2021.7 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12014773 0 0 0 201487 683 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5165355 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 2021.7 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+2082.3 s]
/proc/loadavg: 2.02 2.09 2.00 3/199 7611
/proc/meminfo: memFree=21174892/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564388 CPUtime=2081.68 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12041771 0 0 0 207484 684 0 0 20 0 1 0 408668308 3674767360 891097 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891097 867 493 0 890465 0
Current children cumulated CPU time: 2081.68 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564388 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.07 2.00 3/199 7617
/proc/meminfo: memFree=21174708/32770624 swapFree=67018068/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2141.66 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12090427 0 0 0 213480 686 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2141.66 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.06 2.00 3/199 7622
/proc/meminfo: memFree=21175156/32770624 swapFree=67018072/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2201.64 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12100724 0 0 0 219478 686 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5008463 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2201.64 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.05 2.00 3/199 7626
/proc/meminfo: memFree=21174088/32770624 swapFree=67018072/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2261.63 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12103032 0 0 0 225477 686 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5397222 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2261.63 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 2.00 3/200 7641
/proc/meminfo: memFree=21174080/32770624 swapFree=67018080/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2321.63 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12104957 0 0 0 231476 687 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5165240 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2321.63 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.00 3/200 7645
/proc/meminfo: memFree=21174296/32770624 swapFree=67018080/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2381.63 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12106753 0 0 0 237476 687 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5390279 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2381.63 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.7 s]
/proc/loadavg: 2.00 2.03 2.00 3/201 7647
/proc/meminfo: memFree=21174584/32770624 swapFree=67018080/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2400.03 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12107449 0 0 0 239316 687 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.71 s]
# the end of solver process 7261 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2393.17 s, system=6.88267 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.7 s]
/proc/loadavg: 2.00 2.03 2.00 3/201 7647
/proc/meminfo: memFree=21174584/32770624 swapFree=67018080/67108860
[pid=7261] ppid=7258 vsize=3588640 memory=3564772 CPUtime=2400.03 cores=0,2,4,6
/proc/7261/stat : 7261 (cosoco) R 7258 7261 7017 0 -1 4202496 12107449 0 0 0 239316 687 0 0 20 0 1 0 408668308 3674767360 891193 33554432000 4194304 6210612 140725353355632 140725353343512 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 41463808 140725353362443 140725353362545 140725353362545 140725353365454 0
/proc/7261/statm: 897160 891193 867 493 0 890465 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564772 KiB

Child status: 1
Real time (s): 2400.71
CPU time (s): 2400.05
CPU user time (s): 2393.17
CPU system time (s): 6.88267
CPU usage (%): 99.9724
Max. virtual memory (cumulated for all children) (KiB): 3595768
Max. memory (cumulated for all children) (KiB): 3570264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2393.17
system time used= 6.88267
maximum resident set size= 3573220
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 12107504
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1298
involuntary context switches= 679


# summary of solver processes directly reported to runsolver:
#   pid: 7261
#   total CPU time (s): 2400.05
#   total CPU user time (s): 2393.17
#   total CPU system time (s): 6.88267

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.11822 second user time and 17.8829 second system time

The end

Launcher Data

Begin job on node150 at 2019-09-12 23:31:57
IDJOB=4394664
IDBENCH=120547
IDSOLVER=2830
FILE ID=node150/4394664-1568323957
RUNJOBID= node150-1568323911-7048
PBS_JOBID= 21701149
Free space on /tmp= 55012 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/GraphColoring/GraphColoring-m1-mono/GraphColoring-dsjc-1000-9.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4394664-1568323957/watcher-4394664-1568323957 -o /tmp/evaluation-result-4394664-1568323957/solver-4394664-1568323957 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568323911-7048 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4394664-1568323957.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7e8c40b74266585f6434aeb3a0bbeb87
RANDOM SEED=1460768679

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24779556 kB
MemAvailable:   31820924 kB
Buffers:          156876 kB
Cached:          7033056 kB
SwapCached:         9784 kB
Active:          1172732 kB
Inactive:        6077740 kB
Active(anon):      28788 kB
Inactive(anon):    53776 kB
Active(file):    1143944 kB
Inactive(file):  6023964 kB
Unevictable:      109520 kB
Mlocked:          109520 kB
SwapTotal:      67108860 kB
SwapFree:       67017936 kB
Dirty:             21044 kB
Writeback:             0 kB
AnonPages:        163880 kB
Mapped:            37520 kB
Shmem:             13284 kB
Slab:             332356 kB
SReclaimable:     301920 kB
SUnreclaim:        30436 kB
KernelStack:        3680 kB
PageTables:         5540 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     545492 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       99712 kB
DirectMap2M:    33445888 kB

Free space on /tmp at the end= 55012 MiB
End job on node150 at 2019-09-13 00:11:58