Trace number 4397568

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0SAT (TO)298 2400.1 2400.91

General information on the benchmark

NameGraphColoring/GraphColoring-m1-mono/
GraphColoring-dsjc-1000-9.xml
MD5SUM7e8c40b74266585f6434aeb3a0bbeb87
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark298
Best CPU time to get the best result obtained on this benchmark2400.05
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of constraints449449
Number of domains1
Minimum domain size1000
Maximum domain size1000
Distribution of domain sizes[{"size":1000,"count":1000}]
Minimum variable degree871
Maximum variable degree925
Distribution of variable degrees[{"degree":871,"count":2},{"degree":873,"count":1},{"degree":874,"count":3},{"degree":875,"count":3},{"degree":876,"count":2},{"degree":877,"count":3},{"degree":879,"count":5},{"degree":880,"count":3},{"degree":881,"count":2},{"degree":882,"count":6},{"degree":883,"count":13},{"degree":884,"count":11},{"degree":885,"count":11},{"degree":886,"count":12},{"degree":887,"count":29},{"degree":888,"count":21},{"degree":889,"count":31},{"degree":890,"count":18},{"degree":891,"count":21},{"degree":892,"count":24},{"degree":893,"count":29},{"degree":894,"count":36},{"degree":895,"count":34},{"degree":896,"count":37},{"degree":897,"count":35},"...",{"degree":900,"count":30}, {"degree":901,"count":55}, {"degree":902,"count":30}, {"degree":903,"count":34}, {"degree":904,"count":39}, {"degree":905,"count":31}, {"degree":906,"count":28}, {"degree":907,"count":30}, {"degree":908,"count":34}, {"degree":909,"count":26}, {"degree":910,"count":26}, {"degree":911,"count":35}, {"degree":912,"count":21}, {"degree":913,"count":15}, {"degree":914,"count":22}, {"degree":915,"count":10}, {"degree":916,"count":11}, {"degree":917,"count":11}, {"degree":918,"count":3}, {"degree":919,"count":10}, {"degree":920,"count":2}, {"degree":921,"count":4}, {"degree":922,"count":2}, {"degree":924,"count":1}, {"degree":925,"count":2}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":449449}]
Number of extensional constraints0
Number of intensional constraints449449
Distribution of constraint types[{"type":"intension","count":449449}]
Optimization problemYES
Type of objectivemin MAXIMUM

Solver Data

85.35/85.43	c
85.35/85.43	c This is cosoco 2.00 --  
85.35/85.43	c
85.35/85.43	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397568-1568572784.xml 
85.35/85.43	c enable optimization
85.35/85.43	c ========================================[ Problem Statistics ]===========================================
85.35/85.43	c |                                                                                                       
85.35/85.43	c |  Parse time        :        69.13 s 
85.35/85.43	c |
85.35/85.43	c |               Variables: 1000
85.35/85.43	c |            Domain Sizes: 1000..1000
85.35/85.43	c |
85.35/85.43	c |             Constraints: 449450
85.35/85.43	c |                   Arity: 2..1000  -- Binary: 449449
85.35/85.43	c | 
85.35/85.43	c |                   Types: 
85.35/85.43	c |                          (X != Y): 449449
85.35/85.43	c |                          Max constant: 1
85.35/85.43	c |                          
85.35/85.43	c |               Objective: Minimize Max constant
85.35/85.43	
85.35/85.43	c =========================================================================================================
85.35/85.43	o 298
85.35/85.43	c    1 calls to solver(id=*d): best=0 lower=298 upper=0 
2400.09/2400.90	
2400.09/2400.90	c *** INTERRUPTED ***
2400.09/2400.90	c call to solver        : 1
2400.09/2400.90	c
2400.09/2400.90	c restarts              : 48          
2400.09/2400.90	c conflicts             : 99021        (41 /sec)
2400.09/2400.90	c decisions             : 671481       (281 /sec)
2400.09/2400.90	c propagations          : 66946580    (27972 /sec)
2400.09/2400.90	c root propagations     : 897965      
2400.09/2400.90	c filter calls          : 18430605469    (7700881 /sec)
2400.09/2400.90	c useless filter calls  : 18365765006    (99 %)
2400.09/2400.90	c Memory used           : 3504.54 MB
2400.09/2400.90	c Best bound time (wc)  : 85.4271 s
2400.09/2400.90	c CPU time              : 2393.31 s
2400.09/2400.90	c real time             : 2400.9 s
2400.09/2400.90	
2400.09/2400.90	c nb Solutions = 1
2400.09/2400.90	s SATISFIABLE
2400.09/2400.90	c Best value found: 298
2400.09/2400.90	
2400.09/2400.90	
2400.09/2400.90	v <instantiation type='solution' cost='298'>
2400.09/2400.90	v <list>x[0] x[100] x[101] x[102] x[103] x[104] x[105] x[106] x[107] x[108] x[109] x[10] x[110] x[111] x[112] x[113] x[114] x[115] x[116] x[117] x[118] x[119] x[11] x[120] x[121] x[122] x[123] x[124] x[125] x[126] x[127] x[128] x[129] x[12] x[130] x[131] x[132] x[133] x[134] x[135] x[136] x[137] x[138] x[139] x[13] x[140] x[141] x[142] x[143] x[144] x[145] x[146] x[147] x[148] x[149] x[14] x[150] x[151] x[152] x[153] x[154] x[155] x[156] x[157] x[158] x[159] x[15] x[160] x[161] x[162] x[163] x[164] x[165] x[166] x[167] x[168] x[169] x[16] x[170] x[171] x[172] x[173] x[174] x[175] x[176] x[177] x[178] x[179] x[17] x[180] x[181] x[182] x[183] x[184] x[185] x[186] x[187] x[188] x[189] x[18] x[190] x[191] x[192] x[193] x[194] x[195] x[196] x[197] x[198] x[199] x[19] x[1] x[200] x[201] x[202] x[203] x[204] x[205] x[206] x[207] x[208] x[209] x[20] x[210] x[211] x[212] x[213] x[214] x[215] x[216] x[217] x[218] x[219] x[21] x[220] x[221] x[222] x[223] x[224] x[225] x[226] x[227] x[228] x[229] x[22] x[230] x[231] x[232] x[233] x[234] x[235] x[236] x[237] x[238] x[239] x[23] x[240] x[241] x[242] x[243] x[244] x[245] x[246] x[247] x[248] x[249] x[24] x[250] x[251] x[252] x[253] x[254] x[255] x[256] x[257] x[258] x[259] x[25] x[260] x[261] x[262] x[263] x[264] x[265] x[266] x[267] x[268] x[269] x[26] x[270] x[271] x[272] x[273] x[274] x[275] x[276] x[277] x[278] x[279] x[27] x[280] x[281] x[282] x[283] x[284] x[285] x[286] x[287] x[288] x[289] x[28] x[290] x[291] x[292] x[293] x[294] x[295] x[296] x[297] x[298] x[299] x[29] x[2] x[300] x[301] x[302] x[303] x[304] x[305] x[306] x[307] x[308] x[309] x[30] x[310] x[311] x[312] x[313] x[314] x[315] x[316] x[317] x[318] x[319] x[31] x[320] x[321] x[322] x[323] x[324] x[325] x[326] x[327] x[328] x[329] x[32] x[330] x[331] x[332] x[333] x[334] x[335] x[336] x[337] x[338] x[339] x[33] x[340] x[341] x[342] x[343] x[344] x[345] x[346] x[347] x[348] x[349] x[34] x[350] x[351] x[352] x[353] x[354] x[355] x[356] x[357] x[358] x[359] x[35] x[360] x[361] x[362] x[363] x[364] x[365] x[366] x[367] x[368] x[369] x[36] x[370] x[371] x[372] x[373] x[374] x[375] x[376] x[377] x[378] x[379] x[37] x[380] x[381] x[382] x[383] x[384] x[385] x[386] x[387] x[388] x[389] x[38] x[390] x[391] x[392] x[393] x[394] x[395] x[396] x[397] x[398] x[399] x[39] x[3] x[400] x[401] x[402] x[403] x[404] x[405] x[406] x[407] x[408] x[409] x[40] x[410] x[411] x[412] x[413] x[414] x[415] x[416] x[417] x[418] x[419] x[41] x[420] x[421] x[422] x[423] x[424] x[425] x[426] x[427] x[428] x[429] x[42] x[430] x[431] x[432] x[433] x[434] x[435] x[436] x[437] x[438] x[439] x[43] x[440] x[441] x[442] x[443] x[444] x[445] x[446] x[447] x[448] x[449] x[44] x[450] x[451] x[452] x[453] x[454] x[455] x[456] x[457] x[458] x[459] x[45] x[460] x[461] x[462] x[463] x[464] x[465] x[466] x[467] x[468] x[469] x[46] x[470] x[471] x[472] x[473] x[474] x[475] x[476] x[477] x[478] x[479] x[47] x[480] x[481] x[482] x[483] x[484] x[485] x[486] x[487] x[488] x[489] x[48] x[490] x[491] x[492] x[493] x[494] x[495] x[496] x[497] x[498] x[499] x[49] x[4] x[500] x[501] x[502] x[503] x[504] x[505] x[506] x[507] x[508] x[509] x[50] x[510] x[511] x[512] x[513] x[514] x[515] x[516] x[517] x[518] x[519] x[51] x[520] x[521] x[522] x[523] x[524] x[525] x[526] x[527] x[528] x[529] x[52] x[530] x[531] x[532] x[533] x[534] x[535] x[536] x[537] x[538] x[539] x[53] x[540] x[541] x[542] x[543] x[544] x[545] x[546] x[547] x[548] x[549] x[54] x[550] x[551] x[552] x[553] x[554] x[555] x[556] x[557] x[558] x[559] x[55] x[560] x[561] x[562] x[563] x[564] x[565] x[566] x[567] x[568] x[569] x[56] x[570] x[571] x[572] x[573] x[574] x[575] x[576] x[577] x[578] x[579] x[57] x[580] x[581] x[582] x[583] x[584] x[585] x[586] x[587] x[588] x[589] x[58] x[590] x[591] x[592] x[593] x[594] x[595] x[596] x[597] x[598] x[599] x[59] x[5] x[600] x[601] x[602] x[603] x[604] x[605] x[606] x[607] x[608] x[609] x[60] x[610] x[611] x[612] x[613] x[614] x[615] x[616] x[617] x[618] x[619] x[61] x[620] x[621] x[622] x[623] x[624] x[625] x[626] x[627] x[628] x[629] x[62] x[630] x[631] x[632] x[633] x[634] x[635] x[636] x[637] x[638] x[639] x[63] x[640] x[641] x[642] x[643] x[644] x[645] x[646] x[647] x[648] x[649] x[64] x[650] x[651] x[652] x[653] x[654] x[655] x[656] x[657] x[658] x[659] x[65] x[660] x[661] x[662] x[663] x[664] x[665] x[666] x[667] x[668] x[669] x[66] x[670] x[671] x[672] x[673] x[674] x[675] x[676] x[677] x[678] x[679] x[67] x[680] x[681] x[682] x[683] x[684] x[685] x[686] x[687] x[688] x[689] x[68] x[690] x[691] x[692] x[693] x[694] x[695] x[696] x[697] x[698] x[699] x[69] x[6] x[700] x[701] x[702] x[703] x[704] x[705] x[706] x[707] x[708] x[709] x[70] x[710] x[711] x[712] x[713] x[714] x[715] x[716] x[717] x[718] x[719] x[71] x[720] x[721] x[722] x[723] x[724] x[725] x[726] x[727] x[728] x[729] x[72] x[730] x[731] x[732] x[733] x[734] x[735] x[736] x[737] x[738] x[739] x[73] x[740] x[741] x[742] x[743] x[744] x[745] x[746] x[747] x[748] x[749] x[74] x[750] x[751] x[752] x[753] x[754] x[755] x[756] x[757] x[758] x[759] x[75] x[760] x[761] x[762] x[763] x[764] x[765] x[766] x[767] x[768] x[769] x[76] x[770] x[771] x[772] x[773] x[774] x[775] x[776] x[777] x[778] x[779] x[77] x[780] x[781] x[782] x[783] x[784] x[785] x[786] x[787] x[788] x[789] x[78] x[790] x[791] x[792] x[793] x[794] x[795] x[796] x[797] x[798] x[799] x[79] x[7] x[800] x[801] x[802] x[803] x[804] x[805] x[806] x[807] x[808] x[809] x[80] x[810] x[811] x[812] x[813] x[814] x[815] x[816] x[817] x[818] x[819] x[81] x[820] x[821] x[822] x[823] x[824] x[825] x[826] x[827] x[828] x[829] x[82] x[830] x[831] x[832] x[833] x[834] x[835] x[836] x[837] x[838] x[839] x[83] x[840] x[841] x[842] x[843] x[844] x[845] x[846] x[847] x[848] x[849] x[84] x[850] x[851] x[852] x[853] x[854] x[855] x[856] x[857] x[858] x[859] x[85] x[860] x[861] x[862] x[863] x[864] x[865] x[866] x[867] x[868] x[869] x[86] x[870] x[871] x[872] x[873] x[874] x[875] x[876] x[877] x[878] x[879] x[87] x[880] x[881] x[882] x[883] x[884] x[885] x[886] x[887] x[888] x[889] x[88] x[890] x[891] x[892] x[893] x[894] x[895] x[896] x[897] x[898] x[899] x[89] x[8] x[900] x[901] x[902] x[903] x[904] x[905] x[906] x[907] x[908] x[909] x[90] x[910] x[911] x[912] x[913] x[914] x[915] x[916] x[917] x[918] x[919] x[91] x[920] x[921] x[922] x[923] x[924] x[925] x[926] x[927] x[928] x[929] x[92] x[930] x[931] x[932] x[933] x[934] x[935] x[936] x[937] x[938] x[939] x[93] x[940] x[941] x[942] x[943] x[944] x[945] x[946] x[947] x[948] x[949] x[94] x[950] x[951] x[952] x[953] x[954] x[955] x[956] x[957] x[958] x[959] x[95] x[960] x[961] x[962] x[963] x[964] x[965] x[966] x[967] x[968] x[969] x[96] x[970] x[971] x[972] x[973] x[974] x[975] x[976] x[977] x[978] x[979] x[97] x[980] x[981] x[982] x[983] x[984] x[985] x[986] x[987] x[988] x[989] x[98] x[990] x[991] x[992] x[993] x[994] x[995] x[996] x[997] x[998] x[999] x[99] x[9] </list>
2400.09/2400.90	v <values>0 46 0 119 286 10 12 37 26 28 162 22 158 29 67 19 38 79 249 43 10 51 18 295 20 291 114 154 135 118 228 26 17 171 27 77 56 274 27 29 146 81 26 220 44 255 194 118 50 56 200 115 48 226 167 76 43 204 33 73 74 178 115 28 201 52 52 285 87 187 213 86 92 148 55 59 111 19 169 91 82 78 227 89 28 84 27 130 75 175 178 4 91 23 236 29 1 269 30 70 50 143 246 23 16 16 163 24 83 106 203 6 153 113 258 111 279 101 17 162 105 107 105 63 159 66 148 281 107 122 149 138 134 2 127 83 142 3 26 100 14 288 152 164 68 229 242 253 257 275 251 21 31 13 207 103 134 216 226 58 296 127 93 67 130 253 248 210 110 264 269 268 24 91 46 260 294 243 295 5 140 45 108 217 120 109 220 239 104 139 93 142 281 275 172 223 266 46 248 45 133 4 7 119 41 254 120 32 182 170 112 35 294 211 238 65 156 95 176 98 135 15 7 261 30 224 132 14 277 196 125 175 18 42 101 82 40 221 249 159 184 32 22 58 20 70 166 76 1 241 211 220 205 12 163 38 102 80 239 121 72 45 248 126 192 128 21 26 59 33 273 149 171 55 167 50 247 39 166 153 235 139 21 146 198 102 240 276 22 270 234 131 244 194 185 233 249 247 116 144 64 197 259 20 34 107 179 77 155 190 9 266 116 179 121 41 249 235 202 199 265 88 215 231 152 123 205 172 216 271 35 115 275 279 274 244 285 267 8 73 117 180 209 120 20 150 36 37 171 262 185 187 118 122 165 44 259 232 38 194 217 273 79 94 251 132 176 245 216 262 65 168 57 40 165 106 75 90 151 162 172 134 240 71 203 0 278 277 253 186 49 77 238 144 205 155 262 143 244 23 193 109 109 297 283 27 39 288 79 65 191 206 85 230 270 208 33 222 62 241 147 8 218 214 187 46 219 113 206 142 180 242 193 230 57 274 61 211 264 17 112 245 213 62 11 227 186 129 198 177 174 76 145 148 282 36 193 164 199 236 121 232 139 222 127 233 201 240 298 280 184 99 194 171 276 61 267 85 157 188 208 236 103 95 218 241 87 154 137 169 195 40 250 252 96 198 206 141 221 157 186 174 214 221 145 212 154 94 164 282 60 226 27 158 179 181 19 141 124 119 25 54 199 253 96 243 148 190 188 123 124 234 63 84 108 257 63 286 85 264 183 215 74 2 276 280 173 80 41 175 47 66 202 126 24 165 250 122 212 55 229 82 42 180 260 228 239 161 86 228 245 266 106 103 3 227 241 58 150 149 88 284 138 183 217 189 278 170 90 97 219 81 231 200 51 126 185 97 254 73 152 59 268 284 216 282 53 158 65 60 33 129 129 102 61 173 144 93 110 292 72 287 227 193 195 15 151 87 197 260 190 189 295 136 267 52 98 43 136 90 64 161 192 290 272 111 225 254 173 246 105 224 82 256 167 245 225 49 137 222 52 232 210 237 48 71 13 149 151 178 51 159 173 224 290 267 114 53 173 47 183 191 117 37 53 2 99 160 70 119 291 200 255 146 95 117 277 285 207 25 75 289 53 204 246 19 283 128 125 166 35 263 272 271 210 177 78 287 206 83 159 5 116 261 92 218 252 136 250 74 44 237 125 161 120 112 131 115 230 62 100 212 156 72 123 100 196 247 203 54 243 268 156 88 96 37 242 98 229 269 265 99 207 55 130 121 252 97 69 132 258 145 131 110 128 49 34 14 66 256 238 259 86 49 135 131 7 265 133 71 231 222 30 292 127 192 290 271 98 213 105 161 124 80 12 273 198 57 223 150 97 11 184 24 201 69 174 92 42 155 184 32 114 11 280 100 44 141 50 153 232 15 35 86 181 89 134 153 31 256 147 191 204 68 6 237 168 104 234 69 219 265 177 182 157 34 104 197 160 113 67 94 143 257 64 42 84 63 8 158 258 261 296 18 80 160 30 152 284 39 185 57 81 179 101 75 31 61 16 233 169 293 77 76 83 170 259 64 101 14 288 126 188 214 136 51 68 189 78 4 158 102 204 138 281 62 48 89 48 223 110 176 130 112 58 40 45 0 176 60 289 140 229 60 177 137 70 263 25 215 225 235 108 79 132 47 106 108 113 54 3 166 208 186 6 270 218 181 140 56 251 195 293 196 139 74 146 182 16 133 34 168 9 246 66 25 163 263 18 255 17 13 15 22 1 12 147 283 10 9 8 128 209 5 4 3 2 1 140 36 </values>
2400.09/2400.90	v </instantiation>
2400.09/2400.90	

Verifier Data

OK	298

Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15200 MiB free)
  memory of node 1: 16384 MiB (15576 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397568-1568572784/watcher-4397568-1568572784 -o /tmp/evaluation-result-4397568-1568572784/solver-4397568-1568572784 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node132-1568572734-23144 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397568-1568572784.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23174, runsolver pid=23171

[startup+0.100107 s]*
/proc/loadavg: 0.17 0.05 0.06 3/205 23175
/proc/meminfo: memFree=31505008/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=36028 memory=12104 CPUtime=0.09 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 3250 0 0 0 9 0 0 0 20 0 1 0 433201138 36892672 3026 33554432000 4194304 6211092 140731003957056 140731003953592 5817119 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 9007 3026 807 493 0 2312 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 36028 KiB
Current children cumulated memory: 12104 KiB

[startup+0.209808 s]*
/proc/loadavg: 0.17 0.05 0.06 3/205 23175
/proc/meminfo: memFree=31499520/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=36868 memory=12800 CPUtime=0.2 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 3520 0 0 0 20 0 0 0 20 0 1 0 433201138 37752832 3200 33554432000 4194304 6211092 140731003957056 140731003953592 5483291 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 9217 3200 807 493 0 2522 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 36868 KiB
Current children cumulated memory: 12800 KiB

[startup+0.309337 s]*
/proc/loadavg: 0.17 0.05 0.06 3/205 23175
/proc/meminfo: memFree=31495428/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=37132 memory=13060 CPUtime=0.3 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 3637 0 0 0 30 0 0 0 20 0 1 0 433201138 38023168 3265 33554432000 4194304 6211092 140731003957056 140731003953592 139714440430720 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 9283 3265 807 493 0 2588 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 37132 KiB
Current children cumulated memory: 13060 KiB

[startup+0.700236 s]
/proc/loadavg: 0.17 0.05 0.06 3/205 23175
/proc/meminfo: memFree=31485632/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=38956 memory=15012 CPUtime=0.69 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 4275 0 0 0 68 1 0 0 20 0 1 0 433201138 39890944 3753 33554432000 4194304 6211092 140731003957056 140731003953592 5812177 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 9739 3753 807 493 0 3044 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38956 KiB
Current children cumulated memory: 15012 KiB

[startup+1.50024 s]
/proc/loadavg: 0.17 0.05 0.06 3/205 23175
/proc/meminfo: memFree=31464552/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=42604 memory=18652 CPUtime=1.49 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 5587 0 0 0 148 1 0 0 20 0 1 0 433201138 43626496 4663 33554432000 4194304 6211092 140731003957056 140731003954328 5735364 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 10651 4663 807 493 0 3956 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 42604 KiB
Current children cumulated memory: 18652 KiB

[startup+3.10989 s]
/proc/loadavg: 0.17 0.05 0.06 6/218 23204
/proc/meminfo: memFree=31464544/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=49900 memory=26100 CPUtime=3.1 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 7228 0 0 0 308 2 0 0 20 0 1 0 433201138 51097600 6525 33554432000 4194304 6211092 140731003957056 140731003954328 5538428 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 12475 6525 807 493 0 5780 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 49900 KiB
Current children cumulated memory: 26100 KiB

[startup+6.30025 s]
/proc/loadavg: 0.39 0.10 0.07 3/205 23236
/proc/meminfo: memFree=31425636/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=112408 memory=87752 CPUtime=6.29 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 23097 0 0 0 622 7 0 0 20 0 1 0 433201138 115105792 21938 33554432000 4194304 6211092 140731003957056 140731003951496 5444604 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 28102 21938 822 493 0 21407 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 112408 KiB
Current children cumulated memory: 87752 KiB

[startup+12.7003 s]
/proc/loadavg: 0.44 0.11 0.08 3/205 23236
/proc/meminfo: memFree=31101140/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=458052 memory=433600 CPUtime=12.69 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 111238 0 0 0 1244 25 0 0 20 0 1 0 433201138 469045248 108400 33554432000 4194304 6211092 140731003957056 140731003951896 139714424368101 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 114513 108400 822 493 0 107818 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 458052 KiB
Current children cumulated memory: 433600 KiB

[startup+25.5003 s]
/proc/loadavg: 0.79 0.21 0.11 3/206 23239
/proc/meminfo: memFree=30396664/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=1149924 memory=1124928 CPUtime=25.47 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 285852 0 0 0 2489 58 0 0 20 0 1 0 433201138 1177522176 281232 33554432000 4194304 6211092 140731003957056 140731003949944 139714424368101 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 287481 281232 822 493 0 280786 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 1149924 KiB
Current children cumulated memory: 1124928 KiB

[startup+51.11 s]
/proc/loadavg: 1.12 0.33 0.15 3/205 23239
/proc/meminfo: memFree=28989204/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=2535928 memory=2510504 CPUtime=51.08 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 634468 0 0 0 4983 125 0 0 20 0 1 0 433201138 2596790272 627626 33554432000 4194304 6211092 140731003957056 140731003951496 139714424368101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 633982 627626 822 493 0 627287 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 2535928 KiB
Current children cumulated memory: 2510504 KiB

[startup+102.3 s]
/proc/loadavg: 1.62 0.59 0.25 3/205 23248
/proc/meminfo: memFree=27926360/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563292 CPUtime=102.24 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 1583511 0 0 0 10021 203 0 0 20 0 1 0 433201138 3674767360 890823 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890823 868 493 0 890465 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563292 KiB

[startup+162.3 s]
/proc/loadavg: 1.86 0.85 0.36 3/205 23255
/proc/meminfo: memFree=27927016/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563300 CPUtime=162.21 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 2157149 0 0 0 15994 227 0 0 20 0 1 0 433201138 3674767360 890825 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890825 868 493 0 890465 0
Current children cumulated CPU time: 162.21 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563300 KiB

[startup+222.3 s]
/proc/loadavg: 1.95 1.06 0.46 3/205 23259
/proc/meminfo: memFree=27926080/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563328 CPUtime=222.18 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 2743640 0 0 0 21964 254 0 0 20 0 1 0 433201138 3674767360 890832 33554432000 4194304 6211092 140731003957056 140731003944936 5165723 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890832 868 493 0 890465 0
Current children cumulated CPU time: 222.18 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563328 KiB

[startup+282.3 s]
/proc/loadavg: 1.98 1.23 0.56 3/204 23263
/proc/meminfo: memFree=27925596/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563328 CPUtime=282.15 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 3296736 0 0 0 27936 279 0 0 20 0 1 0 433201138 3674767360 890832 33554432000 4194304 6211092 140731003957056 140731003944936 5165725 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890832 868 493 0 890465 0
Current children cumulated CPU time: 282.15 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563328 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 1.37 0.65 3/204 23269
/proc/meminfo: memFree=27926128/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563336 CPUtime=342.14 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 3839390 0 0 0 33908 306 0 0 20 0 1 0 433201138 3674767360 890834 33554432000 4194304 6211092 140731003957056 140731003944936 5008827 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890834 868 493 0 890465 0
Current children cumulated CPU time: 342.14 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563336 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.48 0.73 3/204 23273
/proc/meminfo: memFree=27925780/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563372 CPUtime=402.11 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 4371481 0 0 0 39878 333 0 0 20 0 1 0 433201138 3674767360 890843 33554432000 4194304 6211092 140731003957056 140731003944936 5165624 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890843 868 493 0 890465 0
Current children cumulated CPU time: 402.11 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563372 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.58 0.81 3/204 23278
/proc/meminfo: memFree=27925688/32770624 swapFree=67010764/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563404 CPUtime=462.08 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 4881613 0 0 0 45853 355 0 0 20 0 1 0 433201138 3674767360 890851 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890851 868 493 0 890465 0
Current children cumulated CPU time: 462.08 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563404 KiB


################
# More data... #
################

/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1661.66 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 1.71 3/204 23536
/proc/meminfo: memFree=27949024/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=1721.64 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11495781 0 0 0 171505 659 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5390468 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1721.64 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.73 3/204 23543
/proc/meminfo: memFree=27948972/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=1781.62 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11555777 0 0 0 177501 661 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5165604 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1781.62 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 1.75 3/204 23547
/proc/meminfo: memFree=27949056/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=1841.59 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11687467 0 0 0 183493 666 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1841.59 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 1.77 3/204 23556
/proc/meminfo: memFree=27949148/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=1901.58 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11735822 0 0 0 189489 669 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5165608 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1901.58 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 1.78 3/205 23563
/proc/meminfo: memFree=27948948/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=1961.56 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11829882 0 0 0 195483 673 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5390468 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 1961.56 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 1.79 3/205 23567
/proc/meminfo: memFree=27948992/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3563512 CPUtime=2021.54 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11857258 0 0 0 201480 674 0 0 20 0 1 0 433201138 3674767360 890878 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 890878 868 493 0 890465 0
Current children cumulated CPU time: 2021.54 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3563512 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.80 3/205 23571
/proc/meminfo: memFree=27947968/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2081.53 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11907917 0 0 0 207477 676 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5390468 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2081.53 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

[startup+2142.3 s]
/proc/loadavg: 1.91 2.00 1.81 3/205 23642
/proc/meminfo: memFree=27946284/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2141.51 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11921176 0 0 0 213474 677 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5008987 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2141.51 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

[startup+2202.3 s]
/proc/loadavg: 1.96 2.00 1.82 3/205 23710
/proc/meminfo: memFree=27948356/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2201.49 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11936912 0 0 0 219472 677 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2201.49 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

[startup+2262.3 s]
/proc/loadavg: 1.91 1.98 1.83 3/204 23777
/proc/meminfo: memFree=27947780/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2261.49 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11939186 0 0 0 225472 677 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2261.49 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

[startup+2322.3 s]
/proc/loadavg: 1.97 1.99 1.84 3/205 23784
/proc/meminfo: memFree=27946936/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2321.49 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11941800 0 0 0 231471 678 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5008971 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2321.49 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

[startup+2382.3 s]
/proc/loadavg: 1.99 1.99 1.85 3/206 23790
/proc/meminfo: memFree=27946560/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2381.49 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11943927 0 0 0 237471 678 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5009182 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2381.49 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.9 s]
/proc/loadavg: 1.99 1.99 1.85 3/206 23790
/proc/meminfo: memFree=27946468/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2400.09 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11944567 0 0 0 239331 678 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5165725 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.91 s]
# the end of solver process 23174 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2393.31 s, system=6.79244 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.9 s]
/proc/loadavg: 1.99 1.99 1.85 3/206 23790
/proc/meminfo: memFree=27946468/32770624 swapFree=67010780/67108860
[pid=23174] ppid=23171 vsize=3588640 memory=3564776 CPUtime=2400.09 cores=0,2,4,6
/proc/23174/stat : 23174 (cosoco) R 23171 23174 23113 0 -1 4202496 11944567 0 0 0 239331 678 0 0 20 0 1 0 433201138 3674767360 891194 33554432000 4194304 6211092 140731003957056 140731003944936 5165725 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 13004800 140731003958283 140731003958385 140731003958385 140731003961294 0
/proc/23174/statm: 897160 891194 868 493 0 890465 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 3588640 KiB
Current children cumulated memory: 3564776 KiB

Child status: 1
Real time (s): 2400.91
CPU time (s): 2400.1
CPU user time (s): 2393.31
CPU system time (s): 6.79244
CPU usage (%): 99.9663
Max. virtual memory (cumulated for all children) (KiB): 3595900
Max. memory (cumulated for all children) (KiB): 3569908

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2393.31
system time used= 6.79244
maximum resident set size= 3572960
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11944622
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1337
involuntary context switches= 770


# summary of solver processes directly reported to runsolver:
#   pid: 23174
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2393.31
#   total CPU system time (s): 6.79244

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.54442 second user time and 18.6948 second system time

The end

Launcher Data

Begin job on node132 at 2019-09-15 20:38:55
IDJOB=4397568
IDBENCH=120547
IDSOLVER=2849
FILE ID=node132/4397568-1568572784
RUNJOBID= node132-1568572734-23144
PBS_JOBID= 21703322
Free space on /tmp= 61608 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/GraphColoring/GraphColoring-m1-mono/GraphColoring-dsjc-1000-9.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397568-1568572784/watcher-4397568-1568572784 -o /tmp/evaluation-result-4397568-1568572784/solver-4397568-1568572784 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node132-1568572734-23144 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397568-1568572784.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7e8c40b74266585f6434aeb3a0bbeb87
RANDOM SEED=1868918536

node132.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31515864 kB
MemAvailable:   31910280 kB
Buffers:           93496 kB
Cached:           578568 kB
SwapCached:         6012 kB
Active:           422604 kB
Inactive:         258956 kB
Active(anon):       6888 kB
Inactive(anon):    32432 kB
Active(file):     415716 kB
Inactive(file):   226524 kB
Unevictable:      109868 kB
Mlocked:          109868 kB
SwapTotal:      67108860 kB
SwapFree:       67010764 kB
Dirty:             20484 kB
Writeback:             0 kB
AnonPages:        115844 kB
Mapped:            35456 kB
Shmem:             20556 kB
Slab:             164632 kB
SReclaimable:     136024 kB
SUnreclaim:        28608 kB
KernelStack:        3376 kB
PageTables:         6532 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     507612 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      136576 kB
DirectMap2M:    33409024 kB

Free space on /tmp at the end= 61604 MiB
End job on node132 at 2019-09-15 21:18:56