Trace number 4293610

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 1.12SAT (TO)18 2520.08 2520.01

General information on the benchmark

NameRlfap/Rlfap-opt/
Rlfap-graph-09-opt_c18.xml
MD5SUM2788969af340f57bdb68eae00f77e52f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark18
Best CPU time to get the best result obtained on this benchmark2520.08
Satisfiable
(Un)Satisfiability was proved
Number of variables916
Number of constraints5246
Number of domains7
Minimum domain size6
Maximum domain size44
Distribution of domain sizes[{"size":6,"count":2},{"size":22,"count":10},{"size":24,"count":2},{"size":36,"count":408},{"size":42,"count":306},{"size":44,"count":188}]
Minimum variable degree2
Maximum variable degree38
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":10},{"degree":4,"count":22},{"degree":5,"count":38},{"degree":6,"count":81},{"degree":7,"count":93},{"degree":8,"count":105},{"degree":9,"count":86},{"degree":10,"count":68},{"degree":11,"count":42},{"degree":12,"count":24},{"degree":13,"count":14},{"degree":14,"count":4},{"degree":15,"count":2},{"degree":16,"count":10},{"degree":17,"count":3},{"degree":18,"count":32},{"degree":19,"count":53},{"degree":20,"count":77},{"degree":21,"count":81},{"degree":22,"count":42},{"degree":23,"count":14},{"degree":24,"count":9},{"degree":25,"count":2},{"degree":26,"count":1},{"degree":38,"count":2}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":5246}]
Number of extensional constraints0
Number of intensional constraints5246
Distribution of constraint types[{"type":"intension","count":5246}]
Optimization problemYES
Type of objectivemin NVALUES

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

2.49/2.54	c best=?? lower=1 upper=916 
3.69/3.74	c
3.69/3.74	c This is cosoco 1.12 --  
3.69/3.74	c
3.69/3.74	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4293610-1532320807.xml 
3.69/3.74	c enable optimization
3.69/3.74	c ========================================[ Problem Statistics ]===========================================
3.69/3.74	c |                                                                                                       
3.69/3.74	c |  Parse time        :         2.49 s 
3.69/3.74	c |
3.69/3.74	c |               Variables: 916
3.69/3.74	c |            Domain Sizes: 6..44
3.69/3.74	c |
3.69/3.74	c |             Constraints: 5247
3.69/3.74	c |                   Arity: 2..916  -- Binary: 5246
3.69/3.74	c | 
3.69/3.74	c |                   Types: 
3.69/3.74	c |                          Intension: 5246
3.69/3.74	c |                          NValues <= k: 1
3.69/3.74	c |                          
3.69/3.74	c |               Objective: Minimize NValues <= k
3.69/3.74	
3.69/3.74	c =========================================================================================================
3.69/3.74	o 44
3.69/3.74	c    1 calls to solver: best=44 lower=1 upper=43 
4.69/4.75	o 42
5.69/5.75	o 40
5.69/5.75	c    3 calls to solver: best=40 lower=1 upper=39 
6.69/6.78	o 38
7.79/7.80	o 36
7.79/7.80	c    5 calls to solver: best=36 lower=1 upper=35 
9.10/9.11	o 34
11.89/11.94	o 32
11.89/11.94	c    7 calls to solver: best=32 lower=1 upper=31 
14.38/14.45	o 30
16.59/16.67	o 28
16.59/16.67	c    9 calls to solver: best=28 lower=1 upper=27 
19.19/19.23	o 26
21.39/21.48	o 24
21.39/21.48	c   11 calls to solver: best=24 lower=1 upper=23 
49.28/49.39	o 22
263.18/263.28	o 20
263.18/263.28	c   13 calls to solver: best=20 lower=1 upper=19 
470.29/470.35	o 18
2520.07/2520.01	
2520.07/2520.01	c *** INTERRUPTED ***
2520.07/2520.01	c restarts              : 76          
2520.07/2520.01	c conflicts             : 1440019      (571 /sec)
2520.07/2520.01	c decisions             : 2144577      (851 /sec)
2520.07/2520.01	c propagations          : 156109461   (61950 /sec)
2520.07/2520.01	c root propagations     : 26227       
2520.07/2520.01	c filter calls          : 233853809      (92802 /sec)
2520.07/2520.01	c useless filter calls  : 207753373      (88 %)
2520.07/2520.01	c Memory used           : 160.11 MB
2520.07/2520.01	c CPU time              : 2519.92 s
2520.07/2520.01	
2520.07/2520.01	c nb Solutions = 14
2520.07/2520.01	s SATISFIABLE
2520.07/2520.01	c Best value found: 18
2520.07/2520.01	
2520.07/2520.01	
2520.07/2520.01	v <instantiation type='solution' cost='18'>
2520.07/2520.01	v <list>x[0] x[100] x[101] x[102] x[103] x[104] x[105] x[106] x[107] x[108] x[109] x[10] x[110] x[111] x[112] x[113] x[114] x[115] x[116] x[117] x[118] x[119] x[11] x[120] x[121] x[122] x[123] x[124] x[125] x[126] x[127] x[128] x[129] x[12] x[130] x[131] x[132] x[133] x[134] x[135] x[136] x[137] x[138] x[139] x[13] x[140] x[141] x[142] x[143] x[144] x[145] x[146] x[147] x[148] x[149] x[14] x[150] x[151] x[152] x[153] x[154] x[155] x[156] x[157] x[158] x[159] x[15] x[160] x[161] x[162] x[163] x[164] x[165] x[166] x[167] x[168] x[169] x[16] x[170] x[171] x[172] x[173] x[174] x[175] x[176] x[177] x[178] x[179] x[17] x[180] x[181] x[182] x[183] x[184] x[185] x[186] x[187] x[188] x[189] x[18] x[190] x[191] x[192] x[193] x[194] x[195] x[196] x[197] x[198] x[199] x[19] x[1] x[200] x[201] x[202] x[203] x[204] x[205] x[206] x[207] x[208] x[209] x[20] x[210] x[211] x[212] x[213] x[214] x[215] x[216] x[217] x[218] x[219] x[21] x[220] x[221] x[222] x[223] x[224] x[225] x[226] x[227] x[228] x[229] x[22] x[230] x[231] x[232] x[233] x[234] x[235] x[236] x[237] x[238] x[239] x[23] x[240] x[241] x[242] x[243] x[244] x[245] x[246] x[247] x[248] x[249] x[24] x[250] x[251] x[252] x[253] x[254] x[255] x[256] x[257] x[258] x[259] x[25] x[260] x[261] x[262] x[263] x[264] x[265] x[266] x[267] x[268] x[269] x[26] x[270] x[271] x[272] x[273] x[274] x[275] x[276] x[277] x[278] x[279] x[27] x[280] x[281] x[282] x[283] x[284] x[285] x[286] x[287] x[288] x[289] x[28] x[290] x[291] x[292] x[293] x[294] x[295] x[296] x[297] x[298] x[299] x[29] x[2] x[300] x[301] x[302] x[303] x[304] x[305] x[306] x[307] x[308] x[309] x[30] x[310] x[311] x[312] x[313] x[314] x[315] x[316] x[317] x[318] x[319] x[31] x[320] x[321] x[322] x[323] x[324] x[325] x[326] x[327] x[328] x[329] x[32] x[330] x[331] x[332] x[333] x[334] x[335] x[336] x[337] x[338] x[339] x[33] x[340] x[341] x[342] x[343] x[344] x[345] x[346] x[347] x[348] x[349] x[34] x[350] x[351] x[352] x[353] x[354] x[355] x[356] x[357] x[358] x[359] x[35] x[360] x[361] x[362] x[363] x[364] x[365] x[366] x[367] x[368] x[369] x[36] x[370] x[371] x[372] x[373] x[374] x[375] x[376] x[377] x[378] x[379] x[37] x[380] x[381] x[382] x[383] x[384] x[385] x[386] x[387] x[388] x[389] x[38] x[390] x[391] x[392] x[393] x[394] x[395] x[396] x[397] x[398] x[399] x[39] x[3] x[400] x[401] x[402] x[403] x[404] x[405] x[406] x[407] x[408] x[409] x[40] x[410] x[411] x[412] x[413] x[414] x[415] x[416] x[417] x[418] x[419] x[41] x[420] x[421] x[422] x[423] x[424] x[425] x[426] x[427] x[428] x[429] x[42] x[430] x[431] x[432] x[433] x[434] x[435] x[436] x[437] x[438] x[439] x[43] x[440] x[441] x[442] x[443] x[444] x[445] x[446] x[447] x[448] x[449] x[44] x[450] x[451] x[452] x[453] x[454] x[455] x[456] x[457] x[458] x[459] x[45] x[460] x[461] x[462] x[463] x[464] x[465] x[466] x[467] x[468] x[469] x[46] x[470] x[471] x[472] x[473] x[474] x[475] x[476] x[477] x[478] x[479] x[47] x[480] x[481] x[482] x[483] x[484] x[485] x[486] x[487] x[488] x[489] x[48] x[490] x[491] x[492] x[493] x[494] x[495] x[496] x[497] x[498] x[499] x[49] x[4] x[500] x[501] x[502] x[503] x[504] x[505] x[506] x[507] x[508] x[509] x[50] x[510] x[511] x[512] x[513] x[514] x[515] x[516] x[517] x[518] x[519] x[51] x[520] x[521] x[522] x[523] x[524] x[525] x[526] x[527] x[528] x[529] x[52] x[530] x[531] x[532] x[533] x[534] x[535] x[536] x[537] x[538] x[539] x[53] x[540] x[541] x[542] x[543] x[544] x[545] x[546] x[547] x[548] x[549] x[54] x[550] x[551] x[552] x[553] x[554] x[555] x[556] x[557] x[558] x[559] x[55] x[560] x[561] x[562] x[563] x[564] x[565] x[566] x[567] x[568] x[569] x[56] x[570] x[571] x[572] x[573] x[574] x[575] x[576] x[577] x[578] x[579] x[57] x[580] x[581] x[582] x[583] x[584] x[585] x[586] x[587] x[588] x[589] x[58] x[590] x[591] x[592] x[593] x[594] x[595] x[596] x[597] x[598] x[599] x[59] x[5] x[600] x[601] x[602] x[603] x[604] x[605] x[606] x[607] x[608] x[609] x[60] x[610] x[611] x[612] x[613] x[614] x[615] x[616] x[617] x[618] x[619] x[61] x[620] x[621] x[622] x[623] x[624] x[625] x[626] x[627] x[628] x[629] x[62] x[630] x[631] x[632] x[633] x[634] x[635] x[636] x[637] x[638] x[639] x[63] x[640] x[641] x[642] x[643] x[644] x[645] x[646] x[647] x[648] x[649] x[64] x[650] x[651] x[652] x[653] x[654] x[655] x[656] x[657] x[658] x[659] x[65] x[660] x[661] x[662] x[663] x[664] x[665] x[666] x[667] x[668] x[669] x[66] x[670] x[671] x[672] x[673] x[674] x[675] x[676] x[677] x[678] x[679] x[67] x[680] x[681] x[682] x[683] x[684] x[685] x[686] x[687] x[688] x[689] x[68] x[690] x[691] x[692] x[693] x[694] x[695] x[696] x[697] x[698] x[699] x[69] x[6] x[700] x[701] x[702] x[703] x[704] x[705] x[706] x[707] x[708] x[709] x[70] x[710] x[711] x[712] x[713] x[714] x[715] x[716] x[717] x[718] x[719] x[71] x[720] x[721] x[722] x[723] x[724] x[725] x[726] x[727] x[728] x[729] x[72] x[730] x[731] x[732] x[733] x[734] x[735] x[736] x[737] x[738] x[739] x[73] x[740] x[741] x[742] x[743] x[744] x[745] x[746] x[747] x[748] x[749] x[74] x[750] x[751] x[752] x[753] x[754] x[755] x[756] x[757] x[758] x[759] x[75] x[760] x[761] x[762] x[763] x[764] x[765] x[766] x[767] x[768] x[769] x[76] x[770] x[771] x[772] x[773] x[774] x[775] x[776] x[777] x[778] x[779] x[77] x[780] x[781] x[782] x[783] x[784] x[785] x[786] x[787] x[788] x[789] x[78] x[790] x[791] x[792] x[793] x[794] x[795] x[796] x[797] x[798] x[799] x[79] x[7] x[800] x[801] x[802] x[803] x[804] x[805] x[806] x[807] x[808] x[809] x[80] x[810] x[811] x[812] x[813] x[814] x[815] x[816] x[817] x[818] x[819] x[81] x[820] x[821] x[822] x[823] x[824] x[825] x[826] x[827] x[828] x[829] x[82] x[830] x[831] x[832] x[833] x[834] x[835] x[836] x[837] x[838] x[839] x[83] x[840] x[841] x[842] x[843] x[844] x[845] x[846] x[847] x[848] x[849] x[84] x[850] x[851] x[852] x[853] x[854] x[855] x[856] x[857] x[858] x[859] x[85] x[860] x[861] x[862] x[863] x[864] x[865] x[866] x[867] x[868] x[869] x[86] x[870] x[871] x[872] x[873] x[874] x[875] x[876] x[877] x[878] x[879] x[87] x[880] x[881] x[882] x[883] x[884] x[885] x[886] x[887] x[888] x[889] x[88] x[890] x[891] x[892] x[893] x[894] x[895] x[896] x[897] x[898] x[899] x[89] x[8] x[900] x[901] x[902] x[903] x[904] x[905] x[906] x[907] x[908] x[909] x[90] x[910] x[911] x[912] x[913] x[914] x[915] x[91] x[92] x[93] x[94] x[95] x[96] x[97] x[98] x[99] x[9] </list>
2520.07/2520.01	v <values>142 44 282 310 72 282 44 338 100 254 16 254 338 100 156 394 16 254 16 254 44 282 16 338 100 282 44 338 100 142 380 100 338 254 282 44 44 282 44 282 380 142 282 44 16 394 156 338 100 72 310 254 16 428 666 254 44 282 16 254 282 44 100 338 142 380 16 310 72 142 380 16 254 282 44 156 394 456 338 100 394 156 338 100 512 750 16 254 694 282 44 338 100 16 254 310 72 44 282 254 44 282 310 72 338 100 254 16 666 428 16 380 282 44 72 310 380 142 254 16 142 380 338 156 394 666 428 310 72 44 282 338 100 100 72 310 44 282 338 100 282 44 142 380 16 72 310 338 100 310 72 156 394 310 72 254 338 100 44 282 428 666 142 380 44 282 750 282 44 100 338 142 380 100 338 142 380 512 100 338 282 44 380 142 512 750 72 310 156 72 310 666 428 338 100 394 156 254 16 394 72 310 16 254 282 44 16 254 16 254 338 44 282 72 310 338 100 142 380 282 44 100 16 254 16 338 100 44 282 254 16 310 72 254 666 428 44 282 428 666 156 394 100 338 16 338 100 72 310 380 142 750 512 282 44 16 156 394 16 254 142 380 142 380 72 310 254 254 16 254 16 142 380 512 750 380 142 282 750 512 142 380 380 142 394 156 666 428 44 100 338 666 428 282 44 380 142 156 394 456 72 310 694 456 512 750 282 44 142 380 694 254 16 16 254 16 254 338 100 16 254 282 456 694 310 72 44 282 394 156 156 394 44 254 72 310 512 750 380 142 72 310 72 310 666 380 142 254 16 380 142 750 512 100 338 428 380 142 254 16 310 72 72 310 282 44 142 282 44 100 338 282 44 338 100 310 72 380 380 142 44 282 100 338 142 380 338 100 282 16 254 44 282 142 380 394 156 282 44 44 338 100 338 100 338 100 72 310 100 338 254 338 100 338 100 44 282 142 380 282 44 16 44 282 380 142 394 156 100 338 100 338 282 156 394 338 100 394 156 254 16 310 72 44 394 142 380 254 16 428 666 156 394 380 142 100 456 694 142 380 380 142 44 282 44 282 338 142 380 100 338 338 100 100 338 16 254 72 310 72 380 142 338 100 310 72 456 694 310 380 142 72 310 282 44 44 282 512 750 380 72 310 338 100 380 142 156 394 16 254 142 72 310 282 44 282 44 310 72 142 380 72 16 254 282 44 16 254 44 282 380 142 310 254 16 380 142 310 72 156 394 44 282 72 310 72 310 72 100 338 428 666 338 100 310 156 142 380 310 72 72 310 666 428 394 156 512 44 282 694 456 428 666 282 44 694 456 750 456 694 338 100 72 310 338 100 380 142 16 44 282 142 380 282 44 310 72 72 310 254 156 394 310 72 380 142 156 394 310 72 380 282 44 100 338 750 512 694 456 282 44 142 44 282 310 72 456 694 310 72 282 44 338 72 310 142 380 338 100 100 338 72 310 100 456 694 310 72 456 694 100 338 100 338 16 338 100 44 282 666 428 16 254 282 44 254 338 380 142 338 100 380 142 310 72 72 310 282 72 310 100 338 310 72 338 100 100 338 44 16 254 282 44 100 338 694 456 156 394 72 44 282 282 44 44 282 456 694 72 310 310 380 142 16 254 338 100 394 156 666 428 156 156 394 380 142 100 338 282 44 512 750 394 282 44 44 282 100 338 394 156 142 380 16 310 72 750 512 44 282 428 666 142 380 254 282 44 310 72 428 666 72 310 338 100 380 44 282 282 44 310 72 100 338 156 394 142 100 142 380 512 750 394 156 44 282 142 380 142 142 380 338 100 44 282 282 44 44 282 380 512 750 72 310 694 456 394 156 338 100 254 72 310 380 142 428 666 338 100 666 428 16 142 380 282 44 100 338 512 750 338 100 338 282 44 44 282 100 338 282 44 44 282 100 694 456 750 512 394 156 394 156 72 310 100 282 44 380 142 282 44 428 666 694 456 338 282 44 282 44 44 282 282 44 282 44 310 44 282 282 44 282 44 44 282 100 338 72 16 310 72 44 282 44 282 282 44 282 44 44 44 282 338 100 428 666 282 44 282 142 380 282 44 380 142 254 </values>
2520.07/2520.01	v </instantiation>
2520.07/2520.01	

Verifier Data

OK	18

Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10651 MiB free)
  memory of node 1: 16384 MiB (12119 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293610-1532320807/watcher-4293610-1532320807 -o /tmp/evaluation-result-4293610-1532320807/solver-4293610-1532320807 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node135-1532297735-5127 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4293610-1532320807.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=7645, runsolver pid=7642
Current StackSize limit: 8192 KiB


[startup+0.100115 s]*
/proc/loadavg: 2.00 2.05 2.06 3/191 7646
/proc/meminfo: memFree=23310140/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=35312 memory=11652 CPUtime=0.1 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 3085 0 0 0 10 0 0 0 20 0 1 0 49643885 36159488 2913 33554432000 4194304 6142532 140724285458928 140724285455560 140299060931557 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 8828 2913 802 476 0 2150 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 35312 KiB
Current children cumulated memory: 11652 KiB

[startup+0.209753 s]*
/proc/loadavg: 2.00 2.05 2.06 3/191 7646
/proc/meminfo: memFree=23306420/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=38868 memory=14984 CPUtime=0.2 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 3951 0 0 0 20 0 0 0 20 0 1 0 49643885 39800832 3746 33554432000 4194304 6142532 140724285458928 140724285455560 140299060931557 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 9717 3746 802 476 0 3039 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 38868 KiB
Current children cumulated memory: 14984 KiB

[startup+0.309269 s]*
/proc/loadavg: 2.00 2.05 2.06 3/191 7646
/proc/meminfo: memFree=23301956/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=43576 memory=19824 CPUtime=0.31 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 5112 0 0 0 30 1 0 0 20 0 1 0 49643885 44621824 4956 33554432000 4194304 6142532 140724285458928 140724285455560 140299061392364 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 10894 4956 802 476 0 4216 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 43576 KiB
Current children cumulated memory: 19824 KiB

[startup+0.700252 s]
/proc/loadavg: 2.08 2.06 2.07 3/191 7646
/proc/meminfo: memFree=23292656/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=61404 memory=37520 CPUtime=0.69 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 9573 0 0 0 68 1 0 0 20 0 1 0 49643885 62877696 9380 33554432000 4194304 6142532 140724285458928 140724285453304 140299060931557 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 15351 9380 802 476 0 8673 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 61404 KiB
Current children cumulated memory: 37520 KiB

[startup+1.50026 s]
/proc/loadavg: 2.08 2.06 2.07 3/191 7646
/proc/meminfo: memFree=23269732/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=98752 memory=74868 CPUtime=1.49 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 18922 0 0 0 146 3 0 0 20 0 1 0 49643885 101122048 18717 33554432000 4194304 6142532 140724285458928 140724285448280 5362519 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 24688 18717 802 476 0 18010 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 98752 KiB
Current children cumulated memory: 74868 KiB

[startup+3.10958 s]
/proc/loadavg: 2.08 2.06 2.07 3/191 7646
/proc/meminfo: memFree=23184300/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=160756 memory=137136 CPUtime=3.1 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 58275 0 0 0 304 6 0 0 20 0 1 0 49643885 164614144 34284 33554432000 4194304 6142532 140724285458928 140724285455880 5375782 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40189 34284 845 476 0 33511 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 160756 KiB
Current children cumulated memory: 137136 KiB

[startup+6.30031 s]
/proc/loadavg: 2.08 2.06 2.07 3/191 7646
/proc/meminfo: memFree=23181352/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163424 memory=139944 CPUtime=6.29 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 93003 0 0 0 621 8 0 0 20 0 1 0 49643885 167346176 34986 33554432000 4194304 6142532 140724285458928 140724285446200 140299061852067 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40856 34986 846 476 0 34178 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 163424 KiB
Current children cumulated memory: 139944 KiB

[startup+12.7003 s]
/proc/loadavg: 1.99 2.05 2.06 3/191 7646
/proc/meminfo: memFree=23181228/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163688 memory=140124 CPUtime=12.69 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 127146 0 0 0 1259 10 0 0 20 0 1 0 49643885 167616512 35031 33554432000 4194304 6142532 140724285458928 140724285456456 5366780 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40922 35031 846 476 0 34244 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 163688 KiB
Current children cumulated memory: 140124 KiB

[startup+25.5003 s]
/proc/loadavg: 1.99 2.04 2.06 3/191 7646
/proc/meminfo: memFree=23180768/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140480 CPUtime=25.49 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 192911 0 0 0 2536 13 0 0 20 0 1 0 49643885 167886848 35120 33554432000 4194304 6142532 140724285458928 140724285446200 5372476 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35120 846 476 0 34310 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140480 KiB

[startup+51.1097 s]
/proc/loadavg: 1.99 2.04 2.06 3/191 7646
/proc/meminfo: memFree=23180984/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140480 CPUtime=51.09 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 215226 0 0 0 5095 14 0 0 20 0 1 0 49643885 167886848 35120 33554432000 4194304 6142532 140724285458928 140724285456456 5366690 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35120 846 476 0 34310 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140480 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/191 7647
/proc/meminfo: memFree=23180972/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140516 CPUtime=102.28 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 223937 0 0 0 10213 15 0 0 20 0 1 0 49643885 167886848 35129 33554432000 4194304 6142532 140724285458928 140724285456456 4991580 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35129 846 476 0 34310 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140516 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/191 7648
/proc/meminfo: memFree=23180968/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140516 CPUtime=162.28 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 224401 0 0 0 16213 15 0 0 20 0 1 0 49643885 167886848 35129 33554432000 4194304 6142532 140724285458928 140724285456456 140299070876554 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35129 846 476 0 34310 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140516 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/191 7649
/proc/meminfo: memFree=23180916/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140516 CPUtime=222.28 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 224846 0 0 0 22213 15 0 0 20 0 1 0 49643885 167886848 35129 33554432000 4194304 6142532 140724285458928 140724285456456 5374338 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35129 846 476 0 34310 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140516 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/191 7650
/proc/meminfo: memFree=23181220/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140516 CPUtime=282.29 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 225325 0 0 0 28214 15 0 0 20 0 1 0 49643885 167886848 35129 33554432000 4194304 6142532 140724285458928 140724285446200 5361736 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35129 846 476 0 34310 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140516 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 7651
/proc/meminfo: memFree=23181308/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140524 CPUtime=342.29 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 225766 0 0 0 34214 15 0 0 20 0 1 0 49643885 167886848 35131 33554432000 4194304 6142532 140724285458928 140724285446200 5396937 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35131 846 476 0 34310 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140524 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 7653
/proc/meminfo: memFree=23181384/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140524 CPUtime=402.29 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 226193 0 0 0 40214 15 0 0 20 0 1 0 49643885 167886848 35131 33554432000 4194304 6142532 140724285458928 140724285446200 5371808 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35131 846 476 0 34310 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140524 KiB

[startup+462.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/191 7654
/proc/meminfo: memFree=23181184/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140524 CPUtime=462.29 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 226661 0 0 0 46214 15 0 0 20 0 1 0 49643885 167886848 35131 33554432000 4194304 6142532 140724285458928 140724285446200 5366674 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35131 846 476 0 34310 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140524 KiB


################
# More data... #
################

/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 1722.33 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 7719
/proc/meminfo: memFree=23179540/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=1782.33 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 236250 0 0 0 178218 15 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5361201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 7728
/proc/meminfo: memFree=23178712/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=1842.33 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 236436 0 0 0 184218 15 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5367420 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 7729
/proc/meminfo: memFree=23179356/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=1902.33 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 236674 0 0 0 190218 15 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5363675 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 1902.33 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+1962.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/190 7730
/proc/meminfo: memFree=23180572/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=1962.34 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 237117 0 0 0 196219 15 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5396695 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 1962.34 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/191 7732
/proc/meminfo: memFree=23179516/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2022.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 237554 0 0 0 202219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 140299070264480 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2022.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/191 7733
/proc/meminfo: memFree=23179580/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2082.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 237991 0 0 0 208219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5048024 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2082.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 7734
/proc/meminfo: memFree=23180084/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2142.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 238428 0 0 0 214219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5366734 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 7856
/proc/meminfo: memFree=23194608/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2202.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 238865 0 0 0 220219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5361747 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2202.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2262.3 s]
/proc/loadavg: 2.09 2.04 2.05 3/190 7857
/proc/meminfo: memFree=23194924/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2262.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 239303 0 0 0 226219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5371674 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2262.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2322.3 s]
/proc/loadavg: 2.07 2.05 2.05 3/190 7858
/proc/meminfo: memFree=23195036/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2322.35 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 239482 0 0 0 232219 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5372493 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2322.35 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2382.3 s]
/proc/loadavg: 1.96 2.02 2.04 3/191 7860
/proc/meminfo: memFree=23194772/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2382.36 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 239917 0 0 0 238220 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5361243 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2382.36 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2442.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/192 7869
/proc/meminfo: memFree=23194392/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2442.36 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 240329 0 0 0 244220 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5146880 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2442.36 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

[startup+2502.3 s]
/proc/loadavg: 2.58 2.21 2.10 3/192 7870
/proc/meminfo: memFree=23194476/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2502.36 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 240329 0 0 0 250220 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5376434 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2502.36 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.45 2.20 2.10 3/192 7870
/proc/meminfo: memFree=23194476/32770624 swapFree=67108860/67108860
[pid=7645] ppid=7642 vsize=163952 memory=140532 CPUtime=2520.07 cores=1,3,5,7
/proc/7645/stat : 7645 (cosoco) R 7642 7645 5095 0 -1 4202496 240492 0 0 0 251991 16 0 0 20 0 1 0 49643885 167886848 35133 33554432000 4194304 6142532 140724285458928 140724285456456 5371684 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 24584192 140724285465734 140724285465864 140724285465864 140724285468622 0
/proc/7645/statm: 40988 35133 846 476 0 34310 0
Current children cumulated CPU time: 2520.07 s
Current children cumulated vsize: 163952 KiB
Current children cumulated memory: 140532 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 7645 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.92 s, system=0.163005 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.08
CPU user time (s): 2519.92
CPU system time (s): 0.163005
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 163952
Max. memory (cumulated for all children) (KiB): 140532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.92
system time used= 0.163005
maximum resident set size= 140600
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 240536
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39
involuntary context switches= 672


# summary of solver processes directly reported to runsolver:
#   pid: 7645
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2519.92
#   total CPU system time (s): 0.163005

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.50815 second user time and 17.8557 second system time

The end

Launcher Data

Begin job on node135 at 2018-07-23 06:40:07
IDJOB=4293610
IDBENCH=141203
IDSOLVER=2752
FILE ID=node135/4293610-1532320807
RUNJOBID= node135-1532297735-5127
PBS_JOBID= 21018994
Free space on /tmp= 52932 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/Rlfap/Rlfap-opt/Rlfap-graph-09-opt_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293610-1532320807/watcher-4293610-1532320807 -o /tmp/evaluation-result-4293610-1532320807/solver-4293610-1532320807 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node135-1532297735-5127 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4293610-1532320807.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2788969af340f57bdb68eae00f77e52f
RANDOM SEED=1467763824

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23318536 kB
MemAvailable:   31911768 kB
Buffers:          186632 kB
Cached:          8594604 kB
SwapCached:            0 kB
Active:          1450836 kB
Inactive:        7410716 kB
Active(anon):      30028 kB
Inactive(anon):    69912 kB
Active(file):    1420808 kB
Inactive(file):  7340804 kB
Unevictable:        7188 kB
Mlocked:            7188 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2832 kB
Writeback:             4 kB
AnonPages:         87132 kB
Mapped:            38444 kB
Shmem:             17056 kB
Slab:             288348 kB
SReclaimable:     260080 kB
SUnreclaim:        28268 kB
KernelStack:        3376 kB
PageTables:         5100 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     369340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     30720 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       93568 kB
DirectMap2M:    33452032 kB

Free space on /tmp at the end= 52928 MiB
End job on node135 at 2018-07-23 07:22:07