Trace number 4409741

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)33 20066.9 2520.03

General information on the benchmark

NameGraphColoring/GraphColoring-m1-fixed/
GraphColoring-qwhopt-o33-h381-bal-1.xml
MD5SUM2a724879a45d3456306f221189212969
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark33
Best CPU time to get the best result obtained on this benchmark2519.82
Satisfiable
(Un)Satisfiability was proved
Number of variables1089
Number of constraints34849
Number of domains1
Minimum domain size1089
Maximum domain size1089
Distribution of domain sizes[{"size":1089,"count":1089}]
Minimum variable degree65
Maximum variable degree66
Distribution of variable degrees[{"degree":65,"count":381},{"degree":66,"count":708}]
Minimum constraint arity2
Maximum constraint arity708
Distribution of constraint arities[{"arity":2,"count":34848},{"arity":708,"count":1}]
Number of extensional constraints0
Number of intensional constraints34848
Distribution of constraint types[{"type":"intension","count":34848},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

53.15/12.48	c
53.15/12.48	c This is cosoco 2.00 --  
53.15/12.48	c
53.15/12.48	c command line: cosoco -model -nbcores=8 HOME/instance-4409741-1569818632.xml 
53.15/12.48	c enable optimization
53.15/12.48	c ========================================[ Problem Statistics ]===========================================
53.15/12.48	c |                                                                                                       
53.15/12.48	c |  Parse time        :         5.82 s 
53.15/12.48	c |
53.15/12.48	c |               Variables: 1089
53.15/12.48	c |            Domain Sizes: 1089..1089
53.15/12.48	c |
53.15/12.48	c |             Constraints: 35557
53.15/12.48	c |                   Arity: 1..1089  -- Unary: 708  -- Binary: 34848
53.15/12.48	c | 
53.15/12.48	c |                   Types: 
53.15/12.48	c |                          (X != Y): 34848
53.15/12.48	c |                          Max constant: 1
53.15/12.48	c |                          Unary: 708
53.15/12.48	c |                          
53.15/12.48	c |               Objective: Minimize Max constant
53.15/12.48	
53.15/12.48	c =========================================================================================================
53.15/12.48	c Parallel mode: Portfolio
53.15/12.48	c [pFactory][Group N°0] created (threads:8).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
53.15/12.48	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
53.15/12.48	c [pFactory][Group N°0] concurrent mode: enabled.
53.15/12.48	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
53.15/12.48	c [pFactory][Group N°0] task 7 launched on thread 0.
53.15/12.48	c [pFactory][Group N°0] task 6 launched on thread 2.
53.15/12.48	c [pFactory][Group N°0] task 5 launched on thread 1.
53.15/12.48	c [pFactory][Group N°0] task 4 launched on thread 6.
53.15/12.48	c [pFactory][Group N°0] task 3 launched on thread 5.
53.15/12.48	c [pFactory][Group N°0] task 2 launched on thread 3.
53.15/12.48	c [pFactory][Group N°0] task 1 launched on thread 7.
53.15/12.48	c [pFactory][Group N°0] task 0 launched on thread 4.
53.15/12.48	o 1062
53.93/12.51	o 35
57.46/13.05	o 34
78.13/15.69	o 33
20066.84/2520.02	
20066.84/2520.02	c *** INTERRUPTED ***
20066.84/2520.02	c call to solver        : 3
20066.84/2520.02	c
20066.84/2520.02	c restarts              : 131130      
20066.84/2520.02	c conflicts             : 1750307      (87 /sec)
20066.84/2520.02	c decisions             : 16956200     (845 /sec)
20066.84/2520.02	c propagations          : 278980468   (13909 /sec)
20066.84/2520.02	c root propagations     : 24090       
20066.84/2520.02	c filter calls          : 8993030985     (448373 /sec)
20066.84/2520.02	c useless filter calls  : 8744501588     (97 %)
20066.84/2520.02	c Memory used           : 2092.03 MB
20066.84/2520.02	c Best bound time (wc)  : 15.6887 s
20066.84/2520.02	c CPU time              : 20057 s
20066.84/2520.02	c real time             : 2520.02 s
20066.84/2520.02	
20066.84/2520.02	s SATISFIABLE
20066.84/2520.02	c Best value found: 33
20066.84/2520.02	
20066.84/2520.02	
20066.84/2520.02	v <instantiation type='solution' cost='33'>
20066.84/2520.02	v <list>x[0] x[1000] x[1001] x[1002] x[1003] x[1004] x[1005] x[1006] x[1007] x[1008] x[1009] x[100] x[1010] x[1011] x[1012] x[1013] x[1014] x[1015] x[1016] x[1017] x[1018] x[1019] x[101] x[1020] x[1021] x[1022] x[1023] x[1024] x[1025] x[1026] x[1027] x[1028] x[1029] x[102] x[1030] x[1031] x[1032] x[1033] x[1034] x[1035] x[1036] x[1037] x[1038] x[1039] x[103] x[1040] x[1041] x[1042] x[1043] x[1044] x[1045] x[1046] x[1047] x[1048] x[1049] x[104] x[1050] x[1051] x[1052] x[1053] x[1054] x[1055] x[1056] x[1057] x[1058] x[1059] x[105] x[1060] x[1061] x[1062] x[1063] x[1064] x[1065] x[1066] x[1067] x[1068] x[1069] x[106] x[1070] x[1071] x[1072] x[1073] x[1074] x[1075] x[1076] x[1077] x[1078] x[1079] x[107] x[1080] x[1081] x[1082] x[1083] x[1084] x[1085] x[1086] x[1087] x[1088] x[108] x[109] x[10] x[110] x[111] x[112] x[113] x[114] x[115] x[116] x[117] x[118] x[119] x[11] x[120] x[121] x[122] x[123] x[124] x[125] x[126] x[127] x[128] x[129] x[12] x[130] x[131] x[132] x[133] x[134] x[135] x[136] x[137] x[138] x[139] x[13] x[140] x[141] x[142] x[143] x[144] x[145] x[146] x[147] x[148] x[149] x[14] x[150] x[151] x[152] x[153] x[154] x[155] x[156] x[157] x[158] x[159] x[15] x[160] x[161] x[162] x[163] x[164] x[165] x[166] x[167] x[168] x[169] x[16] x[170] x[171] x[172] x[173] x[174] x[175] x[176] x[177] x[178] x[179] x[17] x[180] x[181] x[182] x[183] x[184] x[185] x[186] x[187] x[188] x[189] x[18] x[190] x[191] x[192] x[193] x[194] x[195] x[196] x[197] x[198] x[199] x[19] x[1] x[200] x[201] x[202] x[203] x[204] x[205] x[206] x[207] x[208] x[209] x[20] x[210] x[211] x[212] x[213] x[214] x[215] x[216] x[217] x[218] x[219] x[21] x[220] x[221] x[222] x[223] x[224] x[225] x[226] x[227] x[228] x[229] x[22] x[230] x[231] x[232] x[233] x[234] x[235] x[236] x[237] x[238] x[239] x[23] x[240] x[241] x[242] x[243] x[244] x[245] x[246] x[247] x[248] x[249] x[24] x[250] x[251] x[252] x[253] x[254] x[255] x[256] x[257] x[258] x[259] x[25] x[260] x[261] x[262] x[263] x[264] x[265] x[266] x[267] x[268] x[269] x[26] x[270] x[271] x[272] x[273] x[274] x[275] x[276] x[277] x[278] x[279] x[27] x[280] x[281] x[282] x[283] x[284] x[285] x[286] x[287] x[288] x[289] x[28] x[290] x[291] x[292] x[293] x[294] x[295] x[296] x[297] x[298] x[299] x[29] x[2] x[300] x[301] x[302] x[303] x[304] x[305] x[306] x[307] x[308] x[309] x[30] x[310] x[311] x[312] x[313] x[314] x[315] x[316] x[317] x[318] x[319] x[31] x[320] x[321] x[322] x[323] x[324] x[325] x[326] x[327] x[328] x[329] x[32] x[330] x[331] x[332] x[333] x[334] x[335] x[336] x[337] x[338] x[339] x[33] x[340] x[341] x[342] x[343] x[344] x[345] x[346] x[347] x[348] x[349] x[34] x[350] x[351] x[352] x[353] x[354] x[355] x[356] x[357] x[358] x[359] x[35] x[360] x[361] x[362] x[363] x[364] x[365] x[366] x[367] x[368] x[369] x[36] x[370] x[371] x[372] x[373] x[374] x[375] x[376] x[377] x[378] x[379] x[37] x[380] x[381] x[382] x[383] x[384] x[385] x[386] x[387] x[388] x[389] x[38] x[390] x[391] x[392] x[393] x[394] x[395] x[396] x[397] x[398] x[399] x[39] x[3] x[400] x[401] x[402] x[403] x[404] x[405] x[406] x[407] x[408] x[409] x[40] x[410] x[411] x[412] x[413] x[414] x[415] x[416] x[417] x[418] x[419] x[41] x[420] x[421] x[422] x[423] x[424] x[425] x[426] x[427] x[428] x[429] x[42] x[430] x[431] x[432] x[433] x[434] x[435] x[436] x[437] x[438] x[439] x[43] x[440] x[441] x[442] x[443] x[444] x[445] x[446] x[447] x[448] x[449] x[44] x[450] x[451] x[452] x[453] x[454] x[455] x[456] x[457] x[458] x[459] x[45] x[460] x[461] x[462] x[463] x[464] x[465] x[466] x[467] x[468] x[469] x[46] x[470] x[471] x[472] x[473] x[474] x[475] x[476] x[477] x[478] x[479] x[47] x[480] x[481] x[482] x[483] x[484] x[485] x[486] x[487] x[488] x[489] x[48] x[490] x[491] x[492] x[493] x[494] x[495] x[496] x[497] x[498] x[499] x[49] x[4] x[500] x[501] x[502] x[503] x[504] x[505] x[506] x[507] x[508] x[509] x[50] x[510] x[511] x[512] x[513] x[514] x[515] x[516] x[517] x[518] x[519] x[51] x[520] x[521] x[522] x[523] x[524] x[525] x[526] x[527] x[528] x[529] x[52] x[530] x[531] x[532] x[533] x[534] x[535] x[536] x[537] x[538] x[539] x[53] x[540] x[541] x[542] x[543] x[544] x[545] x[546] x[547] x[548] x[549] x[54] x[550] x[551] x[552] x[553] x[554] x[555] x[556] x[557] x[558] x[559] x[55] x[560] x[561] x[562] x[563] x[564] x[565] x[566] x[567] x[568] x[569] x[56] x[570] x[571] x[572] x[573] x[574] x[575] x[576] x[577] x[578] x[579] x[57] x[580] x[581] x[582] x[583] x[584] x[585] x[586] x[587] x[588] x[589] x[58] x[590] x[591] x[592] x[593] x[594] x[595] x[596] x[597] x[598] x[599] x[59] x[5] x[600] x[601] x[602] x[603] x[604] x[605] x[606] x[607] x[608] x[609] x[60] x[610] x[611] x[612] x[613] x[614] x[615] x[616] x[617] x[618] x[619] x[61] x[620] x[621] x[622] x[623] x[624] x[625] x[626] x[627] x[628] x[629] x[62] x[630] x[631] x[632] x[633] x[634] x[635] x[636] x[637] x[638] x[639] x[63] x[640] x[641] x[642] x[643] x[644] x[645] x[646] x[647] x[648] x[649] x[64] x[650] x[651] x[652] x[653] x[654] x[655] x[656] x[657] x[658] x[659] x[65] x[660] x[661] x[662] x[663] x[664] x[665] x[666] x[667] x[668] x[669] x[66] x[670] x[671] x[672] x[673] x[674] x[675] x[676] x[677] x[678] x[679] x[67] x[680] x[681] x[682] x[683] x[684] x[685] x[686] x[687] x[688] x[689] x[68] x[690] x[691] x[692] x[693] x[694] x[695] x[696] x[697] x[698] x[699] x[69] x[6] x[700] x[701] x[702] x[703] x[704] x[705] x[706] x[707] x[708] x[709] x[70] x[710] x[711] x[712] x[713] x[714] x[715] x[716] x[717] x[718] x[719] x[71] x[720] x[721] x[722] x[723] x[724] x[725] x[726] x[727] x[728] x[729] x[72] x[730] x[731] x[732] x[733] x[734] x[735] x[736] x[737] x[738] x[739] x[73] x[740] x[741] x[742] x[743] x[744] x[745] x[746] x[747] x[748] x[749] x[74] x[750] x[751] x[752] x[753] x[754] x[755] x[756] x[757] x[758] x[759] x[75] x[760] x[761] x[762] x[763] x[764] x[765] x[766] x[767] x[768] x[769] x[76] x[770] x[771] x[772] x[773] x[774] x[775] x[776] x[777] x[778] x[779] x[77] x[780] x[781] x[782] x[783] x[784] x[785] x[786] x[787] x[788] x[789] x[78] x[790] x[791] x[792] x[793] x[794] x[795] x[796] x[797] x[798] x[799] x[79] x[7] x[800] x[801] x[802] x[803] x[804] x[805] x[806] x[807] x[808] x[809] x[80] x[810] x[811] x[812] x[813] x[814] x[815] x[816] x[817] x[818] x[819] x[81] x[820] x[821] x[822] x[823] x[824] x[825] x[826] x[827] x[828] x[829] x[82] x[830] x[831] x[832] x[833] x[834] x[835] x[836] x[837] x[838] x[839] x[83] x[840] x[841] x[842] x[843] x[844] x[845] x[846] x[847] x[848] x[849] x[84] x[850] x[851] x[852] x[853] x[854] x[855] x[856] x[857] x[858] x[859] x[85] x[860] x[861] x[862] x[863] x[864] x[865] x[866] x[867] x[868] x[869] x[86] x[870] x[871] x[872] x[873] x[874] x[875] x[876] x[877] x[878] x[879] x[87] x[880] x[881] x[882] x[883] x[884] x[885] x[886] x[887] x[888] x[889] x[88] x[890] x[891] x[892] x[893] x[894] x[895] x[896] x[897] x[898] x[899] x[89] x[8] x[900] x[901] x[902] x[903] x[904] x[905] x[906] x[907] x[908] x[909] x[90] x[910] x[911] x[912] x[913] x[914] x[915] x[916] x[917] x[918] x[919] x[91] x[920] x[921] x[922] x[923] x[924] x[925] x[926] x[927] x[928] x[929] x[92] x[930] x[931] x[932] x[933] x[934] x[935] x[936] x[937] x[938] x[939] x[93] x[940] x[941] x[942] x[943] x[944] x[945] x[946] x[947] x[948] x[949] x[94] x[950] x[951] x[952] x[953] x[954] x[955] x[956] x[957] x[958] x[959] x[95] x[960] x[961] x[962] x[963] x[964] x[965] x[966] x[967] x[968] x[969] x[96] x[970] x[971] x[972] x[973] x[974] x[975] x[976] x[977] x[978] x[979] x[97] x[980] x[981] x[982] x[983] x[984] x[985] x[986] x[987] x[988] x[989] x[98] x[990] x[991] x[992] x[993] x[994] x[995] x[996] x[997] x[998] x[999] x[99] x[9] </list>
20066.84/2520.02	v <values>21 8 28 17 27 33 29 12 11 30 23 15 5 18 9 22 13 26 15 31 19 32 8 3 6 7 9 1 16 22 8 23 28 13 13 25 0 2 33 31 5 4 11 26 26 18 21 10 14 19 3 32 7 15 30 7 17 27 24 29 20 12 16 30 4 9 31 13 21 0 26 22 27 14 11 8 15 28 5 28 10 24 12 18 23 3 7 33 16 1 32 17 2 31 6 20 19 29 3 30 33 10 23 4 27 5 24 32 19 22 9 14 1 20 29 18 2 33 25 11 12 0 29 21 17 10 9 3 30 24 11 7 23 6 12 29 26 1 22 2 18 15 28 31 17 16 4 17 27 21 5 6 8 20 19 25 14 13 32 33 0 23 33 2 8 32 3 6 4 20 15 30 31 5 24 21 28 7 7 29 19 9 12 16 10 17 1 0 31 25 27 13 26 3 22 14 18 30 31 15 12 19 4 7 28 22 10 32 2 16 3 19 25 18 15 26 21 17 14 9 27 20 5 0 11 23 5 6 29 12 33 13 24 28 1 4 27 5 17 22 1 25 12 9 30 7 0 23 10 29 3 30 32 28 8 4 33 18 24 26 15 31 13 16 20 6 22 14 21 2 11 28 4 23 24 9 16 24 11 22 31 17 13 32 18 7 29 2 10 14 25 33 21 20 0 10 6 3 27 0 19 26 30 15 8 12 5 31 32 10 8 1 7 4 2 26 3 27 21 23 19 14 11 17 1 9 30 20 11 25 15 22 6 23 24 5 0 12 33 29 18 16 28 8 9 27 28 12 18 1 30 2 5 11 8 18 17 0 3 23 20 16 6 13 25 32 7 31 29 15 7 26 10 21 22 4 19 28 33 9 14 0 14 29 16 2 32 23 23 17 10 18 1 21 28 3 30 31 15 25 4 26 20 22 6 11 9 24 19 25 8 8 33 7 27 5 13 24 23 11 3 20 2 14 12 6 2 17 19 9 25 20 32 29 31 1 13 26 27 0 8 28 5 18 4 29 33 10 4 22 21 15 7 30 29 11 10 17 32 28 31 14 8 19 20 27 19 13 9 1 12 24 2 33 4 30 6 30 11 18 25 15 21 26 3 23 0 5 26 16 22 8 21 25 26 31 3 33 6 9 28 13 29 22 4 10 0 14 19 23 32 15 5 11 16 24 17 30 7 9 27 13 18 2 12 1 32 13 22 32 21 20 31 27 9 12 11 3 1 25 7 2 0 6 14 17 33 30 24 16 28 26 29 23 19 5 31 14 18 5 27 4 8 10 3 26 24 18 19 30 22 5 27 2 9 4 15 10 16 25 21 8 7 12 6 31 33 17 33 1 0 10 29 28 23 20 11 14 32 12 24 14 2 0 11 6 24 19 7 21 27 22 15 27 32 20 9 33 25 1 29 2 28 4 30 23 16 17 18 5 12 13 16 10 31 3 26 7 3 31 20 11 10 22 18 30 16 14 28 32 29 33 8 19 18 6 17 0 22 6 12 9 2 13 25 24 3 23 15 21 26 1 4 27 33 13 6 1 28 15 27 17 0 8 24 10 18 5 17 14 2 32 11 9 23 26 3 4 25 15 31 12 1 29 21 16 20 30 22 19 21 22 6 33 27 3 17 32 15 29 25 20 24 31 19 28 23 12 16 10 13 1 0 26 14 30 20 21 11 8 5 7 4 27 9 18 2 19 24 30 10 18 26 15 12 13 25 13 33 6 8 0 12 11 27 20 17 5 7 2 29 21 22 4 28 17 3 29 14 1 9 23 31 16 25 18 9 0 18 29 5 10 21 6 12 11 20 15 19 19 22 3 4 2 1 13 7 23 32 8 5 14 28 31 24 17 16 26 30 33 11 4 8 15 5 19 0 1 31 23 6 18 7 26 21 33 24 20 22 3 32 27 30 16 25 13 10 16 14 2 9 28 17 7 1 29 4 26 20 13 33 5 14 24 9 11 32 18 31 21 2 12 16 10 19 0 29 26 17 3 32 7 8 28 22 30 4 11 10 15 25 6 27 23 17 29 22 6 21 23 25 3 18 26 5 28 24 7 30 14 22 4 9 16 20 11 0 15 27 2 33 3 12 1 32 8 23 19 13 31 5 11 8 24 25 12 15 29 33 0 23 3 9 13 30 22 7 6 1 27 2 14 21 32 31 31 19 8 4 13 16 10 28 18 26 33 20 12 16 7 29 33 13 21 4 30 21 20 15 20 17 27 31 8 0 5 6 28 9 19 25 2 14 26 11 9 18 1 32 6 22 24 10 3 1 5 26 15 10 19 32 27 14 33 32 22 4 6 24 13 23 28 18 21 0 29 2 8 16 12 20 3 24 11 7 9 31 25 17 28 15 19 21 30 31 23 33 9 1 7 14 5 6 13 2 26 16 22 27 8 10 17 24 12 4 25 3 32 20 0 30 2 29 28 11 25 15 2 25 20 14 0 4 16 24 1 10 6 16 </values>
20066.84/2520.02	v </instantiation>
20066.84/2520.02

Verifier Data 

OK	33

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15421 MiB free)
  memory of node 1: 16384 MiB (15695 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409741-1569818632/watcher-4409741-1569818632 -o /tmp/evaluation-result-4409741-1569818632/solver-4409741-1569818632 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node121-1569816066-8013 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409741-1569818632.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=8364, runsolver pid=8361
Current StackSize limit: 8192 KiB


[startup+0.10016 s]*
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31785980/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=104788 memory=81012 CPUtime=0.1 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 20437 0 0 0 7 3 0 0 20 0 1 0 558125724 107302912 20253 33554432000 4194304 6211132 140727400993200 140727400989736 5816728 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 26197 20253 807 493 0 19502 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 104788 KiB
Current children cumulated memory: 81012 KiB

[startup+0.209353 s]*
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31785608/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=105244 memory=81484 CPUtime=0.21 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 20587 0 0 0 18 3 0 0 20 0 1 0 558125724 107769856 20371 33554432000 4194304 6211132 140727400993200 140727400989736 5524771 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 26311 20371 807 493 0 19616 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 105244 KiB
Current children cumulated memory: 81484 KiB

[startup+0.308613 s]*
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31785236/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=105892 memory=81932 CPUtime=0.31 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 20796 0 0 0 28 3 0 0 20 0 1 0 558125724 108433408 20483 33554432000 4194304 6211132 140727400993200 140727400989736 5810253 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 26473 20483 807 493 0 19778 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 105892 KiB
Current children cumulated memory: 81932 KiB

[startup+0.700368 s]
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31777840/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=161264 memory=136684 CPUtime=0.69 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 34726 0 0 0 64 5 0 0 20 0 1 0 558125724 165134336 34171 33554432000 4194304 6211132 140727400993200 140727400990472 140146272992229 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 40316 34171 822 493 0 33621 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 161264 KiB
Current children cumulated memory: 136684 KiB

[startup+1.50037 s]
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31656388/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=358464 memory=334156 CPUtime=1.49 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 84048 0 0 0 137 12 0 0 20 0 1 0 558125724 367067136 83539 33554432000 4194304 6211132 140727400993200 140727400990472 140146273040288 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 89649 83539 822 493 0 82954 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 358464 KiB
Current children cumulated memory: 334156 KiB

[startup+3.10934 s]
/proc/loadavg: 8.25 8.26 7.82 2/192 8365
/proc/meminfo: memFree=31161900/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=755084 memory=730688 CPUtime=3.1 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 191230 0 0 0 281 29 0 0 20 0 1 0 558125724 773206016 182672 33554432000 4194304 6211132 140727400993200 140727400986088 140146272987966 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 188771 182672 822 493 0 182076 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 755084 KiB
Current children cumulated memory: 730688 KiB

[startup+6.30035 s]
/proc/loadavg: 7.67 8.14 7.79 2/193 8367
/proc/meminfo: memFree=30415316/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=1548020 memory=1524464 CPUtime=6.29 cores=0-7
/proc/8364/stat : 8364 (cosoco) R 8361 8364 7986 0 -1 4202496 472116 0 0 0 567 62 0 0 20 0 1 0 558125724 1585172480 381115 33554432000 4194304 6211132 140727400993200 140727400986088 5178554 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 387005 381116 830 493 0 380310 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 1548020 KiB
Current children cumulated memory: 1524464 KiB

[startup+12.7008 s]
/proc/loadavg: 7.61 8.12 7.78 9/200 8375
/proc/meminfo: memFree=30303024/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2170932 memory=1635940 CPUtime=55.32 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 1653174 0 0 0 5275 257 0 0 20 0 9 0 558125724 2223034368 408985 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 542733 408985 862 493 0 536038 0
[pid=8364/tid=8368] ppid=8361 vsize=2170932 memory=1557204 CPUtime=6.1 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 105367 0 0 0 571 39 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146265889656 140146272987966 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2170932 memory=1563864 CPUtime=6.11 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 120040 0 0 0 603 8 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146257497104 140146289040307 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2170932 memory=1563864 CPUtime=6.1 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 104582 0 0 0 574 36 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146249104248 140146272992229 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2170932 memory=1568576 CPUtime=6.09 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 140745 0 0 0 598 11 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146240711400 140146272992229 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2170932 memory=591 CPUtime=6.11 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 87349 0 0 0 579 32 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146232318840 140146272987966 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2170932 memory=33 CPUtime=6.09 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 114282 0 0 0 574 35 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146223926136 140146272992229 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2170932 memory=6590 CPUtime=6.01 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 144749 0 0 0 591 10 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146215533432 140146272987966 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2170932 memory=2644 CPUtime=6.1 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 150424 0 0 0 599 11 0 0 20 0 9 0 558126379 2223034368 408985 33554432000 4194304 6211132 140727400993200 140146207140632 140146272987966 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 55.32 s
Current children cumulated vsize: 2170932 KiB
Current children cumulated memory: 1635940 KiB

[startup+25.5008 s]
/proc/loadavg: 7.70 8.12 7.78 9/200 8375
/proc/meminfo: memFree=30164584/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1698544 CPUtime=157.18 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 2613202 0 0 0 15318 400 0 0 20 0 9 0 558125724 2193645568 424636 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424636 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=3620 CPUtime=18.85 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 220728 0 0 0 1833 52 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146265889464 5392375 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=0 CPUtime=18.86 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 216217 0 0 0 1872 14 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146257497104 5392375 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=2257 CPUtime=18.83 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 199487 0 0 0 1836 47 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146249104512 5390498 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=280565517580792 CPUtime=18.86 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 275224 0 0 0 1860 26 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146240712008 5392375 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=280564980669217 CPUtime=18.85 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 184153 0 0 0 1838 47 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146232318992 5165755 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=3620 CPUtime=18.68 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 246150 0 0 0 1801 67 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146223925816 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1698544 CPUtime=18.76 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 284014 0 0 0 1854 22 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146215533240 5392297 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=14008 CPUtime=18.87 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 301568 0 0 0 1838 49 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146207140456 5009218 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 157.18 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1698544 KiB

[startup+51.1108 s]
/proc/loadavg: 7.80 8.11 7.79 9/201 8377
/proc/meminfo: memFree=30163488/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1698544 CPUtime=361.64 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 3321973 0 0 0 35704 460 0 0 20 0 9 0 558125724 2193645568 424636 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424636 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=1698544 CPUtime=44.46 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 304713 0 0 0 4388 58 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146265889464 5009022 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=0 CPUtime=44.48 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 289169 0 0 0 4427 21 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146257497104 5165636 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=1679252 CPUtime=44.44 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 286162 0 0 0 4389 55 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146249104512 5392293 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1698544 CPUtime=44.46 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 370489 0 0 0 4412 34 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146240712008 5397407 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=280565518091312 CPUtime=44.45 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 256432 0 0 0 4390 55 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146232318992 5392384 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=3620 CPUtime=44.14 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 338737 0 0 0 4339 75 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146223925816 5165640 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1698544 CPUtime=44.13 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 388146 0 0 0 4383 30 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146215533240 5397407 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=33 CPUtime=44.47 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 402464 0 0 0 4390 57 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146207140456 5409414 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 361.64 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1698544 KiB

[startup+102.301 s]
/proc/loadavg: 7.97 8.11 7.80 9/200 8380
/proc/meminfo: memFree=30165080/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1698544 CPUtime=770.36 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 3636998 0 0 0 76548 488 0 0 20 0 9 0 558125724 2193645568 424636 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424636 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=1698544 CPUtime=95.64 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 342668 0 0 0 9503 61 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146265889464 5008827 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=1698544 CPUtime=95.67 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 322078 0 0 0 9543 24 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146257497104 5165640 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=0 CPUtime=95.61 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 320606 0 0 0 9502 59 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146249104512 5397407 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=176235930287058 CPUtime=95.64 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 408949 0 0 0 9526 38 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146240712008 5009098 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=140287153174143 CPUtime=95.64 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 287876 0 0 0 9505 59 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146232318992 5397407 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=55 CPUtime=94.58 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 382508 0 0 0 9380 78 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146223925816 5009195 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=2004 CPUtime=95.32 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 432299 0 0 0 9498 34 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146215533240 5009142 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=984 CPUtime=95.64 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 454353 0 0 0 9504 60 0 0 20 0 9 0 558126379 2193645568 424636 33554432000 4194304 6211132 140727400993200 140146207140456 5409476 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0

################
# More data... #
################

/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 709800 0 0 0 225193 119 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5409476 0 0 4096 8405026 0 0 0 -1 5 0 0 27 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2246.71 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 814128 0 0 0 224579 92 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2248.54 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 623933 0 0 0 224729 125 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5392297 0 0 4096 8405026 0 0 0 -1 1 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2252.3 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853052 0 0 0 225080 150 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5009142 0 0 4096 8405026 0 0 0 -1 0 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2250.51 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866056 0 0 0 224957 94 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5390500 0 0 4096 8405026 0 0 0 -1 2 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2253.65 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 910963 0 0 0 225242 123 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5397407 0 0 4096 8405026 0 0 0 -1 6 0 0 27 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 18009.3 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB

[startup+2322.3 s]
/proc/loadavg: 8.35 8.34 8.28 9/199 8571
/proc/meminfo: memFree=30164536/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1699408 CPUtime=18488.4 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 6870491 0 0 0 1847851 987 0 0 20 0 9 0 558125724 2193645568 424852 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424852 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2307 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 753064 0 0 0 230568 132 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146265889464 5165714 0 0 4096 8405026 0 0 0 -1 3 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2310.85 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 652297 0 0 0 231010 75 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146257497104 5392375 0 0 4096 8405026 0 0 0 -1 4 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2313.11 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 710188 0 0 0 231192 119 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5392375 0 0 4096 8405026 0 0 0 -1 5 0 0 27 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2305.84 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 814360 0 0 0 230492 92 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5392375 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2308.53 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 624187 0 0 0 230727 126 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5397407 0 0 4096 8405026 0 0 0 -1 1 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2312.28 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853257 0 0 0 231078 150 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5392340 0 0 4096 8405026 0 0 0 -1 0 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2310.49 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866273 0 0 0 230955 94 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5392297 0 0 4096 8405026 0 0 0 -1 2 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2313.65 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 911204 0 0 0 231242 123 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5009317 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 18488.4 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB

[startup+2382.3 s]
/proc/loadavg: 8.20 8.30 8.27 9/199 8574
/proc/meminfo: memFree=30165104/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1699408 CPUtime=18967.4 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 6872648 0 0 0 1895748 989 0 0 20 0 9 0 558125724 2193645568 424852 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424852 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2366.97 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 753478 0 0 0 236565 132 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146265889464 5390448 0 0 4096 8405026 0 0 0 -1 3 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2370.81 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 652500 0 0 0 237006 75 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146257497104 5392280 0 0 4096 8405026 0 0 0 -1 1 0 0 32 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2373.09 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 710526 0 0 0 237190 119 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2365.01 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 814590 0 0 0 236408 93 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5008994 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2368.48 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 624458 0 0 0 236722 126 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5392375 0 0 4096 8405026 0 0 0 -1 4 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2372.27 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853507 0 0 0 237077 150 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5392352 0 0 4096 8405026 0 0 0 -1 0 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2370.48 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866508 0 0 0 236953 95 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5165755 0 0 4096 8405026 0 0 0 -1 2 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2373.64 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 911420 0 0 0 237241 123 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5112713 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 18967.4 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB

[startup+2442.3 s]
/proc/loadavg: 8.08 8.24 8.25 9/199 8579
/proc/meminfo: memFree=30163928/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1699408 CPUtime=19446.4 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 6874811 0 0 0 1943651 990 0 0 20 0 9 0 558125724 2193645568 424852 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424852 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=288230574492221466 CPUtime=2426.92 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 753911 0 0 0 242560 132 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146265889464 5008971 0 0 4096 8405026 0 0 0 -1 3 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2430.78 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 652693 0 0 0 243003 75 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146257497104 5008940 0 0 4096 8405026 0 0 0 -1 1 0 0 32 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2433.08 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 710847 0 0 0 243189 119 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5390500 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2424.18 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 814765 0 0 0 242325 93 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5009142 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2428.47 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 624753 0 0 0 242721 126 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5392375 0 0 4096 8405026 0 0 0 -1 4 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2432.26 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853710 0 0 0 243075 151 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5397407 0 0 4096 8405026 0 0 0 -1 0 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2430.46 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866740 0 0 0 242951 95 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5165616 0 0 4096 8405026 0 0 0 -1 2 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2433.63 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 911731 0 0 0 243240 123 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5009317 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 19446.4 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB

[startup+2502.3 s]
/proc/loadavg: 8.07 8.21 8.24 9/199 8582
/proc/meminfo: memFree=30164460/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1699408 CPUtime=19925.5 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 6877010 0 0 0 1991555 991 0 0 20 0 9 0 558125724 2193645568 424852 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424852 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=-7035114785800479027 CPUtime=2486.91 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 754363 0 0 0 248558 133 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146265889464 5397407 0 0 4096 8405026 0 0 0 -1 3 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=1720 CPUtime=2490.77 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 652915 0 0 0 249002 75 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146257497104 5392375 0 0 4096 8405026 0 0 0 -1 4 0 0 32 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2493.08 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 711178 0 0 0 249188 120 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5409485 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2483.32 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 814969 0 0 0 248239 93 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5392375 0 0 4096 8405026 0 0 0 -1 7 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1699408 CPUtime=2488.46 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 625065 0 0 0 248720 126 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5390476 0 0 4096 8405026 0 0 0 -1 1 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=280565518450064 CPUtime=2492.25 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853956 0 0 0 249074 151 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5397407 0 0 4096 8405026 0 0 0 -1 0 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=3620 CPUtime=2490.44 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866942 0 0 0 248949 95 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5390500 0 0 4096 8405026 0 0 0 -1 2 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=10480 CPUtime=2493.63 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 911961 0 0 0 249239 124 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5008844 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 19925.5 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.05 8.20 8.23 9/199 8583
/proc/meminfo: memFree=30163936/32770624 swapFree=66993536/67108860
[pid=8364] ppid=8361 vsize=2142232 memory=1699408 CPUtime=20066.8 cores=0-7
/proc/8364/stat : 8364 (cosoco) S 8361 8364 7986 0 -1 1077944320 6877462 0 0 0 2005692 992 0 0 20 0 9 0 558125724 2193645568 424852 33554432000 4194304 6211132 140727400993200 140727400991456 140146289032951 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
/proc/8364/statm: 535558 424852 863 493 0 528863 0
[pid=8364/tid=8368] ppid=8361 vsize=2142232 memory=1398722017469774279 CPUtime=2504.6 cores=0-7
/proc/8364/task/8368/stat : 8368 (cosoco) R 8361 8364 7986 0 -1 4202560 754386 0 0 0 250327 133 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146265889464 5392375 0 0 4096 8405026 0 0 0 -1 3 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8369] ppid=8361 vsize=2142232 memory=4872558044660077418 CPUtime=2508.47 cores=0-7
/proc/8364/task/8369/stat : 8369 (cosoco) R 8361 8364 7986 0 -1 4202560 652994 0 0 0 250772 75 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146257497104 5392293 0 0 4096 8405026 0 0 0 -1 4 0 0 33 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8370] ppid=8361 vsize=2142232 memory=6528 CPUtime=2510.78 cores=0-7
/proc/8364/task/8370/stat : 8370 (cosoco) R 8361 8364 7986 0 -1 4202560 711230 0 0 0 250958 120 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146249104512 5392056 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8371] ppid=8361 vsize=2142232 memory=512 CPUtime=2500.78 cores=0-7
/proc/8364/task/8371/stat : 8371 (cosoco) R 8361 8364 7986 0 -1 4202560 815031 0 0 0 249985 93 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146240712008 5165653 0 0 4096 8405026 0 0 0 -1 7 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8372] ppid=8361 vsize=2142232 memory=1564 CPUtime=2506.17 cores=0-7
/proc/8364/task/8372/stat : 8372 (cosoco) R 8361 8364 7986 0 -1 4202560 625157 0 0 0 250491 126 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146232318992 5392755 0 0 4096 8405026 0 0 0 -1 1 0 0 30 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8373] ppid=8361 vsize=2142232 memory=928 CPUtime=2509.95 cores=0-7
/proc/8364/task/8373/stat : 8373 (cosoco) R 8361 8364 7986 0 -1 4202560 853994 0 0 0 250844 151 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146223925816 5165755 0 0 4096 8405026 0 0 0 -1 0 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8374] ppid=8361 vsize=2142232 memory=3784 CPUtime=2508.15 cores=0-7
/proc/8364/task/8374/stat : 8374 (cosoco) R 8361 8364 7986 0 -1 4202560 866994 0 0 0 250720 95 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146215533240 5392293 0 0 4096 8405026 0 0 0 -1 2 0 0 31 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
[pid=8364/tid=8375] ppid=8361 vsize=2142232 memory=1440 CPUtime=2511.34 cores=0-7
/proc/8364/task/8375/stat : 8375 (cosoco) R 8361 8364 7986 0 -1 4202560 912015 0 0 0 251010 124 0 0 20 0 9 0 558126379 2193645568 424852 33554432000 4194304 6211132 140727400993200 140146207140456 5165656 0 0 4096 8405026 0 0 0 -1 6 0 0 29 0 0 8312316 8317760 29159424 140727400997905 140727400997997 140727400997997 140727401000910 0
Current children cumulated CPU time: 20066.8 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1699408 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 8364 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20057 s, system=9.93047 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.03
CPU time (s): 20066.9
CPU user time (s): 20057
CPU system time (s): 9.93047
CPU usage (%): 796.298
Max. virtual memory (cumulated for all children) (KiB): 2207792
Max. memory (cumulated for all children) (KiB): 1741368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20057
system time used= 9.93047
maximum resident set size= 1744396
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6877515
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27439
involuntary context switches= 178324


# summary of solver processes directly reported to runsolver:
#   pid: 8364
#   total CPU time (s): 20066.9
#   total CPU user time (s): 20057
#   total CPU system time (s): 9.93047

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 13.4016 second user time and 21.218 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-30 06:43:09
IDJOB=4409741
IDBENCH=120522
IDSOLVER=2877
FILE ID=node121/4409741-1569818632
RUNJOBID= node121-1569816066-8013
PBS_JOBID= 21705901
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/GraphColoring/GraphColoring-m1-fixed/GraphColoring-qwhopt-o33-h381-bal-1.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409741-1569818632/watcher-4409741-1569818632 -o /tmp/evaluation-result-4409741-1569818632/solver-4409741-1569818632 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node121-1569816066-8013 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409741-1569818632.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2a724879a45d3456306f221189212969
RANDOM SEED=21950071

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31863548 kB
MemAvailable:   31872520 kB
Buffers:           85408 kB
Cached:           250248 kB
SwapCached:         4536 kB
Active:           177260 kB
Inactive:         165836 kB
Active(anon):       3352 kB
Inactive(anon):    78872 kB
Active(file):     173908 kB
Inactive(file):    86964 kB
Unevictable:      109564 kB
Mlocked:          109564 kB
SwapTotal:      67108860 kB
SwapFree:       66993536 kB
Dirty:              3548 kB
Writeback:             0 kB
AnonPages:        113656 kB
Mapped:            26380 kB
Shmem:             66172 kB
Slab:             156880 kB
SReclaimable:     127872 kB
SUnreclaim:        29008 kB
KernelStack:        3424 kB
PageTables:         5040 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     539012 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 62028 MiB
End job on node121 at 2019-09-30 07:25:09