Trace number 4398481

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallelSAT (TO)33 20067.5 2520.03

General information on the benchmark

NameGraphColoring/GraphColoring-m1-fixed/
GraphColoring-qwhopt-o33-h381-bal-1.xml
MD5SUM2a724879a45d3456306f221189212969
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark33
Best CPU time to get the best result obtained on this benchmark2519.82
Satisfiable
(Un)Satisfiability was proved
Number of variables1089
Number of constraints34849
Number of domains1
Minimum domain size1089
Maximum domain size1089
Distribution of domain sizes[{"size":1089,"count":1089}]
Minimum variable degree65
Maximum variable degree66
Distribution of variable degrees[{"degree":65,"count":381},{"degree":66,"count":708}]
Minimum constraint arity2
Maximum constraint arity708
Distribution of constraint arities[{"arity":2,"count":34848},{"arity":708,"count":1}]
Number of extensional constraints0
Number of intensional constraints34848
Distribution of constraint types[{"type":"intension","count":34848},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

53.55/12.61	c
53.55/12.61	c This is cosoco 2.00 --  
53.55/12.61	c
53.55/12.61	c command line: cosoco -model -nbcores=8 HOME/instance-4398481-1568598248.xml 
53.55/12.61	c enable optimization
53.55/12.61	c ========================================[ Problem Statistics ]===========================================
53.55/12.61	c |                                                                                                       
53.55/12.61	c |  Parse time        :         6.08 s 
53.55/12.61	c |
53.55/12.61	c |               Variables: 1089
53.55/12.61	c |            Domain Sizes: 1089..1089
53.55/12.61	c |
53.55/12.61	c |             Constraints: 35557
53.55/12.61	c |                   Arity: 1..1089  -- Unary: 708  -- Binary: 34848
53.55/12.61	c | 
53.55/12.61	c |                   Types: 
53.55/12.61	c |                          (X != Y): 34848
53.55/12.61	c |                          Max constant: 1
53.55/12.61	c |                          Unary: 708
53.55/12.61	c |                          
53.55/12.61	c |               Objective: Minimize Max constant
53.55/12.61	
53.55/12.61	c =========================================================================================================
53.55/12.61	c Parallel mode: Portfolio
53.55/12.61	c [pFactory][Group N°0] created (threads:8).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
53.55/12.61	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
53.55/12.61	c [pFactory][Group N°0] concurrent mode: enabled.
53.55/12.61	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
53.55/12.61	c [pFactory][Group N°0] task 7 launched on thread 0.
53.55/12.61	c [pFactory][Group N°0] task 6 launched on thread 1.
53.55/12.61	c [pFactory][Group N°0] task 5 launched on thread 6.
53.55/12.61	c [pFactory][Group N°0] task 4 launched on thread 2.
53.55/12.61	c [pFactory][Group N°0] task 3 launched on thread 7.
53.55/12.61	c [pFactory][Group N°0] task 2 launched on thread 5.
53.55/12.61	c [pFactory][Group N°0] task 1 launched on thread 3.
53.55/12.61	c [pFactory][Group N°0] task 0 launched on thread 4.
53.55/12.61	o 35
57.56/13.23	o 34
80.75/16.16	o 33
20067.33/2520.02	
20067.33/2520.02	c *** INTERRUPTED ***
20067.33/2520.02	c call to solver        : 4
20067.33/2520.02	c
20067.33/2520.02	c restarts              : 131485      
20067.33/2520.02	c conflicts             : 1820355      (91 /sec)
20067.33/2520.02	c decisions             : 17207980     (858 /sec)
20067.33/2520.02	c propagations          : 282357863   (14078 /sec)
20067.33/2520.02	c root propagations     : 24090       
20067.33/2520.02	c filter calls          : 8933029700     (445380 /sec)
20067.33/2520.02	c useless filter calls  : 8681730338     (97 %)
20067.33/2520.02	c Memory used           : 2092.03 MB
20067.33/2520.02	c Best bound time (wc)  : 16.1587 s
20067.33/2520.02	c CPU time              : 20057.1 s
20067.33/2520.02	c real time             : 2520.02 s
20067.33/2520.02	
20067.33/2520.02	s SATISFIABLE
20067.33/2520.02	c Best value found: 33
20067.33/2520.02	
20067.33/2520.02	
20067.33/2520.02	v <instantiation type='solution' cost='33'>
20067.33/2520.02	v <list>x[0] x[1000] x[1001] x[1002] x[1003] x[1004] x[1005] x[1006] x[1007] x[1008] x[1009] x[100] x[1010] x[1011] x[1012] x[1013] x[1014] x[1015] x[1016] x[1017] x[1018] x[1019] x[101] x[1020] x[1021] x[1022] x[1023] x[1024] x[1025] x[1026] x[1027] x[1028] x[1029] x[102] x[1030] x[1031] x[1032] x[1033] x[1034] x[1035] x[1036] x[1037] x[1038] x[1039] x[103] x[1040] x[1041] x[1042] x[1043] x[1044] x[1045] x[1046] x[1047] x[1048] x[1049] x[104] x[1050] x[1051] x[1052] x[1053] x[1054] x[1055] x[1056] x[1057] x[1058] x[1059] x[105] x[1060] x[1061] x[1062] x[1063] x[1064] x[1065] x[1066] x[1067] x[1068] x[1069] x[106] x[1070] x[1071] x[1072] x[1073] x[1074] x[1075] x[1076] x[1077] x[1078] x[1079] x[107] x[1080] x[1081] x[1082] x[1083] x[1084] x[1085] x[1086] x[1087] x[1088] x[108] x[109] x[10] x[110] x[111] x[112] x[113] x[114] x[115] x[116] x[117] x[118] x[119] x[11] x[120] x[121] x[122] x[123] x[124] x[125] x[126] x[127] x[128] x[129] x[12] x[130] x[131] x[132] x[133] x[134] x[135] x[136] x[137] x[138] x[139] x[13] x[140] x[141] x[142] x[143] x[144] x[145] x[146] x[147] x[148] x[149] x[14] x[150] x[151] x[152] x[153] x[154] x[155] x[156] x[157] x[158] x[159] x[15] x[160] x[161] x[162] x[163] x[164] x[165] x[166] x[167] x[168] x[169] x[16] x[170] x[171] x[172] x[173] x[174] x[175] x[176] x[177] x[178] x[179] x[17] x[180] x[181] x[182] x[183] x[184] x[185] x[186] x[187] x[188] x[189] x[18] x[190] x[191] x[192] x[193] x[194] x[195] x[196] x[197] x[198] x[199] x[19] x[1] x[200] x[201] x[202] x[203] x[204] x[205] x[206] x[207] x[208] x[209] x[20] x[210] x[211] x[212] x[213] x[214] x[215] x[216] x[217] x[218] x[219] x[21] x[220] x[221] x[222] x[223] x[224] x[225] x[226] x[227] x[228] x[229] x[22] x[230] x[231] x[232] x[233] x[234] x[235] x[236] x[237] x[238] x[239] x[23] x[240] x[241] x[242] x[243] x[244] x[245] x[246] x[247] x[248] x[249] x[24] x[250] x[251] x[252] x[253] x[254] x[255] x[256] x[257] x[258] x[259] x[25] x[260] x[261] x[262] x[263] x[264] x[265] x[266] x[267] x[268] x[269] x[26] x[270] x[271] x[272] x[273] x[274] x[275] x[276] x[277] x[278] x[279] x[27] x[280] x[281] x[282] x[283] x[284] x[285] x[286] x[287] x[288] x[289] x[28] x[290] x[291] x[292] x[293] x[294] x[295] x[296] x[297] x[298] x[299] x[29] x[2] x[300] x[301] x[302] x[303] x[304] x[305] x[306] x[307] x[308] x[309] x[30] x[310] x[311] x[312] x[313] x[314] x[315] x[316] x[317] x[318] x[319] x[31] x[320] x[321] x[322] x[323] x[324] x[325] x[326] x[327] x[328] x[329] x[32] x[330] x[331] x[332] x[333] x[334] x[335] x[336] x[337] x[338] x[339] x[33] x[340] x[341] x[342] x[343] x[344] x[345] x[346] x[347] x[348] x[349] x[34] x[350] x[351] x[352] x[353] x[354] x[355] x[356] x[357] x[358] x[359] x[35] x[360] x[361] x[362] x[363] x[364] x[365] x[366] x[367] x[368] x[369] x[36] x[370] x[371] x[372] x[373] x[374] x[375] x[376] x[377] x[378] x[379] x[37] x[380] x[381] x[382] x[383] x[384] x[385] x[386] x[387] x[388] x[389] x[38] x[390] x[391] x[392] x[393] x[394] x[395] x[396] x[397] x[398] x[399] x[39] x[3] x[400] x[401] x[402] x[403] x[404] x[405] x[406] x[407] x[408] x[409] x[40] x[410] x[411] x[412] x[413] x[414] x[415] x[416] x[417] x[418] x[419] x[41] x[420] x[421] x[422] x[423] x[424] x[425] x[426] x[427] x[428] x[429] x[42] x[430] x[431] x[432] x[433] x[434] x[435] x[436] x[437] x[438] x[439] x[43] x[440] x[441] x[442] x[443] x[444] x[445] x[446] x[447] x[448] x[449] x[44] x[450] x[451] x[452] x[453] x[454] x[455] x[456] x[457] x[458] x[459] x[45] x[460] x[461] x[462] x[463] x[464] x[465] x[466] x[467] x[468] x[469] x[46] x[470] x[471] x[472] x[473] x[474] x[475] x[476] x[477] x[478] x[479] x[47] x[480] x[481] x[482] x[483] x[484] x[485] x[486] x[487] x[488] x[489] x[48] x[490] x[491] x[492] x[493] x[494] x[495] x[496] x[497] x[498] x[499] x[49] x[4] x[500] x[501] x[502] x[503] x[504] x[505] x[506] x[507] x[508] x[509] x[50] x[510] x[511] x[512] x[513] x[514] x[515] x[516] x[517] x[518] x[519] x[51] x[520] x[521] x[522] x[523] x[524] x[525] x[526] x[527] x[528] x[529] x[52] x[530] x[531] x[532] x[533] x[534] x[535] x[536] x[537] x[538] x[539] x[53] x[540] x[541] x[542] x[543] x[544] x[545] x[546] x[547] x[548] x[549] x[54] x[550] x[551] x[552] x[553] x[554] x[555] x[556] x[557] x[558] x[559] x[55] x[560] x[561] x[562] x[563] x[564] x[565] x[566] x[567] x[568] x[569] x[56] x[570] x[571] x[572] x[573] x[574] x[575] x[576] x[577] x[578] x[579] x[57] x[580] x[581] x[582] x[583] x[584] x[585] x[586] x[587] x[588] x[589] x[58] x[590] x[591] x[592] x[593] x[594] x[595] x[596] x[597] x[598] x[599] x[59] x[5] x[600] x[601] x[602] x[603] x[604] x[605] x[606] x[607] x[608] x[609] x[60] x[610] x[611] x[612] x[613] x[614] x[615] x[616] x[617] x[618] x[619] x[61] x[620] x[621] x[622] x[623] x[624] x[625] x[626] x[627] x[628] x[629] x[62] x[630] x[631] x[632] x[633] x[634] x[635] x[636] x[637] x[638] x[639] x[63] x[640] x[641] x[642] x[643] x[644] x[645] x[646] x[647] x[648] x[649] x[64] x[650] x[651] x[652] x[653] x[654] x[655] x[656] x[657] x[658] x[659] x[65] x[660] x[661] x[662] x[663] x[664] x[665] x[666] x[667] x[668] x[669] x[66] x[670] x[671] x[672] x[673] x[674] x[675] x[676] x[677] x[678] x[679] x[67] x[680] x[681] x[682] x[683] x[684] x[685] x[686] x[687] x[688] x[689] x[68] x[690] x[691] x[692] x[693] x[694] x[695] x[696] x[697] x[698] x[699] x[69] x[6] x[700] x[701] x[702] x[703] x[704] x[705] x[706] x[707] x[708] x[709] x[70] x[710] x[711] x[712] x[713] x[714] x[715] x[716] x[717] x[718] x[719] x[71] x[720] x[721] x[722] x[723] x[724] x[725] x[726] x[727] x[728] x[729] x[72] x[730] x[731] x[732] x[733] x[734] x[735] x[736] x[737] x[738] x[739] x[73] x[740] x[741] x[742] x[743] x[744] x[745] x[746] x[747] x[748] x[749] x[74] x[750] x[751] x[752] x[753] x[754] x[755] x[756] x[757] x[758] x[759] x[75] x[760] x[761] x[762] x[763] x[764] x[765] x[766] x[767] x[768] x[769] x[76] x[770] x[771] x[772] x[773] x[774] x[775] x[776] x[777] x[778] x[779] x[77] x[780] x[781] x[782] x[783] x[784] x[785] x[786] x[787] x[788] x[789] x[78] x[790] x[791] x[792] x[793] x[794] x[795] x[796] x[797] x[798] x[799] x[79] x[7] x[800] x[801] x[802] x[803] x[804] x[805] x[806] x[807] x[808] x[809] x[80] x[810] x[811] x[812] x[813] x[814] x[815] x[816] x[817] x[818] x[819] x[81] x[820] x[821] x[822] x[823] x[824] x[825] x[826] x[827] x[828] x[829] x[82] x[830] x[831] x[832] x[833] x[834] x[835] x[836] x[837] x[838] x[839] x[83] x[840] x[841] x[842] x[843] x[844] x[845] x[846] x[847] x[848] x[849] x[84] x[850] x[851] x[852] x[853] x[854] x[855] x[856] x[857] x[858] x[859] x[85] x[860] x[861] x[862] x[863] x[864] x[865] x[866] x[867] x[868] x[869] x[86] x[870] x[871] x[872] x[873] x[874] x[875] x[876] x[877] x[878] x[879] x[87] x[880] x[881] x[882] x[883] x[884] x[885] x[886] x[887] x[888] x[889] x[88] x[890] x[891] x[892] x[893] x[894] x[895] x[896] x[897] x[898] x[899] x[89] x[8] x[900] x[901] x[902] x[903] x[904] x[905] x[906] x[907] x[908] x[909] x[90] x[910] x[911] x[912] x[913] x[914] x[915] x[916] x[917] x[918] x[919] x[91] x[920] x[921] x[922] x[923] x[924] x[925] x[926] x[927] x[928] x[929] x[92] x[930] x[931] x[932] x[933] x[934] x[935] x[936] x[937] x[938] x[939] x[93] x[940] x[941] x[942] x[943] x[944] x[945] x[946] x[947] x[948] x[949] x[94] x[950] x[951] x[952] x[953] x[954] x[955] x[956] x[957] x[958] x[959] x[95] x[960] x[961] x[962] x[963] x[964] x[965] x[966] x[967] x[968] x[969] x[96] x[970] x[971] x[972] x[973] x[974] x[975] x[976] x[977] x[978] x[979] x[97] x[980] x[981] x[982] x[983] x[984] x[985] x[986] x[987] x[988] x[989] x[98] x[990] x[991] x[992] x[993] x[994] x[995] x[996] x[997] x[998] x[999] x[99] x[9] </list>
20067.33/2520.02	v <values>8 8 28 17 27 24 29 5 11 30 26 15 16 18 9 22 13 19 32 31 23 33 8 3 6 7 9 1 16 5 8 31 28 13 13 7 0 2 22 23 25 4 11 26 26 18 6 10 14 19 3 32 33 15 30 2 17 27 24 29 20 12 16 30 4 9 31 31 6 33 26 22 3 14 11 8 13 10 5 28 10 24 12 18 23 21 7 2 16 1 32 17 0 25 15 27 19 29 7 30 4 27 33 4 14 5 24 32 28 23 9 14 1 19 29 18 22 20 25 11 12 0 6 21 17 10 9 3 30 24 33 7 23 0 25 29 26 1 11 2 18 12 28 31 33 16 20 17 27 21 5 6 8 15 19 25 14 4 13 0 22 23 16 2 8 32 3 7 4 20 15 30 11 5 24 21 28 7 26 29 19 9 12 1 10 17 6 0 31 25 27 13 22 3 31 14 18 30 31 15 12 19 4 13 28 22 8 32 2 16 3 19 25 18 15 24 21 26 14 9 27 20 5 0 11 23 5 6 29 12 17 10 33 28 1 4 17 5 19 16 1 25 12 9 30 27 0 23 10 29 3 30 32 28 11 21 6 18 24 26 15 31 13 7 20 33 17 8 21 2 14 28 4 6 33 9 16 24 11 22 31 17 13 32 18 7 27 2 10 1 25 24 21 20 0 10 3 29 23 26 19 26 30 14 8 12 5 31 32 33 23 1 7 4 26 1 3 27 21 23 10 14 22 22 17 9 30 20 19 25 15 11 6 29 24 5 0 12 2 29 18 16 28 8 9 33 28 14 18 1 30 2 5 11 8 18 17 0 3 23 20 16 6 29 25 32 7 31 13 15 7 27 24 21 22 4 19 28 26 9 10 0 14 29 12 2 32 23 23 17 10 18 1 21 28 5 30 31 15 25 4 26 3 22 6 11 9 24 27 25 8 8 19 7 20 16 13 24 23 11 16 20 2 14 12 26 6 17 19 9 25 20 32 29 31 1 13 33 27 22 8 28 5 18 12 3 2 10 4 0 21 15 7 30 29 11 10 17 32 28 11 14 2 19 20 27 19 13 9 1 12 7 33 8 4 30 6 33 16 18 25 15 21 26 3 31 0 5 26 24 23 20 21 25 26 22 3 32 16 9 28 6 29 19 4 10 13 8 14 23 32 15 5 11 33 24 17 30 7 9 27 13 18 2 12 1 0 13 22 10 21 20 31 27 9 0 11 24 1 25 7 2 15 6 14 17 12 30 33 16 28 26 29 23 19 5 31 14 18 5 27 4 8 32 3 26 0 18 22 30 19 5 27 2 9 28 15 10 16 6 21 33 7 12 29 31 0 17 30 1 8 4 10 13 23 20 11 14 32 4 24 14 2 0 11 6 24 19 7 21 27 22 33 30 31 20 9 15 25 1 8 2 28 4 3 23 16 17 29 5 12 13 16 10 32 27 26 7 3 31 20 11 10 22 18 30 28 14 5 15 29 32 8 19 27 6 17 0 22 24 12 9 2 13 25 18 3 23 16 21 26 1 4 33 21 13 12 1 28 33 27 17 0 8 24 10 18 5 17 14 2 32 11 9 23 7 3 4 25 15 31 26 1 29 15 16 20 30 22 19 21 27 6 22 0 3 17 15 33 29 25 32 24 31 19 28 23 21 16 10 13 1 0 26 14 30 20 12 11 8 5 7 32 27 9 18 2 19 24 30 10 15 21 27 1 13 25 13 26 6 8 0 12 11 18 20 17 17 7 2 5 29 22 4 28 33 3 20 14 1 9 23 31 16 25 8 9 27 18 29 5 10 21 6 12 18 20 15 19 19 22 3 4 2 1 13 7 23 32 0 5 14 28 31 24 17 16 33 30 11 1 4 18 15 24 19 0 8 31 23 33 12 7 26 21 17 29 20 22 3 32 27 30 16 25 13 10 16 14 2 9 28 6 7 29 11 4 26 20 13 3 5 14 24 9 11 32 18 31 21 2 12 16 10 19 0 27 26 17 33 29 7 8 1 22 30 4 11 10 15 25 28 23 6 17 29 23 6 21 23 25 3 18 26 28 22 24 7 30 0 22 4 2 16 20 11 33 15 27 14 10 3 12 1 32 8 5 19 13 31 22 11 8 24 25 12 15 29 30 0 23 3 9 13 13 33 7 6 27 5 2 14 21 32 31 31 19 8 4 16 1 10 28 18 26 12 20 12 5 7 29 23 13 16 4 30 21 20 15 20 17 1 31 8 0 18 6 21 9 19 25 2 14 26 11 9 28 33 32 6 22 24 10 3 5 27 26 15 10 22 33 6 14 33 32 31 4 30 24 1 23 28 19 21 0 29 2 8 16 12 20 3 24 11 7 9 13 25 17 28 15 19 21 30 31 7 23 9 1 4 14 5 6 27 2 26 16 22 8 13 10 17 24 12 33 25 28 32 20 0 30 2 29 11 3 25 15 2 25 20 14 0 4 21 15 1 10 6 16 </values>
20067.33/2520.02	v </instantiation>
20067.33/2520.02

Verifier Data 

OK	33

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14709 MiB free)
  memory of node 1: 16384 MiB (15924 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398481-1568598248/watcher-4398481-1568598248 -o /tmp/evaluation-result-4398481-1568598248/solver-4398481-1568598248 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node136-1568598203-6097 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398481-1568598248.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog threadsolver pid=6114, runsolver pid=6111
Starting watchdog threadsolver pid=6114, runsolver pid=6111

Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 1.63 1.93 2.01 2/192 6115
/proc/meminfo: memFree=31291928/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=104788 memory=81012 CPUtime=0.09 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 20425 0 0 0 7 2 0 0 20 0 1 0 436073420 107302912 20253 33554432000 4194304 6211092 140727981438288 140727981435560 5810221 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 26197 20253 807 493 0 19502 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 104788 KiB
Current children cumulated memory: 81012 KiB

[startup+0.209246 s]*
/proc/loadavg: 1.63 1.93 2.01 2/192 6115
/proc/meminfo: memFree=31291556/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=105244 memory=81224 CPUtime=0.2 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 20573 0 0 0 18 2 0 0 20 0 1 0 436073420 107769856 20306 33554432000 4194304 6211092 140727981438288 140727981435560 5810221 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 26311 20306 807 493 0 19616 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 105244 KiB
Current children cumulated memory: 81224 KiB

[startup+0.308575 s]*
/proc/loadavg: 1.63 1.93 2.01 2/192 6115
/proc/meminfo: memFree=31290440/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=105760 memory=81672 CPUtime=0.3 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 20771 0 0 0 28 2 0 0 20 0 1 0 436073420 108298240 20418 33554432000 4194304 6211092 140727981438288 140727981435560 5529440 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 26440 20418 807 493 0 19745 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 105760 KiB
Current children cumulated memory: 81672 KiB

[startup+0.700362 s]
/proc/loadavg: 1.63 1.93 2.01 2/192 6115
/proc/meminfo: memFree=31289324/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=150552 memory=126124 CPUtime=0.69 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 32070 0 0 0 65 4 0 0 20 0 1 0 436073420 154165248 31531 33554432000 4194304 6211092 140727981438288 140727981432728 140396417436645 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 37638 31531 822 493 0 30943 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 150552 KiB
Current children cumulated memory: 126124 KiB

[startup+1.50043 s]
/proc/loadavg: 1.63 1.93 2.01 2/192 6115
/proc/meminfo: memFree=31174376/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=342448 memory=318052 CPUtime=1.49 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 80028 0 0 0 138 11 0 0 20 0 1 0 436073420 350666752 79513 33554432000 4194304 6211092 140727981438288 140727981432728 140396417436645 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 85612 79513 822 493 0 78917 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 342448 KiB
Current children cumulated memory: 318052 KiB

[startup+3.10931 s]
/proc/loadavg: 1.58 1.91 2.01 2/192 6115
/proc/meminfo: memFree=30692364/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=729144 memory=704724 CPUtime=3.1 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 184847 0 0 0 284 26 0 0 20 0 1 0 436073420 746643456 176181 33554432000 4194304 6211092 140727981438288 140727981432728 140396417436645 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 182286 176181 822 493 0 175591 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 729144 KiB
Current children cumulated memory: 704724 KiB

[startup+6.30035 s]
/proc/loadavg: 1.58 1.91 2.01 2/192 6115
/proc/meminfo: memFree=29967084/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=1499572 memory=1475036 CPUtime=6.29 cores=0-7
/proc/6114/stat : 6114 (cosoco) R 6111 6114 6070 0 -1 4202496 378060 0 0 0 578 51 0 0 20 0 1 0 436073420 1535561728 368759 33554432000 4194304 6211092 140727981438288 140727981432728 140396417436645 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 374926 368759 822 493 0 368231 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 1499572 KiB
Current children cumulated memory: 1475036 KiB

[startup+12.7005 s]
/proc/loadavg: 2.09 2.01 2.04 9/200 6123
/proc/meminfo: memFree=29807040/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=2154540 memory=1586208 CPUtime=54.25 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 1499801 0 0 0 5196 229 0 0 20 0 9 0 436073420 2206248960 396552 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 538635 396552 876 493 0 531940 0
[pid=6114/tid=6116] ppid=6111 vsize=2154540 memory=1546296 CPUtime=5.94 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) S 6111 6114 6070 0 -1 1077944384 72219 0 0 0 569 25 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396410334224 140396433498557 0 0 4096 8405026 18446744071579849748 0 0 -1 4 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2154540 memory=3616 CPUtime=5.86 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 114185 0 0 0 576 10 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396401941128 140396417912407 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2154540 memory=0 CPUtime=5.95 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) D 6111 6114 6070 0 -1 4202560 87953 0 0 0 558 37 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396393548816 5009136 0 0 4096 8405026 18446744071582151416 0 0 -1 0 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2154540 memory=0 CPUtime=5.95 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) S 6111 6114 6070 0 -1 1077944384 124832 0 0 0 585 10 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396385156112 140396433498557 0 0 4096 8405026 18446744071579849748 0 0 -1 7 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2154540 memory=44944 CPUtime=5.95 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 127298 0 0 0 586 9 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396376763408 5403682 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2154540 memory=988 CPUtime=5.94 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) S 6111 6114 6070 0 -1 1077944384 121543 0 0 0 584 10 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396368370576 140396433498557 0 0 4096 8405026 18446744071579849748 0 0 -1 1 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2154540 memory=1533144 CPUtime=5.94 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 75835 0 0 0 569 25 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396359978000 5302429 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2154540 memory=6656426216303648864 CPUtime=5.94 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 90160 0 0 0 557 37 0 0 20 0 9 0 436074093 2206248960 396552 33554432000 4194304 6211092 140727981438288 140396351585296 5009210 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 54.25 s
Current children cumulated vsize: 2154540 KiB
Current children cumulated memory: 1586208 KiB

[startup+25.5011 s]
/proc/loadavg: 3.40 2.31 2.14 9/200 6123
/proc/meminfo: memFree=29648136/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721216 CPUtime=155.75 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 2284154 0 0 0 15247 328 0 0 20 0 9 0 436073420 2193645568 430304 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430304 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=1721216 CPUtime=18.65 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 146426 0 0 0 1826 39 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396410334224 5409444 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721216 CPUtime=18.6 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 206435 0 0 0 1841 19 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396401941488 5009317 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=0 CPUtime=18.66 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 190936 0 0 0 1815 51 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396393548472 5392343 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721216 CPUtime=18.64 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 250568 0 0 0 1841 23 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396385155768 5392265 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721216 CPUtime=18.63 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 225820 0 0 0 1846 17 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396376763064 5397375 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=0 CPUtime=18.45 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 226685 0 0 0 1826 19 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396368370960 5009195 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=164 CPUtime=18.66 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 154378 0 0 0 1828 38 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396359978000 5165604 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=6655300316396806240 CPUtime=18.67 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 197022 0 0 0 1813 54 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396351585280 5392343 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 155.75 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721216 KiB

[startup+51.1101 s]
/proc/loadavg: 5.03 2.78 2.30 9/200 6125
/proc/meminfo: memFree=29647184/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721216 CPUtime=360.24 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 2949529 0 0 0 35630 394 0 0 20 0 9 0 436073420 2193645568 430304 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430304 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=3616 CPUtime=44.26 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 225576 0 0 0 4378 48 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396410334224 5009095 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721216 CPUtime=44.2 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 287037 0 0 0 4392 28 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396401941488 5392343 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721216 CPUtime=44.27 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 285852 0 0 0 4368 59 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396393548472 5392265 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721216 CPUtime=44.24 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 351568 0 0 0 4392 32 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396385155768 5008918 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=4406 CPUtime=44.23 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 295679 0 0 0 4399 24 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396376763064 5165608 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=0 CPUtime=43.71 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 310861 0 0 0 4346 25 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396368370960 5392343 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721216 CPUtime=44.27 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 222429 0 0 0 4380 47 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396359978000 5390468 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=1721216 CPUtime=44.27 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 284643 0 0 0 4363 64 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396351585280 5397375 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 360.24 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721216 KiB

[startup+102.301 s]
/proc/loadavg: 6.79 3.60 2.60 9/199 6128
/proc/meminfo: memFree=29646104/32770624 swapFree=67001752/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721216 CPUtime=768.73 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 3269303 0 0 0 76448 425 0 0 20 0 9 0 436073420 2193645568 430304 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430304 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=1721216 CPUtime=95.42 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 262990 0 0 0 9489 53 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396410334224 5392343 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721216 CPUtime=95.35 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 324898 0 0 0 9503 32 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396401941488 5009195 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721216 CPUtime=95.43 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 328962 0 0 0 9480 63 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396393548472 5392339 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=139675047085695 CPUtime=95.29 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 399142 0 0 0 9493 36 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396385155768 5008918 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=-7035114785800479027 CPUtime=95.38 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 329669 0 0 0 9512 26 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396376763064 5390439 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1740 CPUtime=94.24 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 352035 0 0 0 9396 28 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396368370960 5009142 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=55 CPUtime=95.4 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 254141 0 0 0 9490 50 0 0 20 0 9 0 436074093 2193645568 430304 33554432000 4194304 6211092 140727981438288 140396359978000 5392265 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=6944656592455097440 CPUtime=95.43 cores=0-7

################
# More data... #
################

/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 809616 0 0 0 224643 137 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5009195 0 0 4096 8405026 0 0 0 -1 1 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2248.9 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 934680 0 0 0 224784 106 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5397375 0 0 4096 8405026 0 0 0 -1 7 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2243.42 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 716267 0 0 0 224234 108 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5193731 0 0 4096 8405026 0 0 0 -1 3 0 0 25 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2251.27 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 811516 0 0 0 225029 98 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5392343 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2253.68 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 625610 0 0 0 225246 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5008827 0 0 4096 8405026 0 0 0 -1 4 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2251.26 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 893896 0 0 0 224979 147 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5397375 0 0 4096 8405026 0 0 0 -1 5 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 18009.7 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB

[startup+2322.31 s]
/proc/loadavg: 8.54 8.36 7.83 9/200 6318
/proc/meminfo: memFree=29646012/32770624 swapFree=67001824/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721468 CPUtime=18488.8 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 6955373 0 0 0 1847851 1026 0 0 20 0 9 0 436073420 2193645568 430367 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430367 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2314.53 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 716655 0 0 0 231334 119 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396410334224 5112718 0 0 4096 8405026 0 0 0 -1 2 0 0 24 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=0 CPUtime=2311.99 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 759554 0 0 0 231078 121 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396401941488 5390468 0 0 4096 8405026 0 0 0 -1 0 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2307.8 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 809923 0 0 0 230643 137 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5392261 0 0 4096 8405026 0 0 0 -1 1 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2308.03 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 934956 0 0 0 230697 106 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5392343 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2303.43 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 716522 0 0 0 230234 109 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5390444 0 0 4096 8405026 0 0 0 -1 3 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2311.28 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 811792 0 0 0 231030 98 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5009210 0 0 4096 8405026 0 0 0 -1 6 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2313.67 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 625843 0 0 0 231245 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5409439 0 0 4096 8405026 0 0 0 -1 4 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2311.25 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 894244 0 0 0 230978 147 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5008971 0 0 4096 8405026 0 0 0 -1 5 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 18488.8 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB

[startup+2382.3 s]
/proc/loadavg: 8.26 8.32 7.85 9/200 6323
/proc/meminfo: memFree=29646084/32770624 swapFree=67001824/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721468 CPUtime=18967.8 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 6957553 0 0 0 1895751 1028 0 0 20 0 9 0 436073420 2193645568 430367 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430367 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2374.52 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 716918 0 0 0 237333 119 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396410334224 5392281 0 0 4096 8405026 0 0 0 -1 2 0 0 24 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2371.97 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 759806 0 0 0 237076 121 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396401941488 5392274 0 0 4096 8405026 0 0 0 -1 0 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2367.8 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 810156 0 0 0 236643 137 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5112718 0 0 4096 8405026 0 0 0 -1 1 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=0 CPUtime=2367.15 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 935280 0 0 0 236609 106 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5392308 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2363.41 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 716839 0 0 0 236232 109 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5392269 0 0 4096 8405026 0 0 0 -1 3 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2371.26 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 812057 0 0 0 237027 99 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5009182 0 0 4096 8405026 0 0 0 -1 6 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2373.66 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 626051 0 0 0 237244 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5392343 0 0 4096 8405026 0 0 0 -1 4 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=0 CPUtime=2371.23 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 894562 0 0 0 236976 147 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5009218 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 18967.8 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB

[startup+2442.3 s]
/proc/loadavg: 8.10 8.26 7.86 9/200 6326
/proc/meminfo: memFree=29645548/32770624 swapFree=67001824/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721468 CPUtime=19446.9 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 6959754 0 0 0 1943657 1030 0 0 20 0 9 0 436073420 2193645568 430367 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430367 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2434.52 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 717184 0 0 0 243333 119 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396410334224 5165624 0 0 4096 8405026 0 0 0 -1 2 0 0 25 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2431.96 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 760102 0 0 0 243075 121 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396401941488 5392343 0 0 4096 8405026 0 0 0 -1 0 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2427.79 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 810455 0 0 0 242642 137 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5397375 0 0 4096 8405026 0 0 0 -1 1 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2426.28 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 935532 0 0 0 242521 107 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5392343 0 0 4096 8405026 0 0 0 -1 7 0 0 30 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2423.39 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 717045 0 0 0 242230 109 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5009142 0 0 4096 8405026 0 0 0 -1 3 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2431.26 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 812348 0 0 0 243027 99 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5165712 0 0 4096 8405026 0 0 0 -1 6 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2433.64 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 626273 0 0 0 243242 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5009189 0 0 4096 8405026 0 0 0 -1 4 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2431.23 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 894931 0 0 0 242976 147 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5392343 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 19446.9 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB

[startup+2502.3 s]
/proc/loadavg: 8.08 8.23 7.87 9/199 6330
/proc/meminfo: memFree=29645768/32770624 swapFree=67001824/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721468 CPUtime=19925.9 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 6961925 0 0 0 1991563 1032 0 0 20 0 9 0 436073420 2193645568 430367 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430367 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=3616 CPUtime=2494.41 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 717465 0 0 0 249322 119 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396410334224 5392261 0 0 4096 8405026 0 0 0 -1 7 0 0 25 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2491.96 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 760319 0 0 0 249075 121 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396401941488 5392343 0 0 4096 8405026 0 0 0 -1 0 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2487.77 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 810766 0 0 0 248639 138 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5392269 0 0 4096 8405026 0 0 0 -1 1 0 0 30 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2485.5 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 935813 0 0 0 248443 107 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5009098 0 0 4096 8405026 0 0 0 -1 4 0 0 31 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2483.38 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 717320 0 0 0 248229 109 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5112672 0 0 4096 8405026 0 0 0 -1 3 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2491.26 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 812584 0 0 0 249027 99 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5008994 0 0 4096 8405026 0 0 0 -1 6 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2493.63 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 626518 0 0 0 249241 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5112709 0 0 4096 8405026 0 0 0 -1 2 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=1721468 CPUtime=2491.24 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 895256 0 0 0 248976 148 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5392715 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 19926 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.06 8.22 7.88 9/199 6332
/proc/meminfo: memFree=29643456/32770624 swapFree=67001824/67108860
[pid=6114] ppid=6111 vsize=2142232 memory=1721468 CPUtime=20067.3 cores=0-7
/proc/6114/stat : 6114 (cosoco) S 6111 6114 6070 0 -1 1077944320 6962746 0 0 0 2005700 1033 0 0 20 0 9 0 436073420 2193645568 430367 33554432000 4194304 6211092 140727981438288 140727981436544 140396433477367 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
/proc/6114/statm: 535558 430367 876 493 0 528863 0
[pid=6114/tid=6116] ppid=6111 vsize=2142232 memory=-7035114785800479027 CPUtime=2512.06 cores=0-7
/proc/6114/task/6116/stat : 6116 (cosoco) R 6111 6114 6070 0 -1 4202560 717578 0 0 0 251087 119 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396410334224 5390468 0 0 4096 8405026 0 0 0 -1 1 0 0 25 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6117] ppid=6111 vsize=2142232 memory=4126316290023845779 CPUtime=2509.67 cores=0-7
/proc/6114/task/6117/stat : 6117 (cosoco) R 6111 6114 6070 0 -1 4202560 760426 0 0 0 250845 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396401941488 5165608 0 0 4096 8405026 0 0 0 -1 0 0 0 27 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6118] ppid=6111 vsize=2142232 memory=111632 CPUtime=2505.48 cores=0-7
/proc/6114/task/6118/stat : 6118 (cosoco) R 6111 6114 6070 0 -1 4202560 810853 0 0 0 250410 138 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396393548472 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 30 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6119] ppid=6111 vsize=2142232 memory=1568 CPUtime=2503.21 cores=0-7
/proc/6114/task/6119/stat : 6119 (cosoco) R 6111 6114 6070 0 -1 4202560 935920 0 0 0 250214 107 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396385155768 5397375 0 0 4096 8405026 0 0 0 -1 4 0 0 31 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6120] ppid=6111 vsize=2142232 memory=1040 CPUtime=2500.87 cores=0-7
/proc/6114/task/6120/stat : 6120 (cosoco) R 6111 6114 6070 0 -1 4202560 717402 0 0 0 249978 109 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396376763064 5008918 0 0 4096 8405026 0 0 0 -1 7 0 0 26 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6121] ppid=6111 vsize=2142232 memory=14008 CPUtime=2508.97 cores=0-7
/proc/6114/task/6121/stat : 6121 (cosoco) R 6111 6114 6070 0 -1 4202560 812694 0 0 0 250798 99 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396368370960 5112718 0 0 4096 8405026 0 0 0 -1 6 0 0 29 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6122] ppid=6111 vsize=2142232 memory=12040 CPUtime=2511.34 cores=0-7
/proc/6114/task/6122/stat : 6122 (cosoco) R 6111 6114 6070 0 -1 4202560 626639 0 0 0 251012 122 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396359978000 5397375 0 0 4096 8405026 0 0 0 -1 2 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
[pid=6114/tid=6123] ppid=6111 vsize=2142232 memory=2120 CPUtime=2508.94 cores=0-7
/proc/6114/task/6123/stat : 6123 (cosoco) R 6111 6114 6070 0 -1 4202560 895350 0 0 0 250746 148 0 0 20 0 9 0 436074093 2193645568 430367 33554432000 4194304 6211092 140727981438288 140396351585280 5397375 0 0 4096 8405026 0 0 0 -1 5 0 0 28 0 0 8312316 8317760 27934720 140727981446161 140727981446253 140727981446253 140727981449166 0
Current children cumulated CPU time: 20067.3 s
Current children cumulated vsize: 2142232 KiB
Current children cumulated memory: 1721468 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 6114 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20057.1 s, system=10.339 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.03
CPU time (s): 20067.5
CPU user time (s): 20057.1
CPU system time (s): 10.339
CPU usage (%): 796.317
Max. virtual memory (cumulated for all children) (KiB): 2281528
Max. memory (cumulated for all children) (KiB): 1831808

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20057.1
system time used= 10.339
maximum resident set size= 1839060
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6962797
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39838
involuntary context switches= 176909


# summary of solver processes directly reported to runsolver:
#   pid: 6114
#   total CPU time (s): 20067.5
#   total CPU user time (s): 20057.1
#   total CPU system time (s): 10.339

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.6206 second user time and 23.1635 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-16 03:43:24
IDJOB=4398481
IDBENCH=120522
IDSOLVER=2851
FILE ID=node136/4398481-1568598248
RUNJOBID= node136-1568598203-6097
PBS_JOBID= 21703420
Free space on /tmp= 61172 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/GraphColoring/GraphColoring-m1-fixed/GraphColoring-qwhopt-o33-h381-bal-1.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398481-1568598248/watcher-4398481-1568598248 -o /tmp/evaluation-result-4398481-1568598248/solver-4398481-1568598248 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node136-1568598203-6097 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398481-1568598248.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2a724879a45d3456306f221189212969
RANDOM SEED=344780018

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31369308 kB
MemAvailable:   31896816 kB
Buffers:           79840 kB
Cached:           741824 kB
SwapCached:         3440 kB
Active:           525284 kB
Inactive:         300984 kB
Active(anon):       3936 kB
Inactive(anon):    49460 kB
Active(file):     521348 kB
Inactive(file):   251524 kB
Unevictable:      110008 kB
Mlocked:          110008 kB
SwapTotal:      67108860 kB
SwapFree:       67001752 kB
Dirty:              3984 kB
Writeback:             0 kB
AnonPages:        111984 kB
Mapped:            45512 kB
Shmem:             40196 kB
Slab:             170408 kB
SReclaimable:     140940 kB
SUnreclaim:        29468 kB
KernelStack:        3296 kB
PageTables:         6088 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     506884 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61168 MiB
End job on node136 at 2019-09-16 04:25:24