Trace number 3703640

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)-50 1800.01 900.484

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/
~kexu/benchmarks/frb56-25-opb/normalized-frb56-25-2.opb
MD5SUM62a6bdf0e089cd0b8a79007277394096
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-52
Best CPU time to get the best result obtained on this benchmark1800.05
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -54
Optimality of the best value was proved NO
Number of variables1400
Total number of constraints109401
Number of constraints which are clauses109401
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1400
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1400
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1400
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703640-1338091530.opb.
0.00/0.00	c Instance file HOME/instance-3703640-1338091530.opb
0.00/0.00	c File size is 2678526 bytes.
0.19/0.20	c Cost Offset: -1400
0.19/0.20	c Highest Coefficient sum: 3
0.19/0.20	c ============================[ Problem Statistics ]=============================
0.19/0.20	c |                                                                             |
0.19/0.20	c |  Parsing time:          0.21         s                                      |
0.19/0.20	c |  Number Variables:      1400                                                |
0.19/0.20	c |  Number Clauses:        109401                                              |
0.19/0.20	c |  Number Cardinality:    0                                                   |
0.19/0.20	c |  Number PB Constraints: 0                                                   |
0.19/0.20	c |                                                                             |
0.19/0.26	c |  Problem Type:          Optimization                                        |
0.19/0.26	c |  Objective Function:    Cardinality Constraint                              |
0.19/0.26	c |                                                                             |
0.19/0.26	c ===============================================================================
1800.01/900.41	o -40
1800.01/900.41	o -41
1800.01/900.41	o -42
1800.01/900.41	o -43
1800.01/900.41	o -44
1800.01/900.41	o -45
1800.01/900.41	o -46
1800.01/900.41	o -47
1800.01/900.41	o -48
1800.01/900.41	o -49
1800.01/900.41	o -50
1800.01/900.41	c ===============================================================================
1800.01/900.41	c Wall Clock Time: 900.41 s
1800.01/900.41	c Best Solution: -50
1800.01/900.41	s SATISFIABLE
1800.01/900.41	v -x1400 -x1399 -x1398 -x1397 -x1396 x1395 -x1394 -x1393 -x1392 -x1391 -x1390 -x1389 -x1388 -x1387 -x1386 -x1385 -x1384 -x1383 -x1382 -x1381 -x1380 -x1379 -x1378 -x1377 -x1376 -x1375 -x1374 -x1373 -x1372 -x1371 x1370 -x1369 -x1368 -x1367 -x1366 -x1365 -x1364 -x1363 -x1362 -x1361 -x1360 -x1359 -x1358 -x1357 -x1356 -x1355 -x1354 -x1353 -x1352 -x1351 -x1350 -x1349 -x1348 -x1347 -x1346 -x1345 -x1344 -x1343 -x1342 x1341 -x1340 -x1339 -x1338 -x1337 -x1336 -x1335 -x1334 -x1333 -x1332 -x1331 -x1330 -x1329 -x1328 -x1327 -x1326 -x1325 -x1324 -x1323 -x1322 -x1321 -x1320 -x1319 -x1318 -x1317 -x1316 -x1315 -x1314 -x1313 x1312 -x1311 -x1310 -x1309 -x1308 -x1307 -x1306 -x1305 -x1304 -x1303 -x1302 -x1301 -x1300 -x1299 -x1298 -x1297 -x1296 -x1295 -x1294 -x1293 -x1292 x1291 -x1290 -x1289 -x1288 -x1287 -x1286 -x1285 -x1284 -x1283 -x1282 -x1281 -x1280 -x1279 -x1278 -x1277 -x1276 -x1275 -x1274 -x1273 -x1272 -x1271 -x1270 -x1269 -x1268 -x1267 -x1266 -x1265 -x1264 -x1263 -x1262 -x1261 -x1260 -x1259 -x1258 -x1257 -x1256 -x1255 -x1254 x1253 -x1252 -x1251 -x1250 -x1249 -x1248 -x1247 -x1246 -x1245 -x1244 -x1243 -x1242 -x1241 -x1240 -x1239 x1238 -x1237 -x1236 -x1235 -x1234 -x1233 -x1232 -x1231 -x1230 -x1229 -x1228 -x1227 -x1226 -x1225 -x1224 -x1223 -x1222 -x1221 -x1220 -x1219 -x1218 x1217 -x1216 -x1215 -x1214 -x1213 -x1212 -x1211 -x1210 -x1209 -x1208 -x1207 -x1206 -x1205 -x1204 -x1203 -x1202 -x1201 -x1200 -x1199 -x1198 -x1197 -x1196 -x1195 -x1194 -x1193 -x1192 -x1191 -x1190 -x1189 -x1188 -x1187 -x1186 -x1185 -x1184 -x1183 -x1182 -x1181 -x1180 -x1179 -x1178 x1177 -x1176 -x1175 -x1174 -x1173 -x1172 -x1171 -x1170 -x1169 -x1168 -x1167 -x1166 -x1165 x1164 -x1163 -x1162 -x1161 -x1160 -x1159 -x1158 -x1157 -x1156 -x1155 -x1154 -x1153 -x1152 -x1151 -x1150 -x1149 -x1148 -x1147 -x1146 -x1145 -x1144 x1143 -x1142 -x1141 -x1140 -x1139 -x1138 -x1137 -x1136 -x1135 -x1134 -x1133 -x1132 -x1131 -x1130 -x1129 -x1128 -x1127 -x1126 -x1125 -x1124 -x1123 -x1122 -x1121 -x1120 -x1119 -x1118 -x1117 -x1116 -x1115 -x1114 -x1113 -x1112 -x1111 x1110 -x1109 -x1108 -x1107 -x1106 -x1105 -x1104 -x1103 -x1102 -x1101 -x1100 -x1099 -x1098 -x1097 -x1096 -x1095 -x1094 -x1093 -x1092 -x1091 -x1090 -x1089 -x1088 -x1087 -x1086 -x1085 -x1084 -x1083 -x1082 -x1081 -x1080 -x1079 x1078 -x1077 -x1076 -x1075 -x1074 -x1073 -x1072 -x1071 -x1070 -x1069 -x1068 -x1067 -x1066 -x1065 -x1064 -x1063 -x1062 -x1061 -x1060 x1059 -x1058 -x1057 -x1056 -x1055 -x1054 -x1053 -x1052 -x1051 -x1050 -x1049 -x1048 -x1047 -x1046 -x1045 -x1044 -x1043 -x1042 -x1041 -x1040 -x1039 -x1038 -x1037 -x1036 -x1035 -x1034 -x1033 -x1032 -x1031 x1030 -x1029 -x1028 -x1027 -x1026 -x1025 -x1024 -x1023 -x1022 -x1021 -x1020 -x1019 -x1018 x1017 -x1016 -x1015 -x1014 -x1013 -x1012 -x1011 -x1010 -x1009 -x1008 -x1007 -x1006 -x1005 -x1004 -x1003 -x1002 -x1001 -x1000 -x999 -x998 -x997 -x996 -x995 -x994 -x993 -x992 -x991 -x990 -x989 -x988 -x987 x986 -x985 -x984 -x983 -x982 -x981 -x980 -x979 -x978 -x977 -x976 -x975 -x974 -x973 -x972 -x971 -x970 -x969 -x968 -x967 -x966 -x965 -x964 -x963 -x962 -x961 -x960 -x959 -x958 -x957 -x956 -x955 -x954 -x953 -x952 -x951 -x950 -x949 -x948 -x947 -x946 -x945 -x944 -x943 x942 -x941 -x940 -x939 -x938 -x937 -x936 -x935 -x934 -x933 -x932 -x931 -x930 -x929 -x928 -x927 -x926 -x925 -x924 -x923 -x922 -x921 -x920 -x919 x918 -x917 -x916 -x915 -x914 -x913 -x912 -x911 -x910 -x909 -x908 -x907 -x906 -x905 -x904 -x903 -x902 -x901 -x900 -x899 -x898 -x897 -x896 -x895 -x894 -x893 -x892 -x891 -x890 -x889 -x888 -x887 -x886 -x885 -x884 -x883 -x882 -x881 -x880 -x879 -x878 -x877 -x876 -x875 -x874 -x873 -x872 -x871 -x870 -x869 -x868 -x867 -x866 -x865 -x864 -x863 -x862 -x861 -x860 -x859 -x858 -x857 -x856 x855 -x854 -x853 -x852 -x851 -x850 -x849 -x848 -x847 -x846 -x845 -x844 -x843 -x842 -x841 -x840 -x839 -x838 -x837 -x836 -x835 -x834 -x833 -x832 -x831 -x830 -x829 -x828 -x827 x826 x825 -x824 -x823 -x822 -x821 -x820 -x819 -x818 -x817 -x816 -x815 -x814 -x813 -x812 -x811 -x810 -x809 -x808 -x807 -x806 -x805 -x804 -x803 -x802 -x801 -x800 -x799 x798 -x797 -x796 -x795 -x794 -x793 -x792 -x791 -x790 -x789 -x788 -x787 -x786 -x785 -x784 -x783 -x782 -x781 -x780 -x779 -x778 -x777 -x776 -x775 -x774 -x773 -x772 -x771 -x770 -x769 -x768 -x767 -x766 -x765 -x764 -x763 -x762 -x761 -x760 x759 -x758 -x757 -x756 -x755 -x754 -x753 -x752 -x751 -x750 -x749 -x748 -x747 -x746 x745 -x744 -x743 -x742 -x741 -x740 -x739 -x738 -x737 -x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 -x725 -x724 -x723 -x722 -x721 -x720 x719 -x718 -x717 -x716 -x715 -x714 -x713 -x712 -x711 -x710 -x709 -x708 -x707 -x706 -x705 -x704 -x703 -x702 -x701 -x700 -x699 -x698 -x697 -x696 -x695 -x694 -x693 -x692 -x691 -x690 -x689 -x688 -x687 -x686 -x685 -x684 -x683 -x682 -x681 x680 -x679 -x678 -x677 -x676 -x675 -x674 -x673 -x672 -x671 -x670 -x669 -x668 -x667 -x666 -x665 -x664 -x663 -x662 x661 -x660 -x659 -x658 -x657 -x656 -x655 -x654 -x653 -x652 -x651 -x650 -x649 -x648 -x647 -x646 -x645 -x644 -x643 x642 -x641 -x640 -x639 -x638 -x637 -x636 -x635 -x634 -x633 -x632 -x631 -x630 -x629 -x628 -x627 -x626 -x625 -x624 -x623 x622 -x621 -x620 -x619 -x618 -x617 -x616 -x615 -x614 -x613 -x612 -x611 -x610 -x609 -x608 -x607 -x606 -x605 -x604 -x603 -x602 -x601 -x600 -x599 -x598 -x597 x596 -x595 -x594 -x593 -x592 -x591 -x590 -x589 -x588 -x587 -x586 -x585 -x584 -x583 -x582 -x581 -x580 -x579 -x578 -x577 -x576 -x575 -x574 -x573 -x572 -x571 -x570 -x569 -x568 -x567 x566 -x565 -x564 -x563 -x562 -x561 -x560 -x559 -x558 -x557 -x556 -x555 -x554 -x553 -x552 -x551 -x550 -x549 -x548 -x547 -x546 -x545 -x544 -x543 -x542 -x541 -x540 -x539 -x538 -x537 x536 -x535 -x534 -x533 -x532 -x531 -x530 -x529 -x528 -x527 -x526 -x525 -x524 -x523 -x522 -x521 -x520 -x519 -x518 -x517 -x516 -x515 -x514 -x513 -x512 -x511 -x510 -x509 -x508 -x507 -x506 -x505 x504 -x503 -x502 -x501 -x500 -x499 -x498 -x497 -x496 -x495 x494 -x493 -x492 -x491 -x490 -x489 -x488 -x487 -x486 -x485 -x484 -x483 -x482 -x481 -x480 -x479 -x478 -x477 -x476 x475 -x474 -x473 -x472 -x471 -x470 -x469 -x468 -x467 -x466 -x465 -x464 -x463 -x462 -x461 -x460 -x459 -x458 -x457 -x456 -x455 -x454 -x453 -x452 -x451 -x450 -x449 -x448 -x447 -x446 -x445 -x444 -x443 -x442 -x441 -x440 -x439 -x438 -x437 -x436 -x435 -x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 x426 x425 -x424 -x423 -x422 -x421 -x420 -x419 -x418 -x417 -x416 -x415 -x414 -x413 -x412 -x411 -x410 -x409 -x408 -x407 -x406 -x405 -x404 -x403 -x402 -x401 -x400 -x399 -x398 -x397 -x396 -x395 -x394 -x393 -x392 -x391 -x390 -x389 -x388 -x387 -x386 x385 -x384 -x383 -x382 -x381 -x380 -x379 -x378 -x377 -x376 -x375 -x374 -x373 x372 -x371 -x370 -x369 -x368 -x367 -x366 -x365 -x364 -x363 -x362 -x361 -x360 -x359 -x358 -x357 -x356 -x355 -x354 -x353 -x352 -x351 -x350 -x349 -x348 -x347 -x346 -x345 -x344 -x343 -x342 -x341 -x340 -x339 -x338 -x337 -x336 -x335 -x334 -x333 -x332 -x331 -x330 -x329 x328 -x327 -x326 -x325 -x324 -x323 -x322 -x321 -x320 -x319 -x318 -x317 -x316 -x315 -x314 -x313 -x312 -x311 -x310 -x309 -x308 -x307 -x306 -x305 -x304 -x303 -x302 -x301 -x300 -x299 -x298 -x297 -x296 -x295 -x294 x293 -x292 -x291 -x290 -x289 -x288 -x287 -x286 -x285 -x284 -x283 -x282 -x281 -x280 -x279 -x278 -x277 -x276 -x275 -x274 -x273 -x272 -x271 -x270 -x269 x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 -x256 -x255 -x254 -x253 -x252 -x251 -x250 -x249 -x248 -x247 -x246 -x245 -x244 -x243 -x242 -x241 -x240 -x239 -x238 -x237 -x236 -x235 -x234 -x233 -x232 -x231 x230 -x229 -x228 -x227 -x226 -x225 -x224 -x223 -x222 -x221 -x220 -x219 -x218 -x217 -x216 -x215 -x214 -x213 -x212 -x211 -x210 -x209 -x208 -x207 -x206 -x205 -x204 -x203 -x202 -x201 -x200 -x199 -x198 -x197 -x196 -x195 -x194 -x193 -x192 -x191 -x190 -x189 -x188 -x187 -x186 -x185 -x184 -x183 -x182 -x181 x180 -x179 -x178 -x177 -x176 -x175 -x174 -x173 -x172 -x171 -x170 -x169 -x168 -x167 -x166 -x165 -x164 -x163 -x162 -x161 -x160 -x159 -x158 -x157 -x156 -x155 -x154 -x153 x152 -x151 -x150 -x149 -x148 -x147 -x146 x145 -x144 -x143 -x142 -x141 -x140 -x139 -x138 -x137 -x136 -x135 -x134 -x133 -x132 -x131 -x130 -x129 -x128 -x127 -x126 -x125 -x124 -x123 -x122 -x121 -x120 -x119 -x118 -x117 -x116 -x115 -x114 -x113 -x112 -x111 -x110 -x109 -x108 x107 -x106 -x105 -x104 -x103 -x102 -x101 -x100 -x99 -x98 -x97 -x96 -x95 -x94 -x93 -x92 -x91 -x90 -x89 -x88 -x87 -x86 -x85 -x84 -x83 -x82 -x81 -x80 -x79 -x78 -x77 -x76 -x75 x74 -x73 -x72 -x71 -x70 -x69 -x68 -x67 -x66 -x65 -x64 -x63 -x62 -x61 -x60 -x59 -x58 -x57 -x56 -x55 -x54 -x53 -x52 -x51 -x50 -x49 -x48 -x47 -x46 -x45 -x44 -x43 -x42 -x41 -x40 -x39 -x38 -x37 -x36 -x35 -x34 -x33 -x32 -x31 -x30 -x29 -x28 x27 -x26 -x25 -x24 -x23 -x22 -x21 -x20 -x19 -x18 -x17 -x16 -x15 -x14 -x13 -x12 -x11 -x10 -x9 -x8 -x7 -x6 -x5 -x4 -x3 -x2 -x1

Verifier Data

OK	-50

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703640-1338091530/watcher-3703640-1338091530 -o /tmp/evaluation-result-3703640-1338091530/solver-3703640-1338091530 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703640-1338091530.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 3.95 3.90 4/178 21128
/proc/meminfo: memFree=31321976/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=7088 CPUtime=0 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) R 21126 21128 19605 0 -1 4202496 449 0 0 0 0 0 0 0 20 0 1 0 275278708 7258112 401 33554432000 4194304 5965102 140734151093008 140734050307272 5160864 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 1772 401 165 433 0 682 0

[startup+0.0537021 s]
/proc/loadavg: 3.84 3.95 3.90 4/178 21128
/proc/meminfo: memFree=31321976/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=11124 CPUtime=0.05 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) R 21126 21128 19605 0 -1 4202496 1590 0 0 0 5 0 0 0 20 0 1 0 275278708 11390976 1542 33554432000 4194304 5965102 140734151093008 140734050307272 5137146 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 2781 1543 310 433 0 1691 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 11124

[startup+0.10027 s]
/proc/loadavg: 3.84 3.95 3.90 4/178 21128
/proc/meminfo: memFree=31321976/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=15216 CPUtime=0.09 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) R 21126 21128 19605 0 -1 4202496 2775 0 0 0 9 0 0 0 20 0 1 0 275278708 15581184 2661 33554432000 4194304 5965102 140734151093008 140734050307272 4344307 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 3804 2662 456 433 0 2714 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15216

[startup+0.300165 s]
/proc/loadavg: 3.84 3.95 3.90 4/178 21128
/proc/meminfo: memFree=31321976/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=190364 CPUtime=0.34 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 18110 0 0 0 28 6 0 0 20 0 3 0 275278708 194932736 17212 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 47591 17212 197 433 0 47155 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 190364

[startup+0.700172 s]
/proc/loadavg: 3.84 3.95 3.90 4/178 21128
/proc/meminfo: memFree=31321976/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=1.13 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 22010 0 0 0 106 7 0 0 20 0 3 0 275278708 197820416 20680 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 20680 204 433 0 47860 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 193184

[startup+1.50031 s]
/proc/loadavg: 3.84 3.95 3.90 5/181 21131
/proc/meminfo: memFree=31240872/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=2.73 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 22046 0 0 0 266 7 0 0 20 0 3 0 275278708 197820416 20716 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 20716 205 433 0 47860 0
[pid=21128/tid=21130] ppid=21126 vsize=193184 CPUtime=1.26 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 7006 0 0 0 121 5 0 0 20 0 3 0 275278729 197820416 20716 33554432000 4194304 5965102 140734151093008 140033277864472 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=193184 CPUtime=1.27 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 9013 0 0 0 125 2 0 0 20 0 3 0 275278729 197820416 20716 33554432000 4194304 5965102 140734151093008 140033267374440 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 193184

[startup+3.10031 s]
/proc/loadavg: 3.84 3.95 3.90 5/181 21131
/proc/meminfo: memFree=31240112/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=5.92 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 22200 0 0 0 585 7 0 0 20 0 3 0 275278708 197820416 20870 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 20870 205 433 0 47860 0
[pid=21128/tid=21130] ppid=21126 vsize=193184 CPUtime=2.86 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 7104 0 0 0 281 5 0 0 20 0 3 0 275278729 197820416 20870 33554432000 4194304 5965102 140734151093008 140033277864472 5139774 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=193184 CPUtime=2.87 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 9069 0 0 0 285 2 0 0 20 0 3 0 275278729 197820416 20870 33554432000 4194304 5965102 140734151093008 140033267374440 4393958 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 193184

[startup+6.30034 s]
/proc/loadavg: 3.85 3.95 3.90 5/181 21131
/proc/meminfo: memFree=31236384/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=12.32 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 22925 0 0 0 1225 7 0 0 20 0 3 0 275278708 197820416 21223 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 21223 205 433 0 47860 0
[pid=21128/tid=21130] ppid=21126 vsize=193184 CPUtime=6.05 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 7748 0 0 0 600 5 0 0 20 0 3 0 275278729 197820416 21223 33554432000 4194304 5965102 140734151093008 140033277864472 5139774 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=193184 CPUtime=6.06 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 9150 0 0 0 604 2 0 0 20 0 3 0 275278729 197820416 21223 33554432000 4194304 5965102 140734151093008 140033267374392 4404383 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 193184

[startup+12.7003 s]
/proc/loadavg: 3.86 3.95 3.90 5/181 21131
/proc/meminfo: memFree=31218900/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=25.12 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 24018 0 0 0 2504 8 0 0 20 0 3 0 275278708 197820416 22316 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 22316 205 433 0 47860 0
[pid=21128/tid=21130] ppid=21126 vsize=193184 CPUtime=12.44 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 8446 0 0 0 1238 6 0 0 20 0 3 0 275278729 197820416 22316 33554432000 4194304 5965102 140734151093008 140033277864472 5139822 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=193184 CPUtime=12.43 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 9545 0 0 0 1241 2 0 0 20 0 3 0 275278729 197820416 22316 33554432000 4194304 5965102 140734151093008 140033267374328 4400963 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 193184

[startup+25.5004 s]
/proc/loadavg: 3.89 3.96 3.91 5/181 21131
/proc/meminfo: memFree=31157744/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=193184 CPUtime=50.72 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 41452 0 0 0 5057 15 0 0 20 0 3 0 275278708 197820416 30405 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 48296 30405 205 433 0 47860 0
[pid=21128/tid=21130] ppid=21126 vsize=193184 CPUtime=25.2 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 19700 0 0 0 2512 8 0 0 20 0 3 0 275278729 197820416 30405 33554432000 4194304 5965102 140734151093008 140033277864344 5134981 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=193184 CPUtime=25.19 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 15725 0 0 0 2513 6 0 0 20 0 3 0 275278729 197820416 30405 33554432000 4194304 5965102 140734151093008 140033267374392 4401794 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 193184

[startup+51.1004 s]
/proc/loadavg: 3.93 3.96 3.91 5/181 21131
/proc/meminfo: memFree=31043012/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=258720 CPUtime=101.9 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 84996 0 0 0 10156 34 0 0 20 0 3 0 275278708 264929280 48940 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 64680 48940 206 433 0 64244 0
[pid=21128/tid=21130] ppid=21126 vsize=258720 CPUtime=50.74 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 47835 0 0 0 5059 15 0 0 20 0 3 0 275278729 264929280 48940 33554432000 4194304 5965102 140734151093008 140033277864344 5136313 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=258720 CPUtime=50.73 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 31134 0 0 0 5054 19 0 0 20 0 3 0 275278729 264929280 48940 33554432000 4194304 5965102 140734151093008 140033267374392 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 101.9
Current children cumulated vsize (KiB) 258720

[startup+102.3 s]
/proc/loadavg: 3.97 3.96 3.91 5/181 21131
/proc/meminfo: memFree=30801628/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=456952 CPUtime=204.3 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 129322 0 0 0 20367 63 0 0 20 0 3 0 275278708 467918848 85650 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 114238 85650 206 433 0 113802 0
[pid=21128/tid=21130] ppid=21126 vsize=456952 CPUtime=101.81 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 67269 0 0 0 10157 24 0 0 20 0 3 0 275278729 467918848 85650 33554432000 4194304 5965102 140734151093008 140033277863736 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=456952 CPUtime=101.79 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 56026 0 0 0 10140 39 0 0 20 0 3 0 275278729 467918848 85650 33554432000 4194304 5965102 140734151093008 140033267374392 5137076 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 204.3
Current children cumulated vsize (KiB) 456952

[startup+162.3 s]
/proc/loadavg: 4.07 3.99 3.91 5/181 21132
/proc/meminfo: memFree=30596436/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=588024 CPUtime=324.26 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 163414 0 0 0 32339 87 0 0 20 0 3 0 275278708 602136576 119741 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 147006 119741 206 433 0 146570 0
[pid=21128/tid=21130] ppid=21126 vsize=588024 CPUtime=161.65 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 77140 0 0 0 16131 34 0 0 20 0 3 0 275278729 602136576 119741 33554432000 4194304 5965102 140734151093008 140033277863928 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=588024 CPUtime=161.63 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 80247 0 0 0 16106 57 0 0 20 0 3 0 275278729 602136576 119741 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 324.26
Current children cumulated vsize (KiB) 588024

[startup+222.307 s]
/proc/loadavg: 4.02 3.99 3.91 5/181 21132
/proc/meminfo: memFree=30415380/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=721528 CPUtime=444.24 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 195926 0 0 0 44314 110 0 0 20 0 3 0 275278708 738844672 153248 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 180382 153248 206 433 0 179946 0
[pid=21128/tid=21130] ppid=21126 vsize=721528 CPUtime=221.49 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 84289 0 0 0 22109 40 0 0 20 0 3 0 275278729 738844672 153248 33554432000 4194304 5965102 140734151093008 140033277863976 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=721528 CPUtime=221.47 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 105610 0 0 0 22072 75 0 0 20 0 3 0 275278729 738844672 153248 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 444.24
Current children cumulated vsize (KiB) 721528

[startup+282.3 s]
/proc/loadavg: 4.01 3.99 3.91 5/182 21135
/proc/meminfo: memFree=30287308/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=787476 CPUtime=564.18 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 218960 0 0 0 56290 128 0 0 20 0 3 0 275278708 806375424 176242 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 196869 176242 206 433 0 196433 0
[pid=21128/tid=21130] ppid=21126 vsize=787476 CPUtime=281.33 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 86774 0 0 0 28090 43 0 0 20 0 3 0 275278729 806375424 176242 33554432000 4194304 5965102 140734151093008 140033277863736 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=787476 CPUtime=281.27 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 126159 0 0 0 28035 92 0 0 20 0 3 0 275278729 806375424 176242 33554432000 4194304 5965102 140734151093008 140033267374392 4401441 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 564.18
Current children cumulated vsize (KiB) 787476

[startup+342.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21135
/proc/meminfo: memFree=30252500/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=787608 CPUtime=684.12 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 221948 0 0 0 68282 130 0 0 20 0 3 0 275278708 806510592 179187 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 196902 179187 206 433 0 196466 0

################
# More data... #
################

[pid=21128/tid=21131] ppid=21126 vsize=787608 CPUtime=341.08 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 128189 0 0 0 34013 95 0 0 20 0 3 0 275278729 806510592 179187 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 684.12
Current children cumulated vsize (KiB) 787608

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21135
/proc/meminfo: memFree=30201812/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=853416 CPUtime=804.08 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 225723 0 0 0 80271 137 0 0 20 0 3 0 275278708 873897984 183009 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 213354 183009 206 433 0 212918 0
[pid=21128/tid=21130] ppid=21126 vsize=853416 CPUtime=401 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 91424 0 0 0 40048 52 0 0 20 0 3 0 275278729 873897984 183009 33554432000 4194304 5965102 140734151093008 140033277863976 4400978 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=853416 CPUtime=400.91 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 128272 0 0 0 39995 96 0 0 20 0 3 0 275278729 873897984 183009 33554432000 4194304 5965102 140734151093008 140033267374152 4401009 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 804.08
Current children cumulated vsize (KiB) 853416

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21136
/proc/meminfo: memFree=30158812/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=853548 CPUtime=924.02 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 235651 0 0 0 92252 150 0 0 20 0 3 0 275278708 874033152 192935 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 213387 192935 206 433 0 212951 0
[pid=21128/tid=21130] ppid=21126 vsize=853548 CPUtime=460.84 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 95339 0 0 0 46025 59 0 0 20 0 3 0 275278729 874033152 192935 33554432000 4194304 5965102 140734151093008 140033277863976 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=853548 CPUtime=460.72 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 134285 0 0 0 45971 101 0 0 20 0 3 0 275278729 874033152 192935 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 924.02
Current children cumulated vsize (KiB) 853548

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21136
/proc/meminfo: memFree=29994416/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=984888 CPUtime=1043.98 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 269225 0 0 0 104221 177 0 0 20 0 3 0 275278708 1008525312 226470 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 246222 226470 206 433 0 245786 0
[pid=21128/tid=21130] ppid=21126 vsize=984888 CPUtime=520.67 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 99460 0 0 0 52002 65 0 0 20 0 3 0 275278729 1008525312 226470 33554432000 4194304 5965102 140734151093008 140033277863928 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=984888 CPUtime=520.54 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 163738 0 0 0 51929 125 0 0 20 0 3 0 275278729 1008525312 226470 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1043.98
Current children cumulated vsize (KiB) 984888

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21136
/proc/meminfo: memFree=29843336/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1117196 CPUtime=1163.94 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 298854 0 0 0 116194 200 0 0 20 0 3 0 275278708 1144008704 256805 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 279299 256805 206 433 0 278863 0
[pid=21128/tid=21130] ppid=21126 vsize=1117196 CPUtime=580.51 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 103409 0 0 0 57982 69 0 0 20 0 3 0 275278729 1144008704 256805 33554432000 4194304 5965102 140734151093008 140033277863976 4401127 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1117196 CPUtime=580.38 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 189418 0 0 0 57892 146 0 0 20 0 3 0 275278729 1144008704 256805 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1163.94
Current children cumulated vsize (KiB) 1117196

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 21136
/proc/meminfo: memFree=29711180/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1183004 CPUtime=1283.92 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 325548 0 0 0 128169 223 0 0 20 0 3 0 275278708 1211396096 283498 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 295751 283498 206 433 0 295315 0
[pid=21128/tid=21130] ppid=21126 vsize=1183004 CPUtime=640.36 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 106784 0 0 0 63962 74 0 0 20 0 3 0 275278729 1211396096 283498 33554432000 4194304 5965102 140734151093008 140033277863928 4401582 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1183004 CPUtime=640.23 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 212737 0 0 0 63857 166 0 0 20 0 3 0 275278729 1211396096 283498 33554432000 4194304 5965102 140734151093008 140033267374392 4401143 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1283.92
Current children cumulated vsize (KiB) 1183004

[startup+702.3 s]
/proc/loadavg: 4.03 4.00 3.92 5/181 21136
/proc/meminfo: memFree=29581636/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1312120 CPUtime=1403.91 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 348643 0 0 0 140152 239 0 0 20 0 3 0 275278708 1343610880 303310 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 328030 303310 206 433 0 327594 0
[pid=21128/tid=21130] ppid=21126 vsize=1312120 CPUtime=700.2 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107510 0 0 0 69945 75 0 0 20 0 3 0 275278729 1343610880 303310 33554432000 4194304 5965102 140734151093008 140033277864776 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1312120 CPUtime=700.07 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 235106 0 0 0 69824 183 0 0 20 0 3 0 275278729 1343610880 303310 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1403.91
Current children cumulated vsize (KiB) 1312120

[startup+762.3 s]
/proc/loadavg: 4.01 4.00 3.92 5/181 21137
/proc/meminfo: memFree=29407568/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1379148 CPUtime=1523.9 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 371304 0 0 0 152134 256 0 0 20 0 3 0 275278708 1412247552 325971 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 344787 325971 206 433 0 344351 0
[pid=21128/tid=21130] ppid=21126 vsize=1379148 CPUtime=760.06 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107740 0 0 0 75930 76 0 0 20 0 3 0 275278729 1412247552 325971 33554432000 4194304 5965102 140734151093008 140033277864776 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1379148 CPUtime=759.92 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 257537 0 0 0 75791 201 0 0 20 0 3 0 275278729 1412247552 325971 33554432000 4194304 5965102 140734151093008 140033267374392 4401129 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1523.9
Current children cumulated vsize (KiB) 1379148

[startup+822.3 s]
/proc/loadavg: 3.94 3.98 3.91 5/181 21178
/proc/meminfo: memFree=30049788/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1444936 CPUtime=1643.87 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 393509 0 0 0 164114 273 0 0 20 0 3 0 275278708 1479614464 348180 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 361234 348180 206 433 0 360798 0
[pid=21128/tid=21130] ppid=21126 vsize=1444936 CPUtime=819.9 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107768 0 0 0 81913 77 0 0 20 0 3 0 275278729 1479614464 348180 33554432000 4194304 5965102 140734151093008 140033277864776 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1444936 CPUtime=819.76 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 279714 0 0 0 81757 219 0 0 20 0 3 0 275278729 1479614464 348180 33554432000 4194304 5965102 140734151093008 140033267374392 4400960 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1643.87
Current children cumulated vsize (KiB) 1444936

[startup+882.307 s]
/proc/loadavg: 3.98 3.98 3.91 5/182 21181
/proc/meminfo: memFree=29801436/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1576148 CPUtime=1763.83 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 418578 0 0 0 176083 300 0 0 20 0 3 0 275278708 1613975552 373217 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 394037 373217 206 433 0 393601 0
[pid=21128/tid=21130] ppid=21126 vsize=1576148 CPUtime=879.75 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107831 0 0 0 87897 78 0 0 20 0 3 0 275278729 1613975552 373217 33554432000 4194304 5965102 140734151093008 140033277864776 4401127 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1576148 CPUtime=879.56 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 304720 0 0 0 87709 247 0 0 20 0 3 0 275278729 1613975552 373217 33554432000 4194304 5965102 140734151093008 140033267374392 4401137 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1763.83
Current children cumulated vsize (KiB) 1576148



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.4 s]
/proc/loadavg: 3.98 3.98 3.91 5/182 21181
/proc/meminfo: memFree=29737296/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1576148 CPUtime=1800.01 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 425366 0 0 0 179691 310 0 0 20 0 3 0 275278708 1613975552 380006 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 394037 380006 206 433 0 393601 0
[pid=21128/tid=21130] ppid=21126 vsize=1576148 CPUtime=897.8 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107923 0 0 0 89702 78 0 0 20 0 3 0 275278729 1613975552 380006 33554432000 4194304 5965102 140734151093008 140033277864776 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1576148 CPUtime=897.6 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 311416 0 0 0 89503 257 0 0 20 0 3 0 275278729 1613975552 380006 33554432000 4194304 5965102 140734151093008 140033267374392 4401078 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1576148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.4 s]
/proc/loadavg: 3.98 3.98 3.91 5/182 21181
/proc/meminfo: memFree=29737296/32873844 swapFree=7112/7112
[pid=21128] ppid=21126 vsize=1576148 CPUtime=1800.01 cores=0,2,4,6
/proc/21128/stat : 21128 (pwbo2.0) S 21126 21128 19605 0 -1 4202496 425366 0 0 0 179691 310 0 0 20 0 3 0 275278708 1613975552 380006 33554432000 4194304 5965102 140734151093008 140734151092528 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/21128/statm: 394037 380006 206 433 0 393601 0
[pid=21128/tid=21130] ppid=21126 vsize=1576148 CPUtime=897.8 cores=0,2,4,6
/proc/21128/task/21130/stat : 21130 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 107923 0 0 0 89702 78 0 0 20 0 3 0 275278729 1613975552 380006 33554432000 4194304 5965102 140734151093008 140033277864776 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=21128/tid=21131] ppid=21126 vsize=1576148 CPUtime=897.6 cores=0,2,4,6
/proc/21128/task/21131/stat : 21131 (pwbo2.0) R 21126 21128 19605 0 -1 4202560 311416 0 0 0 89503 257 0 0 20 0 3 0 275278729 1613975552 380006 33554432000 4194304 5965102 140734151093008 140033267374392 4401078 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1576148

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21128 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=279532
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=446476
# CPU time returned by wait4() is 1795.73
# while last known CPU time is 1800.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.484
CPU time (s): 1800.01
CPU user time (s): 1796.91
CPU system time (s): 3.1
CPU usage (%): 199.894
Max. virtual memory (cumulated for all children) (KiB): 1576148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.28
system time used= 3.44648
maximum resident set size= 1520044
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 425371
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2143
involuntary context switches= 2317

runsolver used 3.70044 second user time and 3.24551 second system time

The end

Launcher Data

Begin job on node119 at 2012-05-27 06:05:30
IDJOB=3703640
IDBENCH=2248
IDSOLVER=2279
FILE ID=node119/3703640-1338091530
RUNJOBID= node119-1338085105-19621
PBS_JOBID= 14624426
Free space on /tmp= 71604 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/~kexu/benchmarks/frb56-25-opb/normalized-frb56-25-2.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703640-1338091530/watcher-3703640-1338091530 -o /tmp/evaluation-result-3703640-1338091530/solver-3703640-1338091530 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703640-1338091530.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 62a6bdf0e089cd0b8a79007277394096
RANDOM SEED=1950899453

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31322240 kB
Buffers:          255332 kB
Cached:           269944 kB
SwapCached:         1776 kB
Active:           698820 kB
Inactive:          56672 kB
Active(anon):     230524 kB
Inactive(anon):     1972 kB
Active(file):     468296 kB
Inactive(file):    54700 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100168 kB
Dirty:              7800 kB
Writeback:             0 kB
AnonPages:        235256 kB
Mapped:            12544 kB
Shmem:                 8 kB
Slab:             655608 kB
SReclaimable:      97828 kB
SUnreclaim:       557780 kB
KernelStack:        1472 kB
PageTables:         4472 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     171152 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71596 MiB
End job on node119 at 2012-05-27 06:20:33