Trace number 3703599

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)1167 1800.11 900.371

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
vtxcov/normalized-vtxcov_v2000_e4000_7.opb.PB06.opb
MD5SUMff2125c4e604678d0c316c16eb28ba7d
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1040
Best CPU time to get the best result obtained on this benchmark1796.74
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1035
Optimality of the best value was proved NO
Number of variables1968
Total number of constraints4000
Number of constraints which are clauses4000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1968
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1968
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1968
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703599-1338088933.opb.
0.00/0.00	c Instance file HOME/instance-3703599-1338088933.opb
0.00/0.00	c File size is 112221 bytes.
0.00/0.01	c Cost Offset: 0
0.00/0.01	c Highest Coefficient sum: 3
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      1968                                                |
0.00/0.01	c |  Number Clauses:        4000                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 0                                                   |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.11/900.31	o 1195
1800.11/900.31	o 1183
1800.11/900.31	o 1182
1800.11/900.31	o 1178
1800.11/900.31	o 1174
1800.11/900.31	o 1167
1800.11/900.31	c ===============================================================================
1800.11/900.31	c Wall Clock Time: 900.31 s
1800.11/900.31	c Best Solution: 1167
1800.11/900.31	s SATISFIABLE
1800.11/900.31	v x1 x2 x3 x4 x5 x6 x7 -x8 x9 -x10 -x11 x12 -x13 -x14 -x15 -x16 x17 x18 -x19 x20 -x21 x22 -x23 x24 x25 -x26 x27 x28 x29 x30 -x31 x32 x33 x34 x35 x36 x37 x38 x39 x40 x41 -x42 x43 x44 -x45 x46 x47 -x48 x49 -x50 -x51 -x52 x53 x54 -x55 x56 x57 -x58 -x59 -x60 -x61 -x62 x63 -x64 -x65 -x66 -x67 x68 x69 -x70 x71 x72 x73 x74 x75 x76 x77 x78 x79 x80 x81 -x82 x83 -x84 x85 x86 -x87 x88 x89 x90 x91 -x92 -x93 -x94 x95 -x96 x97 x98 -x99 x100 -x101 -x102 -x103 x104 x105 x106 -x107 x108 x109 x110 x111 x112 -x113 x114 x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 x123 x124 -x125 -x126 x127 x128 -x129 -x130 -x131 -x132 -x133 x134 x135 x136 -x137 x138 -x139 x140 x141 -x142 -x143 x144 -x145 x146 x147 x148 x149 x150 x151 x152 -x153 -x154 -x155 x156 x157 x158 x159 x160 x161 -x162 -x163 -x164 -x165 -x166 x167 x168 x169 x170 x171 -x172 x173 x174 x175 -x176 x177 x178 -x179 x180 x181 -x182 x183 -x184 x185 x186 x187 -x188 x189 -x190 -x191 x192 -x193 -x194 x195 x196 x197 x198 x199 x200 x201 -x202 x203 -x204 x205 x206 -x207 x208 x209 -x210 -x211 x212 -x213 -x214 x215 x216 x217 -x218 x219 x220 -x221 -x222 -x223 x224 -x225 x226 x227 x228 x229 x230 x231 x232 x233 x234 x235 x236 x237 x238 x239 x240 x241 x242 x243 -x244 -x245 x246 -x247 x248 -x249 x250 x251 -x252 x253 x254 x255 x256 x257 x258 x259 x260 x261 x262 x263 -x264 x265 x266 x267 -x268 -x269 x270 x271 x272 x273 x274 x275 x276 x277 x278 -x279 x280 x281 -x282 -x283 x284 -x285 -x286 x287 x288 -x289 -x290 -x291 -x292 x293 x294 x295 -x296 x297 -x298 -x299 x300 -x301 -x302 -x303 x304 -x305 -x306 x307 x308 x309 -x310 -x311 -x312 x313 x314 -x315 x316 x317 x318 x319 x320 -x321 -x322 x323 -x324 -x325 -x326 -x327 -x328 x329 x330 x331 -x332 x333 x334 -x335 -x336 x337 -x338 x339 -x340 x341 x342 x343 x344 x345 x346 x347 x348 x349 x350 -x351 x352 x353 -x354 x355 x356 -x357 x358 x359 x360 x361 -x362 x363 -x364 x365 -x366 x367 -x368 -x369 -x370 -x371 -x372 x373 x374 -x375 -x376 x377 x378 x379 x380 -x381 x382 -x383 x384 x385 -x386 -x387 x388 x389 x390 x391 x392 x393 -x394 x395 x396 -x397 x398 x399 x400 -x401 x402 -x403 -x404 -x405 x406 x407 -x408 x409 -x410 -x411 -x412 x413 x414 x415 -x416 -x417 x418 x419 x420 -x421 -x422 -x423 -x424 x425 x426 -x427 x428 x429 x430 x431 x432 -x433 x434 x435 -x436 -x437 -x438 -x439 -x440 x441 x442 x443 -x444 x445 x446 x447 x448 -x449 -x450 x451 -x452 -x453 -x454 x455 x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 x471 -x472 x473 -x474 -x475 x476 -x477 x478 -x479 -x480 x481 x482 -x483 x484 x485 x486 -x487 x488 -x489 -x490 x491 x492 x493 x494 x495 x496 -x497 x498 x499 x500 x501 x502 -x503 x504 x505 -x506 x507 x508 -x509 -x510 x511 x512 x513 x514 -x515 x516 -x517 -x518 x519 x520 x521 x522 x523 x524 -x525 -x526 x527 -x528 -x529 x530 -x531 -x532 -x533 -x534 -x535 -x536 x537 x538 x539 -x540 -x541 -x542 x543 x544 x545 x546 -x547 x548 x549 x550 x551 x552 -x553 x554 x555 -x556 x557 x558 -x559 -x560 -x561 -x562 x563 -x564 x565 -x566 x567 -x568 x569 x570 x571 -x572 -x573 x574 x575 x576 x577 -x578 x579 x580 x581 x582 x583 -x584 x585 x586 x587 -x588 x589 -x590 x591 -x592 x593 x594 x595 -x596 -x597 x598 x599 -x600 x601 x602 x603 -x604 -x605 x606 x607 x608 x609 x610 -x611 -x612 -x613 x614 x615 -x616 x617 x618 x619 -x620 -x621 -x622 x623 x624 -x625 -x626 -x627 x628 -x629 -x630 -x631 -x632 -x633 -x634 -x635 x636 -x637 -x638 x639 -x640 -x641 x642 x643 x644 -x645 -x646 -x647 -x648 -x649 -x650 x651 -x652 -x653 x654 -x655 -x656 x657 x658 -x659 x660 x661 -x662 x663 x664 -x665 x666 x667 x668 x669 x670 x671 -x672 x673 x674 x675 -x676 -x677 -x678 -x679 x680 -x681 x682 -x683 x684 -x685 -x686 -x687 -x688 -x689 -x690 x691 x692 x693 -x694 x695 x696 -x697 -x698 -x699 x700 x701 x702 x703 x704 -x705 x706 -x707 x708 x709 x710 x711 -x712 x713 x714 x715 -x716 x717 x718 -x719 x720 -x721 -x722 x723 -x724 x725 x726 -x727 x728 -x729 -x730 -x731 -x732 -x733 x734 x735 -x736 -x737 x738 x739 x740 x741 -x742 -x743 x744 x745 -x746 x747 x748 -x749 x750 -x751 -x752 -x753 -x754 x755 -x756 -x757 -x758 -x759 -x760 -x761 x762 -x763 x764 -x765 -x766 x767 -x768 x769 -x770 x771 -x772 -x773 x774 x775 -x776 x777 x778 x779 x780 -x781 x782 x783 -x784 x785 x786 x787 -x788 x789 x790 -x791 -x792 x793 -x794 -x795 -x796 x797 x798 x799 x800 -x801 -x802 -x803 x804 x805 -x806 -x807 -x808 -x809 -x810 -x811 -x812 -x813 -x814 -x815 -x816 x817 -x818 x819 x820 -x821 x822 x823 x824 x825 -x826 -x827 -x828 x829 -x830 x831 -x832 x833 -x834 x835 x836 x837 -x838 x839 -x840 -x841 x842 x843 -x844 x845 x846 -x847 -x848 x849 -x850 -x851 -x852 -x853 -x854 -x855 x856 x857 -x858 -x859 -x860 -x861 -x862 x863 -x864 -x865 -x866 -x867 -x868 -x869 -x870 -x871 x872 -x873 x874 -x875 -x876 -x877 -x878 -x879 -x880 -x881 -x882 -x883 -x884 -x885 -x886 -x887 -x888 -x889 -x890 x891 x892 x893 -x894 -x895 -x896 x897 x898 x899 x900 x901 -x902 -x903 -x904 x905 x906 x907 -x908 x909 -x910 -x911 -x912 x913 -x914 x915 -x916 x917 x918 x919 x920 x921 -x922 x923 -x924 x925 x926 x927 -x928 x929 x930 x931 x932 x933 -x934 x935 x936 -x937 -x938 -x939 -x940 -x941 x942 -x943 x944 -x945 -x946 -x947 -x948 -x949 -x950 -x951 -x952 x953 -x954 -x955 x956 -x957 -x958 -x959 -x960 -x961 -x962 -x963 -x964 -x965 -x966 -x967 -x968 -x969 -x970 -x971 -x972 -x973 -x974 -x975 -x976 -x977 -x978 -x979 -x980 -x981 -x982 -x983 -x984 -x985 -x986 -x987 -x988 x989 -x990 -x991 -x992 -x993 -x994 -x995 x996 x997 -x998 -x999 -x1000 -x1001 -x1002 -x1003 -x1004 -x1005 -x1006 x1007 -x1008 -x1009 -x1010 -x1011 -x1012 x1013 x1014 -x1015 -x1016 -x1017 x1018 -x1019 -x1020 x1021 x1022 x1023 x1024 x1025 x1026 -x1027 -x1028 -x1029 x1030 -x1031 -x1032 -x1033 x1034 x1035 x1036 -x1037 -x1038 x1039 x1040 x1041 x1042 x1043 -x1044 -x1045 x1046 x1047 x1048 x1049 -x1050 x1051 x1052 x1053 -x1054 x1055 x1056 x1057 x1058 -x1059 x1060 x1061 x1062 x1063 x1064 x1065 x1066 x1067 x1068 -x1069 x1070 x1071 -x1072 x1073 -x1074 -x1075 x1076 x1077 -x1078 x1079 x1080 x1081 x1082 x1083 -x1084 x1085 x1086 x1087 -x1088 x1089 x1090 -x1091 -x1092 -x1093 -x1094 x1095 -x1096 -x1097 x1098 x1099 x1100 x1101 x1102 x1103 x1104 x1105 x1106 x1107 x1108 -x1109 -x1110 -x1111 x1112 -x1113 x1114 -x1115 -x1116 -x1117 x1118 x1119 -x1120 x1121 x1122 x1123 x1124 x1125 x1126 -x1127 x1128 x1129 x1130 x1131 -x1132 x1133 x1134 x1135 -x1136 -x1137 x1138 x1139 -x1140 x1141 -x1142 -x1143 -x1144 x1145 -x1146 -x1147 x1148 x1149 -x1150 -x1151 x1152 -x1153 x1154 x1155 -x1156 x1157 x1158 x1159 x1160 x1161 -x1162 x1163 -x1164 -x1165 -x1166 -x1167 x1168 -x1169 x1170 x1171 x1172 x1173 x1174 -x1175 x1176 -x1177 x1178 x1179 x1180 x1181 x1182 x1183 x1184 x1185 x1186 x1187 -x1188 -x1189 x1190 x1191 -x1192 x1193 x1194 x1195 x1196 x1197 x1198 x1199 x1200 x1201 -x1202 -x1203 x1204 x1205 x1206 x1207 x1208 x1209 x1210 x1211 x1212 x1213 x1214 x1215 x1216 -x1217 -x1218 -x1219 -x1220 -x1221 x1222 x1223 x1224 -x1225 x1226 x1227 x1228 x1229 x1230 x1231 x1232 x1233 x1234 x1235 x1236 -x1237 -x1238 -x1239 -x1240 -x1241 -x1242 -x1243 x1244 x1245 -x1246 x1247 x1248 x1249 x1250 -x1251 -x1252 x1253 -x1254 x1255 x1256 x1257 -x1258 x1259 x1260 x1261 -x1262 x1263 -x1264 x1265 x1266 x1267 -x1268 x1269 x1270 -x1271 x1272 x1273 x1274 -x1275 x1276 x1277 x1278 -x1279 -x1280 -x1281 -x1282 x1283 x1284 x1285 -x1286 -x1287 -x1288 x1289 x1290 -x1291 -x1292 -x1293 x1294 -x1295 -x1296 x1297 x1298 x1299 x1300 x1301 x1302 -x1303 -x1304 -x1305 x1306 x1307 x1308 x1309 x1310 x1311 -x1312 x1313 x1314 -x1315 -x1316 -x1317 -x1318 x1319 x1320 x1321 x1322 -x1323 x1324 x1325 -x1326 x1327 -x1328 -x1329 -x1330 x1331 x1332 x1333 x1334 x1335 -x1336 -x1337 -x1338 -x1339 -x1340 -x1341 -x1342 -x1343 x1344 -x1345 x1346 -x1347 x1348 -x1349 x1350 x1351 x1352 -x1353 -x1354 x1355 x1356 -x1357 x1358 x1359 x1360 x1361 x1362 -x1363 x1364 -x1365 x1366 -x1367 x1368 x1369 -x1370 -x1371 x1372 -x1373 -x1374 x1375 -x1376 x1377 -x1378 x1379 -x1380 x1381 -x1382 x1383 -x1384 x1385 x1386 x1387 -x1388 x1389 x1390 x1391 x1392 -x1393 x1394 -x1395 -x1396 x1397 x1398 -x1399 -x1400 x1401 x1402 x1403 x1404 -x1405 x1406 x1407 -x1408 x1409 x1410 x1411 x1412 x1413 x1414 x1415 -x1416 -x1417 -x1418 x1419 x1420 x1421 x1422 x1423 -x1424 x1425 x1426 x1427 x1428 -x1429 x1430 x1431 -x1432 -x1433 x1434 x1435 -x1436 x1437 x1438 x1439 x1440 -x1441 x1442 x1443 -x1444 -x1445 x1446 x1447 x1448 x1449 x1450 x1451 x1452 x1453 -x1454 x1455 x1456 x1457 x1458 -x1459 -x1460 x1461 x1462 x1463 x1464 -x1465 x1466 x1467 x1468 x1469 -x1470 x1471 x1472 -x1473 x1474 x1475 -x1476 x1477 x1478 -x1479 -x1480 x1481 x1482 x1483 x1484 x1485 -x1486 -x1487 -x1488 x1489 x1490 x1491 -x1492 x1493 -x1494 x1495 x1496 x1497 -x1498 -x1499 x1500 x1501 x1502 x1503 x1504 x1505 -x1506 x1507 x1508 x1509 -x1510 x1511 x1512 x1513 -x1514 -x1515 x1516 x1517 x1518 x1519 x1520 x1521 -x1522 x1523 x1524 x1525 x1526 x1527 x1528 x1529 x1530 x1531 x1532 x1533 x1534 x1535 x1536 x1537 -x1538 x1539 x1540 x1541 x1542 -x1543 -x1544 -x1545 -x1546 x1547 x1548 x1549 x1550 -x1551 x1552 x1553 x1554 -x1555 x1556 -x1557 x1558 x1559 -x1560 -x1561 x1562 x1563 -x1564 -x1565 x1566 -x1567 x1568 -x1569 -x1570 -x1571 -x1572 x1573 -x1574 -x1575 -x1576 x1577 x1578 -x1579 -x1580 -x1581 -x1582 -x1583 -x1584 -x1585 -x1586 -x1587 -x1588 x1589 -x1590 -x1591 x1592 -x1593 -x1594 x1595 x1596 x1597 x1598 x1599 -x1600 -x1601 x1602 x1603 x1604 x1605 x1606 x1607 x1608 -x1609 x1610 x1611 x1612 x1613 x1614 x1615 -x1616 x1617 x1618 -x1619 x1620 x1621 x1622 x1623 -x1624 x1625 x1626 -x1627 x1628 x1629 x1630 -x1631 -x1632 x1633 x1634 x1635 -x1636 x1637 x1638 x1639 x1640 -x1641 x1642 x1643 -x1644 x1645 -x1646 x1647 -x1648 x1649 x1650 x1651 x1652 x1653 x1654 x1655 x1656 x1657 x1658 x1659 x1660 x1661 x1662 x1663 x1664 -x1665 x1666 x1667 x1668 x1669 -x1670 x1671 x1672 x1673 x1674 x1675 -x1676 -x1677 x1678 -x1679 -x1680 -x1681 -x1682 x1683 x1684 -x1685 x1686 -x1687 -x1688 x1689 x1690 x1691 -x1692 -x1693 -x1694 -x1695 x1696 -x1697 x1698 x1699 x1700 x1701 x1702 x1703 x1704 x1705 x1706 x1707 -x1708 x1709 -x1710 -x1711 x1712 x1713 x1714 x1715 x1716 x1717 -x1718 x1719 x1720 x1721 x1722 x1723 x1724 -x1725 x1726 x1727 -x1728 -x1729 -x1730 x1731 -x1732 -x1733 -x1734 -x1735 -x1736 x1737 x1738 -x1739 -x1740 x1741 x1742 x1743 x1744 -x1745 -x1746 -x1747 -x1748 -x1749 -x1750 x1751 x1752 x1753 x1754 x1755 -x1756 -x1757 -x1758 x1759 x1760 x1761 x1762 -x1763 -x1764 -x1765 x1766 x1767 x1768 x1769 x1770 -x1771 x1772 -x1773 x1774 -x1775 -x1776 x1777 x1778 x1779 -x1780 x1781 x1782 x1783 -x1784 x1785 x1786 x1787 x1788 -x1789 -x1790 x1791 x1792 -x1793 x1794 x1795 x1796 x1797 x1798 x1799 x1800 x1801 x1802 -x1803 x1804 x1805 x1806 x1807 x1808 x1809 x1810 x1811 x1812 x1813 x1814 x1815 x1816 x1817 x1818 x1819 -x1820 x1821 x1822 x1823 x1824 x1825 x1826 -x1827 x1828 x1829 x1830 x1831 x1832 x1833 x1834 x1835 x1836 x1837 -x1838 x1839 x1840 x1841 x1842 -x1843 x1844 x1845 x1846 x1847 x1848 x1849 -x1850 -x1851 x1852 x1853 x1854 x1855 -x1856 x1857 x1858 -x1859 x1860 x1861 x1862 x1863 x1864 x1865 x1866 x1867 x1868 -x1869 x1870 x1871 -x1872 x1873 x1874 x1875 -x1876 x1877 x1878 x1879 x1880 x1881 -x1882 -x1883 x1884 -x1885 x1886 x1887 x1888 x1889 x1890 x1891 x1892 -x1893 x1894 x1895 -x1896 x1897 x1898 x1899 x1900 x1901 x1902 -x1903 x1904 x1905 x1906 x1907 x1908 x1909 -x1910 x1911 x1912 x1913 -x1914 -x1915 -x1916 x1917 x1918 x1919 x1920 x1921 x1922 -x1923 x1924 x1925 x1926 x1927 -x1928 -x1929 x1930 x1931 x1932 -x1933 -x1934 x1935 x1936 x1937 x1938 x1939 x1940 -x1941 x1942 x1943 x1944 x1945 x1946 x1947 x1948 x1949 x1950 x1951 x1952 x1953 x1954 x1955 x1956 x1957 -x1958 x1959 x1960 -x1961 x1962 x1963 x1964 x1965 x1966 x1967 -x1968

Verifier Data 

OK	1167

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703599-1338088933/watcher-3703599-1338088933 -o /tmp/evaluation-result-3703599-1338088933/solver-3703599-1338088933 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703599-1338088933.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 3.84 3.15 4/178 25300
/proc/meminfo: memFree=30399232/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=4820 CPUtime=0 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) R 25298 25300 25163 0 -1 4202496 481 0 0 0 0 0 0 0 20 0 1 0 275018770 4935680 433 33554432000 4194304 5965102 140735909715232 140735718903880 4355744 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 1205 433 163 433 0 741 0

[startup+0.070767 s]
/proc/loadavg: 3.84 3.84 3.15 4/178 25300
/proc/meminfo: memFree=30399232/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=177888 CPUtime=0.11 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 8015 0 0 0 10 1 0 0 20 0 3 0 275018770 182157312 7873 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 44472 7876 202 433 0 44036 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 177888

[startup+0.10023 s]
/proc/loadavg: 3.84 3.84 3.15 4/178 25300
/proc/meminfo: memFree=30399232/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=181896 CPUtime=0.17 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 8980 0 0 0 15 2 0 0 20 0 3 0 275018770 186261504 8837 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45474 8838 203 433 0 45038 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 181896

[startup+0.300181 s]
/proc/loadavg: 3.84 3.84 3.15 4/178 25300
/proc/meminfo: memFree=30399232/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182076 CPUtime=0.57 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 9493 0 0 0 55 2 0 0 20 0 3 0 275018770 186445824 9258 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45519 9258 203 433 0 45083 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 182076

[startup+0.700181 s]
/proc/loadavg: 3.84 3.84 3.15 4/178 25300
/proc/meminfo: memFree=30399232/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182244 CPUtime=1.36 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 10580 0 0 0 134 2 0 0 20 0 3 0 275018770 186617856 9800 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45561 9800 205 433 0 45125 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 182244

[startup+1.50023 s]
/proc/loadavg: 3.84 3.84 3.15 5/181 25303
/proc/meminfo: memFree=30352476/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182244 CPUtime=2.96 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 13278 0 0 0 293 3 0 0 20 0 3 0 275018770 186617856 11023 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45561 11023 205 433 0 45125 0
[pid=25300/tid=25302] ppid=25298 vsize=182244 CPUtime=1.46 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 4421 0 0 0 144 2 0 0 20 0 3 0 275018771 186617856 11023 33554432000 4194304 5965102 140735909715232 140586259716632 5139822 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=182244 CPUtime=1.47 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 7732 0 0 0 145 2 0 0 20 0 3 0 275018771 186617856 11023 33554432000 4194304 5965102 140735909715232 140586249226600 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 182244

[startup+3.10024 s]
/proc/loadavg: 3.84 3.84 3.15 5/181 25303
/proc/meminfo: memFree=30337836/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182244 CPUtime=6.16 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 19778 0 0 0 611 5 0 0 20 0 3 0 275018770 186617856 14013 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45561 14013 206 433 0 45125 0
[pid=25300/tid=25302] ppid=25298 vsize=182244 CPUtime=3.06 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 10709 0 0 0 303 3 0 0 20 0 3 0 275018771 186617856 14013 33554432000 4194304 5965102 140735909715232 140586259716632 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=182244 CPUtime=3.07 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 7944 0 0 0 305 2 0 0 20 0 3 0 275018771 186617856 14013 33554432000 4194304 5965102 140735909715232 140586249226552 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 182244

[startup+6.30036 s]
/proc/loadavg: 3.85 3.85 3.15 5/181 25303
/proc/meminfo: memFree=30307528/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182244 CPUtime=12.56 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 22245 0 0 0 1250 6 0 0 20 0 3 0 275018770 186617856 16200 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45561 16200 206 433 0 45125 0
[pid=25300/tid=25302] ppid=25298 vsize=182244 CPUtime=6.26 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 12615 0 0 0 622 4 0 0 20 0 3 0 275018771 186617856 16200 33554432000 4194304 5965102 140735909715232 140586259716088 4390204 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=182244 CPUtime=6.25 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 8505 0 0 0 623 2 0 0 20 0 3 0 275018771 186617856 16200 33554432000 4194304 5965102 140735909715232 140586249226552 4401078 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 182244

[startup+12.7004 s]
/proc/loadavg: 3.86 3.85 3.16 5/181 25303
/proc/meminfo: memFree=30272672/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182244 CPUtime=25.36 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 26101 0 0 0 2527 9 0 0 20 0 3 0 275018770 186617856 20027 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45561 20027 206 433 0 45125 0
[pid=25300/tid=25302] ppid=25298 vsize=182244 CPUtime=12.64 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 14556 0 0 0 1259 5 0 0 20 0 3 0 275018771 186617856 20027 33554432000 4194304 5965102 140735909715232 140586259716136 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=182244 CPUtime=12.64 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 10420 0 0 0 1260 4 0 0 20 0 3 0 275018771 186617856 20027 33554432000 4194304 5965102 140735909715232 140586249226360 4400879 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 182244

[startup+25.5003 s]
/proc/loadavg: 3.89 3.86 3.17 5/181 25303
/proc/meminfo: memFree=30208552/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=182568 CPUtime=50.95 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 34537 0 0 0 5083 12 0 0 20 0 3 0 275018770 186949632 28371 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 45642 28371 206 433 0 45206 0
[pid=25300/tid=25302] ppid=25298 vsize=182568 CPUtime=25.4 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 19356 0 0 0 2534 6 0 0 20 0 3 0 275018771 186949632 28371 33554432000 4194304 5965102 140735909715232 140586259717048 4401127 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=182568 CPUtime=25.4 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 14056 0 0 0 2535 5 0 0 20 0 3 0 275018771 186949632 28371 33554432000 4194304 5965102 140735909715232 140586249226552 4400955 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 182568

[startup+51.1004 s]
/proc/loadavg: 3.93 3.87 3.19 5/181 25303
/proc/meminfo: memFree=30095804/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=248504 CPUtime=102.15 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 45778 0 0 0 10194 21 0 0 20 0 3 0 275018770 254468096 39612 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 62126 39612 206 433 0 61690 0
[pid=25300/tid=25302] ppid=25298 vsize=248504 CPUtime=50.94 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 24578 0 0 0 5084 10 0 0 20 0 3 0 275018771 254468096 39612 33554432000 4194304 5965102 140735909715232 140586259716136 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=248504 CPUtime=50.94 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 20075 0 0 0 5084 10 0 0 20 0 3 0 275018771 254468096 39612 33554432000 4194304 5965102 140735909715232 140586249226552 4400894 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 248504

[startup+102.307 s]
/proc/loadavg: 3.97 3.89 3.23 5/181 25303
/proc/meminfo: memFree=29870896/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=314400 CPUtime=204.54 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 69133 0 0 0 20418 36 0 0 20 0 3 0 275018770 321945600 62836 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 78600 62836 206 433 0 78164 0
[pid=25300/tid=25302] ppid=25298 vsize=314400 CPUtime=102.01 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 34202 0 0 0 10186 15 0 0 20 0 3 0 275018771 321945600 62836 33554432000 4194304 5965102 140735909715232 140586259717048 4404457 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=314400 CPUtime=102.01 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 33806 0 0 0 10178 23 0 0 20 0 3 0 275018771 321945600 62836 33554432000 4194304 5965102 140735909715232 140586249226696 4389036 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 314400

[startup+162.3 s]
/proc/loadavg: 3.99 3.90 3.28 5/181 25303
/proc/meminfo: memFree=29727980/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=381020 CPUtime=324.49 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 79296 0 0 0 32405 44 0 0 20 0 3 0 275018770 390164480 72979 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 95255 72979 206 433 0 94819 0
[pid=25300/tid=25302] ppid=25298 vsize=381020 CPUtime=161.85 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 44345 0 0 0 16162 23 0 0 20 0 3 0 275018771 390164480 72979 33554432000 4194304 5965102 140735909715232 140586259716088 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=381020 CPUtime=161.83 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 33826 0 0 0 16159 24 0 0 20 0 3 0 275018771 390164480 72979 33554432000 4194304 5965102 140735909715232 140586249226696 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 324.49
Current children cumulated vsize (KiB) 381020

[startup+222.3 s]
/proc/loadavg: 3.99 3.92 3.32 5/181 25304
/proc/meminfo: memFree=29463084/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=512632 CPUtime=444.42 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 118012 0 0 0 44374 68 0 0 20 0 3 0 275018770 524935168 111727 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 128158 111727 206 433 0 127722 0
[pid=25300/tid=25302] ppid=25298 vsize=512632 CPUtime=221.66 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 66482 0 0 0 22130 36 0 0 20 0 3 0 275018771 524935168 111727 33554432000 4194304 5965102 140735909715232 140586259715896 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=512632 CPUtime=221.66 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 50405 0 0 0 22129 37 0 0 20 0 3 0 275018771 524935168 111727 33554432000 4194304 5965102 140735909715232 140586249226552 4400957 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 444.42
Current children cumulated vsize (KiB) 512632

[startup+282.3 s]
/proc/loadavg: 3.99 3.93 3.36 5/181 25304
/proc/meminfo: memFree=29232596/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=643704 CPUtime=564.36 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 146678 0 0 0 56344 92 0 0 20 0 3 0 275018770 659152896 140374 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 160926 140374 206 433 0 160490 0
[pid=25300/tid=25302] ppid=25298 vsize=643704 CPUtime=281.48 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 77961 0 0 0 28103 45 0 0 20 0 3 0 275018771 659152896 140374 33554432000 4194304 5965102 140735909715232 140586259715896 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=643704 CPUtime=281.48 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 67592 0 0 0 28094 54 0 0 20 0 3 0 275018771 659152896 140374 33554432000 4194304 5965102 140735909715232 140586249226552 5137076 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 564.36
Current children cumulated vsize (KiB) 643704

[startup+342.3 s]
/proc/loadavg: 4.04 3.95 3.40 5/182 25305
/proc/meminfo: memFree=29084464/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=776124 CPUtime=684.32 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 175016 0 0 0 68314 118 0 0 20 0 3 0 275018770 794750976 169094 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 194031 169094 206 433 0 193595 0

################
# More data... #
################

[pid=25300/tid=25303] ppid=25298 vsize=776124 CPUtime=341.31 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 88069 0 0 0 34055 76 0 0 20 0 3 0 275018771 794750976 169094 33554432000 4194304 5965102 140735909715232 140586249226552 4400955 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 684.32
Current children cumulated vsize (KiB) 776124

[startup+402.3 s]
/proc/loadavg: 4.06 3.97 3.44 5/181 25305
/proc/meminfo: memFree=28909040/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=841660 CPUtime=804.3 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 205623 0 0 0 80292 138 0 0 20 0 3 0 275018770 861859840 200924 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 210415 200924 206 433 0 209979 0
[pid=25300/tid=25302] ppid=25298 vsize=841660 CPUtime=401.15 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 103302 0 0 0 40050 65 0 0 20 0 3 0 275018771 861859840 200924 33554432000 4194304 5965102 140735909715232 140586259715896 4401096 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=841660 CPUtime=401.15 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 101196 0 0 0 40031 84 0 0 20 0 3 0 275018771 861859840 200924 33554432000 4194304 5965102 140735909715232 140586249226552 4404341 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 804.3
Current children cumulated vsize (KiB) 841660

[startup+462.3 s]
/proc/loadavg: 4.02 3.97 3.47 5/181 25305
/proc/meminfo: memFree=28889168/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=841660 CPUtime=924.28 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 206236 0 0 0 92290 138 0 0 20 0 3 0 275018770 861859840 201536 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 210415 201536 206 433 0 209979 0
[pid=25300/tid=25302] ppid=25298 vsize=841660 CPUtime=461 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 103915 0 0 0 46035 65 0 0 20 0 3 0 275018771 861859840 201536 33554432000 4194304 5965102 140735909715232 140586259715896 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=841660 CPUtime=461 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 101196 0 0 0 46016 84 0 0 20 0 3 0 275018771 861859840 201536 33554432000 4194304 5965102 140735909715232 140586249226552 4401050 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 924.28
Current children cumulated vsize (KiB) 841660

[startup+522.3 s]
/proc/loadavg: 4.01 3.97 3.50 5/182 25309
/proc/meminfo: memFree=28760112/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=907196 CPUtime=1044.26 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 212872 0 0 0 104283 143 0 0 20 0 3 0 275018770 928968704 208172 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 226799 208172 206 433 0 226363 0
[pid=25300/tid=25302] ppid=25298 vsize=907196 CPUtime=520.85 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 110551 0 0 0 52014 71 0 0 20 0 3 0 275018771 928968704 208172 33554432000 4194304 5965102 140735909715232 140586259715896 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=907196 CPUtime=520.84 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 101196 0 0 0 51999 85 0 0 20 0 3 0 275018771 928968704 208172 33554432000 4194304 5965102 140735909715232 140586249226552 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1044.26
Current children cumulated vsize (KiB) 907196

[startup+582.3 s]
/proc/loadavg: 4.00 3.97 3.53 5/181 25309
/proc/meminfo: memFree=28635780/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=907196 CPUtime=1164.24 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 217160 0 0 0 116277 147 0 0 20 0 3 0 275018770 928968704 212459 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 226799 212459 206 433 0 226363 0
[pid=25300/tid=25302] ppid=25298 vsize=907196 CPUtime=580.69 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 114839 0 0 0 57993 76 0 0 20 0 3 0 275018771 928968704 212459 33554432000 4194304 5965102 140735909715232 140586259716136 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=907196 CPUtime=580.69 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 101196 0 0 0 57983 86 0 0 20 0 3 0 275018771 928968704 212459 33554432000 4194304 5965102 140735909715232 140586249226552 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1164.24
Current children cumulated vsize (KiB) 907196

[startup+642.3 s]
/proc/loadavg: 4.00 3.97 3.56 5/181 25309
/proc/meminfo: memFree=28567980/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=972732 CPUtime=1284.24 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 231918 0 0 0 128262 162 0 0 20 0 3 0 275018770 996077568 227217 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 243183 227217 206 433 0 242747 0
[pid=25300/tid=25302] ppid=25298 vsize=972732 CPUtime=640.54 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 129546 0 0 0 63962 92 0 0 20 0 3 0 275018771 996077568 227217 33554432000 4194304 5965102 140735909715232 140586259715896 4401127 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=972732 CPUtime=640.54 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 101247 0 0 0 63967 87 0 0 20 0 3 0 275018771 996077568 227217 33554432000 4194304 5965102 140735909715232 140586249226552 4401137 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1284.24
Current children cumulated vsize (KiB) 972732

[startup+702.3 s]
/proc/loadavg: 4.00 3.97 3.58 5/181 25309
/proc/meminfo: memFree=28488668/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1103804 CPUtime=1404.2 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 250521 0 0 0 140234 186 0 0 20 0 3 0 275018770 1130295296 245819 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 275951 245819 206 433 0 275515 0
[pid=25300/tid=25302] ppid=25298 vsize=1103804 CPUtime=700.38 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 129831 0 0 0 69945 93 0 0 20 0 3 0 275018771 1130295296 245819 33554432000 4194304 5965102 140735909715232 140586259715896 4401155 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1103804 CPUtime=700.38 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 119565 0 0 0 69925 113 0 0 20 0 3 0 275018771 1130295296 245819 33554432000 4194304 5965102 140735909715232 140586249226360 5137076 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1404.2
Current children cumulated vsize (KiB) 1103804

[startup+762.307 s]
/proc/loadavg: 4.00 3.97 3.60 5/181 25309
/proc/meminfo: memFree=28286924/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1234876 CPUtime=1524.2 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 285444 0 0 0 152200 220 0 0 20 0 3 0 275018770 1264513024 280742 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 308719 280742 206 433 0 308283 0
[pid=25300/tid=25302] ppid=25298 vsize=1234876 CPUtime=760.24 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 148265 0 0 0 75914 110 0 0 20 0 3 0 275018771 1264513024 280742 33554432000 4194304 5965102 140735909715232 140586259716088 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1234876 CPUtime=760.23 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 136054 0 0 0 75892 131 0 0 20 0 3 0 275018771 1264513024 280742 33554432000 4194304 5965102 140735909715232 140586249226552 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1524.2
Current children cumulated vsize (KiB) 1234876

[startup+822.3 s]
/proc/loadavg: 4.05 3.99 3.63 5/181 25310
/proc/meminfo: memFree=28157276/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1367164 CPUtime=1644.16 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 312518 0 0 0 164175 241 0 0 20 0 3 0 275018770 1399975936 307815 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 341791 307815 206 433 0 341355 0
[pid=25300/tid=25302] ppid=25298 vsize=1367164 CPUtime=820.08 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 153783 0 0 0 81894 114 0 0 20 0 3 0 275018771 1399975936 307815 33554432000 4194304 5965102 140735909715232 140586259715896 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1367164 CPUtime=820.07 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 157610 0 0 0 81857 150 0 0 20 0 3 0 275018771 1399975936 307815 33554432000 4194304 5965102 140735909715232 140586249226552 4400960 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1644.16
Current children cumulated vsize (KiB) 1367164

[startup+882.3 s]
/proc/loadavg: 4.07 4.00 3.66 5/181 25310
/proc/meminfo: memFree=27973044/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1498236 CPUtime=1764.11 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 352243 0 0 0 176138 273 0 0 20 0 3 0 275018770 1534193664 347659 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 374559 347659 206 433 0 374123 0
[pid=25300/tid=25302] ppid=25298 vsize=1498236 CPUtime=879.9 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 176513 0 0 0 87856 134 0 0 20 0 3 0 275018771 1534193664 347659 33554432000 4194304 5965102 140735909715232 140586259716088 4380036 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1498236 CPUtime=879.89 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 174605 0 0 0 87824 165 0 0 20 0 3 0 275018771 1534193664 347659 33554432000 4194304 5965102 140735909715232 140586249226552 4400952 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1764.11
Current children cumulated vsize (KiB) 1498236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.05 4.00 3.66 3/177 25311
/proc/meminfo: memFree=29038740/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1498236 CPUtime=1800.11 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 352258 0 0 0 179738 273 0 0 20 0 3 0 275018770 1534193664 347671 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 374559 347671 206 433 0 374123 0
[pid=25300/tid=25302] ppid=25298 vsize=1498236 CPUtime=897.86 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 176525 0 0 0 89652 134 0 0 20 0 3 0 275018771 1534193664 347671 33554432000 4194304 5965102 140735909715232 140586259716088 4390112 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1498236 CPUtime=897.85 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 174608 0 0 0 89620 165 0 0 20 0 3 0 275018771 1534193664 347671 33554432000 4194304 5965102 140735909715232 140586249226552 4401107 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 1498236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.05 4.00 3.66 3/177 25311
/proc/meminfo: memFree=29038740/32873648 swapFree=7108/7108
[pid=25300] ppid=25298 vsize=1498236 CPUtime=1800.11 cores=1,3,5,7
/proc/25300/stat : 25300 (pwbo2.0) S 25298 25300 25163 0 -1 4202496 352258 0 0 0 179738 273 0 0 20 0 3 0 275018770 1534193664 347671 33554432000 4194304 5965102 140735909715232 140735909714752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/25300/statm: 374559 347671 206 433 0 374123 0
[pid=25300/tid=25302] ppid=25298 vsize=1498236 CPUtime=897.86 cores=1,3,5,7
/proc/25300/task/25302/stat : 25302 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 176525 0 0 0 89652 134 0 0 20 0 3 0 275018771 1534193664 347671 33554432000 4194304 5965102 140735909715232 140586259716088 4390112 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=25300/tid=25303] ppid=25298 vsize=1498236 CPUtime=897.85 cores=1,3,5,7
/proc/25300/task/25303/stat : 25303 (pwbo2.0) R 25298 25300 25163 0 -1 4202560 174608 0 0 0 89620 165 0 0 20 0 3 0 275018771 1534193664 347671 33554432000 4194304 5965102 140735909715232 140586249226552 4401107 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 1498236

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25300 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=747460
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=70533
# CPU time returned by wait4() is 1795.82
# while last known CPU time is 1800.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.371
CPU time (s): 1800.11
CPU user time (s): 1797.38
CPU system time (s): 2.73
CPU usage (%): 199.93
Max. virtual memory (cumulated for all children) (KiB): 1498236

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.75
system time used= 3.07053
maximum resident set size= 1390692
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 352260
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 867
involuntary context switches= 3065

runsolver used 2.38464 second user time and 4.76128 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-27 05:22:13
IDJOB=3703599
IDBENCH=1992
IDSOLVER=2279
FILE ID=node123/3703599-1338088933
RUNJOBID= node123-1338088025-25180
PBS_JOBID= 14624452
Free space on /tmp= 71688 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/vtxcov/normalized-vtxcov_v2000_e4000_7.opb.PB06.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703599-1338088933/watcher-3703599-1338088933 -o /tmp/evaluation-result-3703599-1338088933/solver-3703599-1338088933 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703599-1338088933.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff2125c4e604678d0c316c16eb28ba7d
RANDOM SEED=1800755128

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30399380 kB
Buffers:          273772 kB
Cached:          1357856 kB
SwapCached:         1808 kB
Active:           711744 kB
Inactive:         966796 kB
Active(anon):      37268 kB
Inactive(anon):    10968 kB
Active(file):     674476 kB
Inactive(file):   955828 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67104820 kB
Dirty:             11220 kB
Writeback:            48 kB
AnonPages:         50996 kB
Mapped:            14832 kB
Shmem:               100 kB
Slab:             658128 kB
SReclaimable:     102328 kB
SUnreclaim:       555800 kB
KernelStack:        1440 kB
PageTables:         3524 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     174980 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71688 MiB
End job on node123 at 2012-05-27 05:37:15