Trace number 3731800

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: PB-clasp 2007-04-10SAT (TO)1167 1800.45 1800.77

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
vtxcov/normalized-vtxcov_v2000_e4000_18.opb.PB06.opb
MD5SUMe1d6958876c3f9359c6b5193f1345bd5
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1041
Best CPU time to get the best result obtained on this benchmark1796.74
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1038
Optimality of the best value was proved NO
Number of variables1964
Total number of constraints4000
Number of constraints which are clauses4000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1964
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1964
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1964
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.15/0.22	o 1312
0.15/0.29	o 1311
0.27/0.38	o 1167
1800.07/1800.40	sh: line 1: 29095 Done                    cat HOME/temp/instance-3731800-1338701111.opb.op
1800.07/1800.40	     29096 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3731800-1338701111.opb.clasp
1800.07/1800.41	c Somebody sent me a SIGTERM
1800.07/1800.41	s SATISFIABLE
1800.07/1800.41	v x1 x2 x5 x12 x18 x20 x24 x27 x28 x29 x30 x31 x32 x39 x41 x43 x45 x47 x49 x50 x52 x55 x57 x60 x61 x66 x71 x73 x76 x78 x82 x85 x86 x87 x94 x95 x96 x98 x100 x101 x104 x105 x109 x111 x113 x114 x115 x116 x121 x122 x124 x125 x126 x128 x130 x135 x137 x138 x140 x144 x147 x149 x154 x155 x156 x157 x167 x168 x171 x172 x173 x177 x178 x183 x184 x186 x187 x189 x190 x194 x197 x199 x200 x202 x205 x206 x207 x211 x214 x217 x219 x220 x222 x223 x225 x227 x230 x231 x234 x238 x243 x245 x249 x250 x251 x252 x253 x254 x257 x259 x262 x264 x267 x268 x269 x273 x275 x276 x277 x282 x283 x287 x289 x290 x295 x296 x298 x299 x303 x304 x305 x306 x307 x311 x312 x316 x318 x320 x322 x325 x326 x329 x334 x336 x337 x338 x340 x341 x343 x344 x346 x347 x352 x353 x354 x356 x357 x358 x361 x362 x363 x367 x370 x371 x374 x375 x377 x378 x382 x386 x391 x392 x393 x397 x400 x401 x403 x406 x407 x408 x411 x416 x419 x420 x421 x424 x425 x427 x430 x431 x433 x434 x435 x437 x442 x447 x448 x450 x451 x452 x453 x456 x460 x461 x463 x464 x469 x471 x474 x476 x478 x479 x480 x481 x482 x483 x485 x486 x488 x491 x493 x494 x495 x496 x499 x500 x501 x502 x505 x506 x511 x514 x516 x517 x520 x522 x526 x528 x529 x530 x531 x537 x539 x540 x541 x543 x546 x547 x548 x549 x554 x556 x560 x566 x568 x570 x572 x575 x578 x579 x582 x586 x587 x588 x589 x590 x591 x592 x593 x597 x599 x600 x602 x603 x604 x606 x608 x609 x613 x614 x616 x618 x619 x620 x623 x624 x625 x626 x629 x630 x631 x632 x634 x636 x640 x641 x642 x643 x645 x646 x648 x650 x652 x653 x655 x657 x661 x663 x665 x667 x668 x670 x672 x675 x676 x677 x678 x680 x681 x682 x684 x687 x689 x690 x692 x693 x694 x696 x697 x698 x699 x700 x702 x704 x707 x708 x709 x710 x711 x712 x713 x715 x716 x719 x721 x723 x725 x727 x728 x730 x732 x738 x739 x741 x742 x744 x748 x750 x752 x753 x754 x755 x756 x759 x762 x764 x765 x766 x767 x768 x769 x771 x773 x775 x776 x779 x780 x781 x782 x783 x791 x794 x795 x797 x798 x801 x802 x804 x805 x813 x814 x816 x817 x820 x821 x822 x823 x824 x826 x827 x828 x829 x831 x832 x833 x836 x837 x838 x839 x840 x842 x845 x847 x848 x849 x850 x851 x854 x855 x859 x863 x864 x869 x872 x873 x874 x877 x878 x881 x883 x885 x886 x888 x889 x891 x893 x894 x896 x897 x898 x900 x901 x904 x905 x906 x910 x911 x913 x915 x918 x919 x920 x922 x924 x925 x928 x930 x933 x935 x936 x937 x940 x941 x942 x943 x944 x948 x949 x950 x958 x961 x963 x964 x966 x967 x969 x970 x974 x975 x976 x977 x978 x979 x980 x981 x983 x988 x989 x990 x991 x993 x995 x996 x997 x998 x1000 x1001 x1002 x1003 x1004 x1005 x1006 x1008 x1010 x1011 x1012 x1013 x1014 x1015 x1017 x1020 x1021 x1024 x1025 x1026 x1027 x1028 x1032 x1033 x1034 x1035 x1036 x1038 x1041 x1042 x1044 x1045 x1046 x1047 x1048 x1051 x1052 x1053 x1056 x1058 x1059 x1061 x1062 x1063 x1064 x1067 x1069 x1071 x1075 x1077 x1078 x1079 x1080 x1082 x1084 x1085 x1087 x1088 x1089 x1090 x1093 x1095 x1097 x1100 x1101 x1102 x1103 x1104 x1105 x1107 x1108 x1110 x1112 x1113 x1114 x1115 x1117 x1119 x1121 x1122 x1125 x1126 x1128 x1129 x1130 x1132 x1133 x1134 x1137 x1138 x1139 x1140 x1141 x1142 x1143 x1144 x1146 x1148 x1149 x1150 x1153 x1154 x1155 x1156 x1160 x1161 x1162 x1164 x1165 x1167 x1168 x1169 x1173 x1174 x1176 x1177 x1179 x1180 x1181 x1187 x1189 x1191 x1192 x1194 x1196 x1197 x1198 x1199 x1200 x1201 x1202 x1203 x1204 x1206 x1207 x1208 x1209 x1210 x1211 x1213 x1214 x1217 x1218 x1222 x1223 x1225 x1226 x1227 x1229 x1230 x1231 x1233 x1234 x1236 x1237 x1239 x1240 x1243 x1245 x1246 x1247 x1248 x1249 x1252 x1254 x1255 x1259 x1261 x1262 x1264 x1265 x1267 x1270 x1272 x1273 x1277 x1278 x1279 x1280 x1281 x1282 x1283 x1284 x1285 x1286 x1287 x1289 x1290 x1291 x1292 x1293 x1294 x1295 x1297 x1298 x1300 x1301 x1304 x1305 x1306 x1307 x1308 x1309 x1310 x1311 x1312 x1313 x1314 x1315 x1316 x1317 x1320 x1321 x1322 x1323 x1324 x1325 x1329 x1330 x1331 x1332 x1335 x1336 x1337 x1338 x1339 x1340 x1341 x1342 x1344 x1345 x1346 x1349 x1350 x1354 x1355 x1356 x1357 x1358 x1359 x1360 x1361 x1366 x1369 x1370 x1371 x1373 x1374 x1375 x1376 x1377 x1378 x1379 x1380 x1382 x1383 x1385 x1386 x1387 x1389 x1390 x1391 x1392 x1393 x1394 x1395 x1396 x1397 x1398 x1400 x1401 x1403 x1404 x1405 x1406 x1407 x1410 x1411 x1412 x1415 x1416 x1417 x1419 x1421 x1422 x1425 x1426 x1428 x1429 x1430 x1434 x1435 x1436 x1437 x1438 x1441 x1442 x1443 x1444 x1445 x1447 x1448 x1450 x1451 x1452 x1453 x1454 x1455 x1457 x1458 x1459 x1460 x1461 x1463 x1464 x1465 x1466 x1468 x1469 x1470 x1471 x1473 x1474 x1475 x1476 x1478 x1479 x1480 x1481 x1482 x1483 x1484 x1487 x1489 x1490 x1493 x1494 x1495 x1496 x1497 x1500 x1501 x1502 x1505 x1506 x1507 x1508 x1512 x1513 x1514 x1515 x1516 x1518 x1519 x1521 x1523 x1524 x1529 x1531 x1532 x1533 x1534 x1535 x1536 x1537 x1539 x1540 x1541 x1543 x1545 x1546 x1547 x1549 x1550 x1552 x1553 x1554 x1555 x1556 x1557 x1561 x1563 x1564 x1565 x1567 x1568 x1569 x1570 x1573 x1575 x1576 x1578 x1579 x1581 x1582 x1584 x1585 x1587 x1588 x1592 x1593 x1594 x1595 x1597 x1598 x1599 x1600 x1602 x1603 x1607 x1608 x1609 x1610 x1611 x1612 x1614 x1617 x1618 x1619 x1620 x1622 x1623 x1624 x1625 x1627 x1628 x1629 x1630 x1631 x1632 x1634 x1635 x1636 x1637 x1639 x1640 x1641 x1643 x1647 x1648 x1649 x1651 x1652 x1654 x1655 x1656 x1657 x1658 x1659 x1661 x1662 x1663 x1664 x1665 x1666 x1668 x1670 x1673 x1674 x1676 x1677 x1679 x1680 x1681 x1682 x1683 x1685 x1686 x1687 x1689 x1690 x1692 x1695 x1696 x1697 x1698 x1699 x1700 x1701 x1702 x1703 x1704 x1705 x1706 x1707 x1708 x1709 x1710 x1713 x1715 x1716 x1717 x1719 x1720 x1722 x1723 x1725 x1726 x1728 x1729 x1730 x1731 x1732 x1734 x1735 x1736 x1738 x1739 x1740 x1741 x1742 x1743 x1744 x1746 x1747 x1752 x1753 x1755 x1756 x1757 x1758 x1759 x1760 x1762 x1764 x1765 x1767 x1768 x1771 x1772 x1774 x1775 x1777 x1778 x1779 x1781 x1782 x1784 x1787 x1788 x1789 x1790 x1791 x1793 x1794 x1795 x1796 x1797 x1798 x1799 x1801 x1802 x1803 x1805 x1806 x1807 x1808 x1809 x1810 x1811 x1813 x1814 x1815 x1817 x1818 x1820 x1821 x1822 x1823 x1824 x1826 x1827 x1828 x1829 x1830 x1831 x1832 x1833 x1834 x1835 x1837 x1838 x1839 x1840 x1841 x1842 x1843 x1844 x1846 x1851 x1852 x1853 x1854 x1856 x1858 x1859 x1860 x1861 x1863 x1864 x1865 x1867 x1868 x1870 x1871 x1872 x1873 x1874 x1875 x1876 x1879 x1882 x1884 x1885 x1886 x1887 x1888 x1890 x1891 x1892 x1893 x1894 x1896 x1897 x1898 x1899 x1900 x1901 x1902 x1903 x1904 x1905 x1907 x1908 x1909 x1910 x1912 x1913 x1914 x1915 x1916 x1918 x1919 x1920 x1921 x1922 x1925 x1927 x1928 x1930 x1933 x1937 x1938 x1939 x1941 x1942 x1943 x1946 x1947 x1949 x1950 x1951 x1952 x1953 x1954 x1955 x1958 x1959 x1960 x1961 x1962 x1963 
1800.07/1800.42	pb2clasp1: no process killed
1800.36/1800.76	sh: line 1: 29143 Done                    cat HOME/temp/instance-3731800-1338701111.opb.op
1800.36/1800.76	     29144 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3731800-1338701111.opb.clasp

Verifier Data 

OK	1167

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731800-1338701111/watcher-3731800-1338701111 -o /tmp/evaluation-result-3731800-1338701111/solver-3731800-1338701111 -C 1800 -W 1900 -M 15500 pbclasp instance-3731800-1338701111.opb HOME/temp 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.02 2.00 3/172 29011
/proc/meminfo: memFree=27657488/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=25592 CPUtime=0 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) R 29008 29011 23082 0 -1 4202496 526 0 0 0 0 0 0 0 20 0 1 0 336235995 26206208 456 33554432000 4194304 4198148 140734061614992 140734061612440 223651270548 0 0 4224 0 0 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6398 457 345 1 0 193 0

[startup+0.0564411 s]
/proc/loadavg: 2.02 2.02 2.00 3/172 29011
/proc/meminfo: memFree=27657488/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26132 CPUtime=0.02 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 702 0 0 0 2 0 0 0 20 0 1 0 336235995 26759168 614 33554432000 4194304 4198148 140734061614992 140734061613880 223655027952 0 0 4224 16384 18446744071580380219 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6533 614 368 1 0 328 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 26132

[startup+0.100242 s]
/proc/loadavg: 2.02 2.02 2.00 3/172 29011
/proc/meminfo: memFree=27657488/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26132 CPUtime=0.02 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 702 0 0 0 2 0 0 0 20 0 1 0 336235995 26759168 614 33554432000 4194304 4198148 140734061614992 140734061613880 223655027952 0 0 4224 16384 18446744071580380219 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6533 614 368 1 0 328 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 26132

[startup+0.300196 s]
/proc/loadavg: 2.02 2.02 2.00 3/172 29011
/proc/meminfo: memFree=27657488/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.27 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) R 29008 29011 23082 0 -1 4202496 1159 7290 0 0 4 0 22 1 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613880 223651254569 0 0 4224 16384 0 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 26264

[startup+0.700228 s]
/proc/loadavg: 2.02 2.02 2.00 3/172 29011
/proc/meminfo: memFree=27657488/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 26264

[startup+1.50038 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27684056/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=21664 CPUtime=1.1 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 4984 0 0 0 109 1 0 0 20 0 1 0 336236034 22183936 4882 33554432000 134512640 134847168 4286988000 4286986256 9495847 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 5416 4882 270 82 0 4657 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 57076

[startup+3.10034 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27664092/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=25120 CPUtime=2.7 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 5847 0 0 0 269 1 0 0 20 0 1 0 336236034 25722880 5745 33554432000 134512640 134847168 4286988000 4286986324 134792444 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 6280 5745 270 82 0 5521 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 60532

[startup+6.30035 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27650700/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=30116 CPUtime=5.9 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 7109 0 0 0 589 1 0 0 20 0 1 0 336236034 30838784 7007 33554432000 134512640 134847168 4286988000 4286986624 134784694 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 7529 7007 270 82 0 6770 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 65528

[startup+12.7003 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27638752/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=34892 CPUtime=12.29 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 8323 0 0 0 1228 1 0 0 20 0 1 0 336236034 35729408 8222 33554432000 134512640 134847168 4286988000 4286986640 134715302 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 8723 8222 270 82 0 7964 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 70304

[startup+25.5004 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27626360/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=40952 CPUtime=25.09 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 9983 0 0 0 2507 2 0 0 20 0 1 0 336236034 41934848 9738 33554432000 134512640 134847168 4286988000 4286986276 134792583 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 10238 9738 270 82 0 9479 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 76364

[startup+51.1003 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27609820/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=49932 CPUtime=50.68 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 12221 0 0 0 5066 2 0 0 20 0 1 0 336236034 51130368 11973 33554432000 134512640 134847168 4286988000 4286986640 134715324 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 12483 11973 270 82 0 11724 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 85344

[startup+102.307 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29113
/proc/meminfo: memFree=27598524/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=55048 CPUtime=101.87 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 14582 0 0 0 10185 2 0 0 20 0 1 0 336236034 56369152 13247 33554432000 134512640 134847168 4286988000 4286986640 134715295 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 13762 13247 270 82 0 13003 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 90460

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29113
/proc/meminfo: memFree=27583200/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=65600 CPUtime=161.86 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 17205 0 0 0 16183 3 0 0 20 0 1 0 336236034 67174400 15870 33554432000 134512640 134847168 4286988000 4286986624 134784628 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 16400 15870 270 82 0 15641 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 101012

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29113
/proc/meminfo: memFree=27576300/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=66312 CPUtime=221.85 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 17752 0 0 0 22181 4 0 0 20 0 1 0 336236034 67903488 16066 33554432000 134512640 134847168 4286988000 4286986464 134713707 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 16578 16066 270 82 0 15819 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 101724

[startup+282.3 s]

################
# More data... #
################

[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=96760 CPUtime=1361.67 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 50385 0 0 0 136154 13 0 0 20 0 1 0 336236034 99082240 23674 33554432000 134512640 134847168 4286988000 4286986624 134784634 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 24190 23674 270 82 0 23431 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 132172

[startup+1422.31 s]
/proc/loadavg: 2.08 2.03 2.01 3/181 29124
/proc/meminfo: memFree=27514040/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=96776 CPUtime=1421.66 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 50911 0 0 0 142153 13 0 0 20 0 1 0 336236034 99098624 23665 33554432000 134512640 134847168 4286988000 4286986576 134742262 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 24194 23665 270 82 0 23435 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 132188

[startup+1482.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/181 29124
/proc/meminfo: memFree=27505784/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=104764 CPUtime=1481.65 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 53476 0 0 0 148151 14 0 0 20 0 1 0 336236034 107278336 25680 33554432000 134512640 134847168 4286988000 4286986304 134791663 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26191 25680 270 82 0 25432 0
Current children cumulated CPU time (s) 1482.01
Current children cumulated vsize (KiB) 140176

[startup+1542.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/182 29127
/proc/meminfo: memFree=27505904/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=104992 CPUtime=1541.63 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 55123 0 0 0 154149 14 0 0 20 0 1 0 336236034 107511808 25713 33554432000 134512640 134847168 4286988000 4286986688 134616623 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26248 25713 270 82 0 25489 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 140404

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27497604/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=104984 CPUtime=1601.63 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 56716 0 0 0 160148 15 0 0 20 0 1 0 336236034 107503616 25729 33554432000 134512640 134847168 4286988000 4286986252 134793548 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26246 25729 270 82 0 25487 0
Current children cumulated CPU time (s) 1601.99
Current children cumulated vsize (KiB) 140396

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27497292/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=105024 CPUtime=1661.62 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 59939 0 0 0 166147 15 0 0 20 0 1 0 336236034 107544576 25727 33554432000 134512640 134847168 4286988000 4286986624 134784592 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26256 25727 270 82 0 25497 0
Current children cumulated CPU time (s) 1661.98
Current children cumulated vsize (KiB) 140436

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29128
/proc/meminfo: memFree=27497036/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=105076 CPUtime=1721.61 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 59983 0 0 0 172146 15 0 0 20 0 1 0 336236034 107597824 25758 33554432000 134512640 134847168 4286988000 4286986624 134784643 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26269 25758 270 82 0 25510 0
Current children cumulated CPU time (s) 1721.97
Current children cumulated vsize (KiB) 140488

[startup+1782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27496848/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=105132 CPUtime=1781.6 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 61602 0 0 0 178144 16 0 0 20 0 1 0 336236034 107655168 25749 33554432000 134512640 134847168 4286988000 4286986692 134616619 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26283 25749 270 82 0 25524 0
Current children cumulated CPU time (s) 1781.96
Current children cumulated vsize (KiB) 140544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.09 2.03 2.00 3/181 29128
/proc/meminfo: memFree=27500880/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=0.36 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1356 10775 0 0 5 0 29 2 20 0 1 0 336235995 26894336 688 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 688 387 1 0 361 0
[pid=29094] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29094/stat : 29094 (sh) S 29011 29011 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336236034 9367552 263 33554432000 4194304 5064252 140735766752112 140735766750368 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29094/statm: 2287 263 223 213 0 72 0
[pid=29096] ppid=29094 vsize=105064 CPUtime=1799.71 cores=1,3,5,7
/proc/29096/stat : 29096 (clasp-1.0) R 29094 29011 23082 0 -1 4202496 61603 0 0 0 179955 16 0 0 20 0 1 0 336236034 107585536 25750 33554432000 134512640 134847168 4286988000 4286986720 134741346 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29096/statm: 26266 25750 270 82 0 25507 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 140476

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.09 2.03 2.00 3/182 29147
/proc/meminfo: memFree=27695604/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=1800.1 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1538 75156 0 0 5 0 179985 20 20 0 1 0 336235995 26894336 690 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 690 387 1 0 361 0
[pid=29141] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29141/stat : 29141 (sh) S 29011 29011 23082 0 -1 4202496 371 220 0 0 0 0 0 0 20 0 1 0 336416038 9367552 263 33554432000 4194304 5064252 140734778240080 140734778238336 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29141/statm: 2287 263 223 213 0 72 0
[pid=29144] ppid=29141 vsize=7236 CPUtime=0.16 cores=1,3,5,7
/proc/29144/stat : 29144 (clasp-1.0) R 29141 29011 23082 0 -1 4202496 1391 0 0 0 16 0 0 0 20 0 1 0 336416038 7409664 1289 33554432000 134512640 134847168 4288157872 4288156324 134790214 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29144/statm: 1809 1289 270 82 0 1050 0
Current children cumulated CPU time (s) 1800.26
Current children cumulated vsize (KiB) 42648

[startup+1800.71 s]
/proc/loadavg: 2.09 2.03 2.00 3/182 29147
/proc/meminfo: memFree=27695604/32873844 swapFree=7628/7628
[pid=29011] ppid=29008 vsize=26264 CPUtime=1800.1 cores=1,3,5,7
/proc/29011/stat : 29011 (pbclasp) S 29008 29011 23082 0 -1 4202496 1538 75156 0 0 5 0 179985 20 20 0 1 0 336235995 26894336 690 33554432000 4194304 4198148 140734061614992 140734061613920 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/29011/statm: 6566 690 387 1 0 361 0
[pid=29141] ppid=29011 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/29141/stat : 29141 (sh) S 29011 29011 23082 0 -1 4202496 371 220 0 0 0 0 0 0 20 0 1 0 336416038 9367552 263 33554432000 4194304 5064252 140734778240080 140734778238336 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/29141/statm: 2287 263 223 213 0 72 0
[pid=29144] ppid=29141 vsize=9028 CPUtime=0.26 cores=1,3,5,7
/proc/29144/stat : 29144 (clasp-1.0) R 29141 29011 23082 0 -1 4202496 1839 0 0 0 26 0 0 0 20 0 1 0 336416038 9244672 1737 33554432000 134512640 134847168 4288157872 4288156128 9495847 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/29144/statm: 2257 1737 270 82 0 1498 0
Current children cumulated CPU time (s) 1800.36
Current children cumulated vsize (KiB) 44440

Child status: 0
Real time (s): 1800.77
CPU time (s): 1800.45
CPU user time (s): 1800.23
CPU system time (s): 0.216967
CPU usage (%): 99.9825
Max. virtual memory (cumulated for all children) (KiB): 140612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.23
system time used= 0.216967
maximum resident set size= 103044
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 79645
page faults= 0
swaps= 0
block input operations= 0
block output operations= 2128
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 324
involuntary context switches= 2642

runsolver used 3.74143 second user time and 10.0745 second system time

The end

Launcher Data 

Begin job on node144 at 2012-06-03 07:25:11
IDJOB=3731800
IDBENCH=1987
IDSOLVER=2317
FILE ID=node144/3731800-1338701111
RUNJOBID= node144-1338697504-28582
PBS_JOBID= 14636669
Free space on /tmp= 70788 MiB

SOLVER NAME= PB07: PB-clasp 2007-04-10
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/vtxcov/normalized-vtxcov_v2000_e4000_18.opb.PB06.opb
COMMAND LINE= pbclasp BENCHNAMENOPATH TMPDIR/temp
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731800-1338701111/watcher-3731800-1338701111 -o /tmp/evaluation-result-3731800-1338701111/solver-3731800-1338701111 -C 1800 -W 1900 -M 15500  pbclasp instance-3731800-1338701111.opb HOME/temp

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e1d6958876c3f9359c6b5193f1345bd5
RANDOM SEED=756659849

node144.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27655024 kB
Buffers:          631456 kB
Cached:          3698176 kB
SwapCached:          464 kB
Active:          2463616 kB
Inactive:        1888532 kB
Active(anon):       4864 kB
Inactive(anon):    11192 kB
Active(file):    2458752 kB
Inactive(file):  1877340 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108384 kB
Dirty:             17560 kB
Writeback:             0 kB
AnonPages:         22664 kB
Mapped:            14616 kB
Shmem:               172 kB
Slab:             726512 kB
SReclaimable:     168484 kB
SUnreclaim:       558028 kB
KernelStack:        1496 kB
PageTables:         4408 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     137792 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731800-1338701111.opb

Free space on /tmp at the end= 70836 MiB
End job on node144 at 2012-06-03 07:55:13