Trace number 3731811

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: PB-clasp 2007-04-10SAT (TO)1165 1800.34 1800.63

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
vtxcov/normalized-vtxcov_v2000_e4000_8.opb.PB06.opb
MD5SUM810966efbb409d6e2e91a116be6e9263
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1040
Best CPU time to get the best result obtained on this benchmark1796.76
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1038
Optimality of the best value was proved NO
Number of variables1963
Total number of constraints4000
Number of constraints which are clauses4000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1963
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1963
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1963
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.17/0.23	o 1304
0.22/0.32	o 1167
0.30/0.40	o 1165
1799.86/1800.29	sh: line 1: 29111 Done                    cat HOME/temp/instance-3731811-1338701111.opb.op
1799.86/1800.29	     29112 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3731811-1338701111.opb.clasp
1800.29/1800.61	sh: line 1: 29146 Done                    cat HOME/temp/instance-3731811-1338701111.opb.op
1800.29/1800.61	     29147 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3731811-1338701111.opb.clasp
1800.29/1800.62	c Somebody sent me a SIGTERM
1800.29/1800.62	s SATISFIABLE
1800.29/1800.62	v x5 x8 x14 x17 x18 x23 x27 x29 x39 x40 x42 x44 x47 x48 x49 x58 x61 x64 x66 x68 x69 x72 x74 x75 x81 x83 x85 x86 x88 x89 x94 x102 x105 x108 x111 x116 x118 x119 x120 x121 x122 x123 x125 x132 x135 x141 x143 x144 x148 x151 x154 x155 x157 x159 x160 x162 x169 x172 x175 x181 x183 x184 x185 x186 x187 x188 x190 x192 x194 x200 x202 x206 x209 x210 x215 x217 x220 x224 x226 x227 x228 x229 x230 x231 x233 x234 x239 x246 x248 x251 x253 x255 x256 x257 x258 x264 x265 x266 x267 x274 x275 x276 x278 x280 x282 x286 x288 x289 x295 x297 x298 x299 x300 x301 x302 x303 x304 x305 x306 x307 x308 x310 x311 x313 x314 x315 x316 x317 x318 x319 x321 x326 x328 x329 x338 x340 x341 x342 x343 x347 x349 x350 x352 x354 x356 x357 x358 x360 x362 x363 x364 x367 x368 x369 x372 x376 x378 x379 x380 x383 x386 x390 x393 x397 x400 x406 x407 x408 x409 x410 x412 x415 x416 x417 x421 x422 x423 x424 x425 x427 x429 x433 x435 x436 x437 x438 x439 x440 x441 x444 x446 x447 x448 x451 x455 x460 x461 x462 x465 x467 x469 x470 x471 x474 x475 x478 x480 x482 x483 x484 x485 x486 x488 x490 x491 x492 x493 x498 x501 x502 x503 x505 x506 x507 x508 x510 x511 x516 x517 x520 x522 x523 x525 x526 x529 x530 x531 x532 x535 x536 x537 x538 x540 x541 x544 x545 x547 x550 x552 x553 x554 x556 x557 x560 x562 x563 x564 x565 x566 x570 x571 x574 x577 x578 x583 x585 x586 x587 x589 x590 x591 x593 x597 x598 x599 x600 x605 x607 x608 x609 x611 x612 x613 x614 x618 x620 x622 x623 x624 x629 x630 x631 x632 x633 x634 x639 x640 x643 x644 x645 x648 x649 x650 x651 x654 x656 x657 x658 x660 x661 x663 x664 x666 x668 x673 x674 x675 x680 x682 x684 x685 x686 x687 x688 x689 x690 x691 x693 x694 x696 x698 x699 x704 x705 x707 x708 x711 x712 x713 x715 x717 x718 x720 x721 x722 x723 x724 x725 x726 x727 x728 x729 x730 x731 x732 x733 x734 x735 x736 x738 x740 x744 x745 x747 x748 x750 x752 x753 x754 x755 x757 x759 x760 x762 x763 x764 x765 x766 x768 x772 x773 x774 x775 x777 x780 x781 x782 x783 x784 x785 x786 x787 x789 x790 x791 x792 x795 x796 x798 x801 x804 x805 x806 x808 x809 x810 x813 x814 x816 x818 x820 x821 x822 x823 x825 x830 x831 x832 x834 x835 x836 x837 x838 x839 x840 x841 x842 x843 x844 x846 x847 x849 x851 x852 x855 x856 x857 x859 x860 x861 x862 x866 x867 x869 x873 x874 x875 x876 x879 x880 x882 x884 x885 x887 x890 x891 x892 x893 x894 x895 x897 x899 x901 x902 x904 x905 x906 x907 x908 x909 x910 x911 x912 x914 x915 x916 x919 x920 x921 x923 x926 x928 x933 x934 x935 x936 x937 x938 x940 x941 x944 x945 x947 x950 x951 x954 x955 x956 x959 x960 x961 x962 x963 x964 x965 x966 x967 x968 x969 x971 x972 x975 x977 x979 x980 x983 x984 x986 x987 x988 x989 x990 x992 x994 x995 x998 x999 x1001 x1002 x1005 x1006 x1007 x1008 x1009 x1010 x1011 x1012 x1013 x1014 x1015 x1017 x1019 x1020 x1021 x1024 x1025 x1027 x1028 x1029 x1030 x1032 x1033 x1034 x1035 x1038 x1041 x1043 x1044 x1046 x1047 x1048 x1049 x1051 x1052 x1053 x1054 x1056 x1058 x1059 x1062 x1063 x1066 x1067 x1069 x1071 x1072 x1074 x1077 x1078 x1079 x1082 x1085 x1088 x1089 x1090 x1091 x1092 x1094 x1095 x1097 x1099 x1100 x1101 x1102 x1103 x1104 x1105 x1106 x1107 x1108 x1109 x1113 x1115 x1116 x1117 x1120 x1121 x1122 x1123 x1125 x1126 x1127 x1128 x1130 x1131 x1132 x1134 x1135 x1136 x1137 x1141 x1145 x1146 x1147 x1149 x1150 x1152 x1154 x1156 x1157 x1159 x1161 x1162 x1163 x1164 x1165 x1168 x1170 x1173 x1174 x1177 x1178 x1179 x1181 x1185 x1187 x1191 x1193 x1198 x1199 x1202 x1203 x1204 x1205 x1207 x1208 x1210 x1211 x1212 x1213 x1214 x1216 x1219 x1220 x1221 x1222 x1224 x1225 x1226 x1229 x1231 x1233 x1234 x1236 x1237 x1238 x1239 x1240 x1241 x1242 x1243 x1244 x1245 x1252 x1253 x1254 x1255 x1256 x1257 x1258 x1259 x1262 x1263 x1265 x1266 x1267 x1268 x1269 x1270 x1271 x1273 x1277 x1278 x1279 x1280 x1281 x1282 x1284 x1285 x1287 x1288 x1290 x1291 x1292 x1293 x1294 x1295 x1296 x1298 x1299 x1300 x1302 x1305 x1306 x1310 x1311 x1312 x1313 x1314 x1315 x1317 x1318 x1320 x1321 x1323 x1324 x1325 x1327 x1328 x1329 x1332 x1333 x1338 x1339 x1340 x1341 x1343 x1345 x1346 x1347 x1348 x1350 x1351 x1352 x1354 x1356 x1357 x1358 x1359 x1360 x1363 x1364 x1365 x1368 x1369 x1370 x1371 x1372 x1374 x1377 x1378 x1379 x1381 x1382 x1383 x1384 x1386 x1387 x1390 x1391 x1392 x1396 x1397 x1398 x1399 x1400 x1401 x1404 x1405 x1407 x1408 x1409 x1410 x1411 x1412 x1413 x1414 x1415 x1417 x1419 x1421 x1423 x1426 x1428 x1430 x1431 x1432 x1433 x1437 x1439 x1441 x1442 x1443 x1444 x1445 x1449 x1450 x1452 x1454 x1455 x1456 x1457 x1458 x1459 x1462 x1463 x1464 x1465 x1466 x1468 x1469 x1471 x1472 x1474 x1475 x1476 x1477 x1479 x1480 x1482 x1484 x1486 x1487 x1488 x1489 x1490 x1491 x1492 x1496 x1498 x1499 x1500 x1501 x1502 x1506 x1509 x1510 x1511 x1512 x1515 x1517 x1518 x1519 x1520 x1523 x1525 x1526 x1528 x1529 x1531 x1532 x1533 x1534 x1535 x1536 x1537 x1538 x1540 x1541 x1542 x1543 x1544 x1545 x1546 x1547 x1548 x1550 x1551 x1554 x1555 x1556 x1557 x1561 x1562 x1563 x1564 x1565 x1567 x1568 x1569 x1571 x1574 x1575 x1577 x1579 x1584 x1585 x1587 x1588 x1589 x1590 x1591 x1592 x1595 x1596 x1597 x1598 x1599 x1601 x1603 x1604 x1605 x1606 x1607 x1608 x1609 x1610 x1611 x1612 x1613 x1615 x1617 x1619 x1620 x1622 x1623 x1624 x1626 x1627 x1629 x1630 x1633 x1636 x1637 x1638 x1641 x1642 x1643 x1644 x1645 x1646 x1649 x1650 x1651 x1653 x1655 x1656 x1657 x1659 x1660 x1661 x1663 x1665 x1666 x1667 x1669 x1670 x1672 x1673 x1674 x1676 x1678 x1679 x1680 x1681 x1684 x1685 x1689 x1692 x1693 x1695 x1698 x1699 x1701 x1702 x1703 x1704 x1705 x1706 x1707 x1710 x1713 x1714 x1717 x1718 x1719 x1721 x1724 x1725 x1726 x1728 x1731 x1732 x1733 x1736 x1738 x1740 x1741 x1743 x1744 x1746 x1747 x1749 x1750 x1751 x1752 x1753 x1754 x1755 x1759 x1760 x1761 x1764 x1766 x1767 x1768 x1770 x1773 x1774 x1776 x1777 x1779 x1783 x1784 x1785 x1786 x1787 x1788 x1790 x1791 x1792 x1793 x1794 x1795 x1797 x1798 x1799 x1800 x1801 x1803 x1804 x1805 x1806 x1808 x1809 x1810 x1812 x1814 x1815 x1816 x1817 x1819 x1820 x1822 x1823 x1824 x1825 x1826 x1827 x1831 x1832 x1835 x1837 x1841 x1842 x1843 x1845 x1848 x1850 x1851 x1853 x1856 x1857 x1860 x1861 x1862 x1863 x1864 x1865 x1866 x1867 x1870 x1872 x1873 x1874 x1876 x1877 x1879 x1880 x1881 x1882 x1883 x1886 x1888 x1889 x1890 x1891 x1894 x1896 x1897 x1898 x1899 x1900 x1901 x1902 x1903 x1904 x1906 x1907 x1910 x1911 x1912 x1913 x1914 x1915 x1917 x1918 x1919 x1920 x1921 x1922 x1923 x1924 x1925 x1927 x1928 x1929 x1930 x1932 x1934 x1935 x1936 x1939 x1940 x1941 x1942 x1944 x1945 x1946 x1947 x1948 x1949 x1950 x1951 x1952 x1953 x1954 x1956 x1957 x1958 x1959 x1960 x1961 x1962 x1963 
1800.29/1800.62	pb2clasp1: no process killed
1800.29/1800.62	cat: write error: Broken pipe
1800.29/1800.62	sh: line 1: 29154 Done(1)                 cat HOME/temp/instance-3731811-1338701111.opb.op
1800.29/1800.62	     29155 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3731811-1338701111.opb.clasp

Verifier Data 

OK	1165

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731811-1338701111/watcher-3731811-1338701111 -o /tmp/evaluation-result-3731811-1338701111/solver-3731811-1338701111 -C 1800 -W 1900 -M 15500 pbclasp instance-3731811-1338701111.opb HOME/temp 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 29047
/proc/meminfo: memFree=27707092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=25724 CPUtime=0 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) R 29045 29047 23082 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 336236009 26341376 528 33554432000 4194304 4198148 140736301166400 140734097959352 223676988688 0 0 4224 16384 0 0 0 17 0 0 0 0 0 0
/proc/29047/statm: 6431 528 361 1 0 226 0

[startup+0.0909021 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 29047
/proc/meminfo: memFree=27707092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26132 CPUtime=0.03 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 703 0 0 0 3 0 0 0 20 0 1 0 336236009 26759168 615 33554432000 4194304 4198148 140736301166400 140736301165288 223655027952 0 0 4224 16384 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/29047/statm: 6533 615 368 1 0 328 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 26132

[startup+0.100209 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 29047
/proc/meminfo: memFree=27707092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26132 CPUtime=0.03 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 703 0 0 0 3 0 0 0 20 0 1 0 336236009 26759168 615 33554432000 4194304 4198148 140736301166400 140736301165288 223655027952 0 0 4224 16384 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/29047/statm: 6533 615 368 1 0 328 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 26132

[startup+0.300129 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 29047
/proc/meminfo: memFree=27707092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.22 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1039 4936 0 0 4 0 18 0 20 0 1 0 336236009 26894336 687 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 687 387 1 0 361 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 26264

[startup+0.700115 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 29047
/proc/meminfo: memFree=27707092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 26264

[startup+1.50031 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27680336/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=20724 CPUtime=1.07 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 4758 0 0 0 107 0 0 0 20 0 1 0 336236050 21221376 4655 33554432000 134512640 134847168 4290107728 4290105984 1582375 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 5181 4655 272 82 0 4422 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 56136

[startup+3.1003 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27664092/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=24992 CPUtime=2.68 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 5836 0 0 0 267 1 0 0 20 0 1 0 336236050 25591808 5733 33554432000 134512640 134847168 4290107728 4290106304 134714871 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 6248 5733 272 82 0 5489 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 60404

[startup+6.3003 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27650700/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=29592 CPUtime=5.88 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 6975 0 0 0 587 1 0 0 20 0 1 0 336236050 30302208 6872 33554432000 134512640 134847168 4290107728 4290106352 134784667 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 7398 6872 272 82 0 6639 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 65004

[startup+12.7003 s]
/proc/loadavg: 2.02 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27638752/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=35088 CPUtime=12.28 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 8349 0 0 0 1227 1 0 0 20 0 1 0 336236050 35930112 8246 33554432000 134512640 134847168 4290107728 4290106420 134616619 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 8772 8246 272 82 0 8013 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 70500

[startup+25.5003 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27626360/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=41516 CPUtime=25.07 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 9957 0 0 0 2506 1 0 0 20 0 1 0 336236050 42512384 9854 33554432000 134512640 134847168 4290107728 4290106448 134741346 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 10379 9854 272 82 0 9620 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 76928

[startup+51.1003 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 29112
/proc/meminfo: memFree=27609820/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=45380 CPUtime=50.65 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 12129 0 0 0 5064 1 0 0 20 0 1 0 336236050 46469120 10847 33554432000 134512640 134847168 4290107728 4290106036 134793021 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 11345 10847 272 82 0 10586 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 80792

[startup+102.307 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29113
/proc/meminfo: memFree=27598524/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=54968 CPUtime=101.85 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 14640 0 0 0 10183 2 0 0 20 0 1 0 336236050 56287232 13238 33554432000 134512640 134847168 4290107728 4290106352 134784505 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 13742 13238 272 82 0 12983 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 90380

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29113
/proc/meminfo: memFree=27583200/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=59204 CPUtime=161.83 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 16760 0 0 0 16180 3 0 0 20 0 1 0 336236050 60624896 14303 33554432000 134512640 134847168 4290107728 4290106304 134714694 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 14801 14303 272 82 0 14042 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 94616

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29113
/proc/meminfo: memFree=27576300/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=65832 CPUtime=221.82 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 18597 0 0 0 22179 3 0 0 20 0 1 0 336236050 67411968 15959 33554432000 134512640 134847168 4290107728 4290106352 134784673 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 16458 15959 272 82 0 15699 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 101244

[startup+282.3 s]

################
# More data... #
################

[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=97232 CPUtime=1241.67 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 34892 0 0 0 124158 9 0 0 20 0 1 0 336236050 99565568 23794 33554432000 134512640 134847168 4290107728 4290106412 134789696 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24308 23794 272 82 0 23549 0
Current children cumulated CPU time (s) 1242.06
Current children cumulated vsize (KiB) 132644

[startup+1302.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/181 29124
/proc/meminfo: memFree=27514232/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=97748 CPUtime=1301.66 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 35059 0 0 0 130157 9 0 0 20 0 1 0 336236050 100093952 23928 33554432000 134512640 134847168 4290107728 4290106352 134784670 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24437 23928 272 82 0 23678 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 133160

[startup+1362.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/181 29124
/proc/meminfo: memFree=27513976/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=97932 CPUtime=1361.65 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 35094 0 0 0 136156 9 0 0 20 0 1 0 336236050 100282368 23963 33554432000 134512640 134847168 4290107728 4290106408 134789702 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24483 23963 272 82 0 23724 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 133344

[startup+1422.31 s]
/proc/loadavg: 2.08 2.03 2.01 3/181 29124
/proc/meminfo: memFree=27514040/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=97932 CPUtime=1421.64 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 35095 0 0 0 142155 9 0 0 20 0 1 0 336236050 100282368 23964 33554432000 134512640 134847168 4290107728 4290106352 134784711 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24483 23964 272 82 0 23724 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 133344

[startup+1482.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/181 29124
/proc/meminfo: memFree=27505784/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=97932 CPUtime=1481.63 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 35095 0 0 0 148154 9 0 0 20 0 1 0 336236050 100282368 23964 33554432000 134512640 134847168 4290107728 4290105996 134793560 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24483 23964 272 82 0 23724 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 133344

[startup+1542.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/182 29127
/proc/meminfo: memFree=27505904/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=98024 CPUtime=1541.62 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 35105 0 0 0 154153 9 0 0 20 0 1 0 336236050 100376576 23974 33554432000 134512640 134847168 4290107728 4290106368 134715273 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 24506 23974 272 82 0 23747 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 133436

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27497604/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=106340 CPUtime=1601.61 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 37175 0 0 0 160151 10 0 0 20 0 1 0 336236050 108892160 26044 33554432000 134512640 134847168 4290107728 4290106368 134777495 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 26585 26044 272 82 0 25826 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 141752

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27497292/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=106432 CPUtime=1661.6 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 38678 0 0 0 166150 10 0 0 20 0 1 0 336236050 108986368 26086 33554432000 134512640 134847168 4290107728 4290106004 134792639 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 26608 26086 272 82 0 25849 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 141844

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 29128
/proc/meminfo: memFree=27497036/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=106616 CPUtime=1721.59 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 38711 0 0 0 172149 10 0 0 20 0 1 0 336236050 109174784 26131 33554432000 134512640 134847168 4290107728 4290106448 134741381 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 26654 26131 272 82 0 25895 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 142028

[startup+1782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/181 29128
/proc/meminfo: memFree=27496848/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=0.39 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1351 10761 0 0 5 0 32 2 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29110] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29110/stat : 29110 (sh) S 29047 29047 23082 0 -1 4202496 374 221 0 0 0 0 0 0 20 0 1 0 336236050 9367552 264 33554432000 4194304 5064252 140734312580800 140734312579056 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/29110/statm: 2287 264 223 213 0 72 0
[pid=29112] ppid=29110 vsize=106744 CPUtime=1781.58 cores=0,2,4,6
/proc/29112/stat : 29112 (clasp-1.0) R 29110 29047 23082 0 -1 4202496 38757 0 0 0 178148 10 0 0 20 0 1 0 336236050 109305856 26177 33554432000 134512640 134847168 4290107728 4290106368 134715402 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/29112/statm: 26686 26177 272 82 0 25927 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 142156



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.09 2.03 2.00 3/182 29147
/proc/meminfo: memFree=27691000/32873844 swapFree=7628/7628
[pid=29047] ppid=29045 vsize=26264 CPUtime=1799.98 cores=0,2,4,6
/proc/29047/stat : 29047 (pbclasp) S 29045 29047 23082 0 -1 4202496 1453 51464 0 0 5 0 179979 14 20 0 1 0 336236009 26894336 689 33554432000 4194304 4198148 140736301166400 140736301165328 223655030814 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/29047/statm: 6566 689 387 1 0 361 0
[pid=29145] ppid=29047 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/29145/stat : 29145 (sh) S 29047 29047 23082 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 336416038 9367552 264 33554432000 4194304 5064252 140734586289760 140734586288016 223651456590 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/29145/statm: 2287 264 223 213 0 72 0
[pid=29147] ppid=29145 vsize=9672 CPUtime=0.31 cores=0,2,4,6
/proc/29147/stat : 29147 (clasp-1.0) R 29145 29047 23082 0 -1 4202496 1981 0 0 0 31 0 0 0 20 0 1 0 336416038 9904128 1879 33554432000 134512640 134847168 4288940816 4288939092 134792629 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/29147/statm: 2418 1879 270 82 0 1659 0
Current children cumulated CPU time (s) 1800.29
Current children cumulated vsize (KiB) 45084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.63
CPU time (s): 1800.34
CPU user time (s): 1800.17
CPU system time (s): 0.167974
CPU usage (%): 99.9839
Max. virtual memory (cumulated for all children) (KiB): 142156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.17
system time used= 0.167974
maximum resident set size= 104708
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 59169
page faults= 0
swaps= 0
block input operations= 0
block output operations= 2480
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 316
involuntary context switches= 2144

runsolver used 3.9224 second user time and 9.2036 second system time

The end

Launcher Data 

Begin job on node144 at 2012-06-03 07:25:11
IDJOB=3731811
IDBENCH=1988
IDSOLVER=2317
FILE ID=node144/3731811-1338701111
RUNJOBID= node144-1338697504-28581
PBS_JOBID= 14636669
Free space on /tmp= 70836 MiB

SOLVER NAME= PB07: PB-clasp 2007-04-10
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/vtxcov/normalized-vtxcov_v2000_e4000_8.opb.PB06.opb
COMMAND LINE= pbclasp BENCHNAMENOPATH TMPDIR/temp
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731811-1338701111/watcher-3731811-1338701111 -o /tmp/evaluation-result-3731811-1338701111/solver-3731811-1338701111 -C 1800 -W 1900 -M 15500  pbclasp instance-3731811-1338701111.opb HOME/temp

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 810966efbb409d6e2e91a116be6e9263
RANDOM SEED=756659849

node144.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.196
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27707876 kB
Buffers:          631472 kB
Cached:          3647332 kB
SwapCached:          464 kB
Active:          2416416 kB
Inactive:        1884112 kB
Active(anon):       4204 kB
Inactive(anon):    11192 kB
Active(file):    2412212 kB
Inactive(file):  1872920 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108384 kB
Dirty:               876 kB
Writeback:             0 kB
AnonPages:         22468 kB
Mapped:            15004 kB
Shmem:               172 kB
Slab:             726252 kB
SReclaimable:     168224 kB
SUnreclaim:       558028 kB
KernelStack:        1496 kB
PageTables:         3244 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     128908 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731811-1338701111.opb

Free space on /tmp at the end= 70836 MiB
End job on node144 at 2012-06-03 07:55:14