Trace number 1858816

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjCPU timeWall clock time
pbclasp 2009-04-24SAT (TO)-42 1800.03 1800.53

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/
~kexu/benchmarks/frb53-24-opb/normalized-frb53-24-1.opb
MD5SUM604c6b786f56b09c749bc0d6b7c8f76d
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-42
Best CPU time to get the best result obtained on this benchmark1798.21
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -52
Optimality of the best value was proved NO
Number of variables1272
Total number of constraints94227
Number of constraints which are clauses94227
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1272
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1272
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1272
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c optimisation-statement found. OPT-category assumed.
0.00/0.75	o -28
0.00/0.75	o -36
0.00/0.81	o -37
1.33/1.13	o -39
81.19/81.03	o -40
1678.86/1679.31	o -41
1680.06/1680.52	o -42
1800.03/1800.50	s SATISFIABLE
1800.03/1800.50	v x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 -x435 -x436 x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 -x457 -x458 -x459 x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 -x510 -x511 -x512 -x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 -x522 -x523 -x524 -x525 -x526 -x527 -x528 -x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 -x551 -x552 -x553 -x554 -x555 x556 -x557 -x558 -x559 -x560 -x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 -x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 -x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 -x673 -x674 -x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 -x686 -x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 -x695 -x696 -x697 -x698 -x699 -x700 -x701 -x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 -x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 -x719 -x720 x721 -x722 -x723 -x724 -x725 -x726 -x727 -x728 -x729 -x730 -x731 -x732 -x733 -x734 -x735 -x736 -x737 -x738 -x739 -x740 -x741 -x742 -x743 -x744 -x745 -x746 -x747 -x748 -x749 -x750 -x751 -x752 -x753 -x754 -x755 -x756 -x757 -x758 -x759 -x760 -x761 -x762 -x763 -x764 -x765 -x766 -x767 -x768 -x769 -x770 -x771 -x772 -x773 -x774 -x775 -x776 -x777 -x778 x779 -x780 -x781 -x782 -x783 -x784 -x785 -x786 -x787 -x788 -x789 -x790 -x791 -x792 -x793 -x794 -x795 -x796 -x797 -x798 -x799 -x800 -x801 -x802 -x803 -x804 -x805 -x806 -x807 -x808 -x809 -x810 -x811 -x812 -x813 -x814 -x815 -x816 -x817 -x818 -x819 -x820 -x821 -x822 -x823 -x824 -x825 -x826 -x827 -x828 -x829 -x830 -x831 -x832 -x833 -x834 -x835 -x836 -x837 -x838 -x839 -x840 -x841 -x842 -x843 -x844 -x845 -x846 -x847 -x848 -x849 -x850 -x851 -x852 -x853 -x854 x855 -x856 -x857 -x858 -x859 -x860 -x861 -x862 -x863 -x864 -x865 -x866 -x867 -x868 -x869 -x870 -x871 -x872 -x873 -x874 -x875 -x876 -x877 -x878 -x879 x880 -x881 -x882 -x883 -x884 -x885 -x886 -x887 -x888 -x889 -x890 -x891 -x892 x893 -x894 -x895 -x896 -x897 -x898 -x899 -x900 -x901 -x902 -x903 -x904 -x905 -x906 -x907 -x908 -x909 -x910 -x911 -x912 -x913 -x914 -x915 -x916 -x917 -x918 x919 -x920 -x921 -x922 -x923 -x924 -x925 -x926 -x927 -x928 -x929 -x930 -x931 -x932 -x933 -x934 -x935 -x936 -x937 -x938 -x939 -x940 -x941 -x942 -x943 -x944 -x945 -x946 -x947 -x948 -x949 -x950 -x951 -x952 -x953 x954 -x955 -x956 -x957 -x958 -x959 -x960 -x961 -x962 -x963 -x964 x965 -x966 -x967 -x968 -x969 -x970 -x971 -x972 -x973 -x974 -x975 -x976 -x977 -x978 -x979 -x980 -x981 -x982 -x983 -x984 -x985 -x986 -x987 -x988 x989 -x990 -x991 -x992 -x993 -x994 -x995 -x996 -x997 -x998 -x999 -x1000 -x1001 -x1002 -x1003 -x1004 -x1005 -x1006 -x1007 -x1008 -x1009 -x1010 -x1011 -x1012 -x1013 -x1014 -x1015 -x1016 -x1017 -x1018 -x1019 -x1020 -x1021 -x1022 -x1023 x1024 -x1025 -x1026 -x1027 -x1028 -x1029 -x1030 -x1031 -x1032 -x1033 -x1034 -x1035 x1036 -x1037 -x1038 -x1039 -x1040 -x1041 -x1042 -x1043 -x1044 -x1045 -x1046 -x1047 -x1048 -x1049 -x1050 -x1051 -x1052 -x1053 -x1054 -x1055 -x1056 -x1057 -x1058 -x1059 -x1060 -x1061 -x1062 -x1063 -x1064 -x1065 -x1066 -x1067 -x1068 -x1069 -x1070 -x1071 -x1072 -x1073 -x1074 -x1075 -x1076 -x1077 -x1078 -x1079 -x1080 -x1081 -x1082 -x1083 -x1084 -x1085 -x1086 -x1087 -x1088 -x1089 -x1090 -x1091 -x1092 -x1093 -x1094 -x1095 -x1096 -x1097 -x1098 -x1099 -x1100 -x1101 -x1102 -x1103 -x1104 -x1105 -x1106 -x1107 -x1108 -x1109 -x1110 -x1111 -x1112 -x1113 -x1114 -x1115 -x1116 -x1117 -x1118 -x1119 -x1120 -x1121 -x1122 x1123 -x1124 -x1125 -x1126 -x1127 -x1128 -x1129 -x1130 -x1131 -x1132 -x1133 -x1134 -x1135 -x1136 x1137 -x1138 -x1139 -x1140 -x1141 -x1142 -x1143 -x1144 -x1145 -x1146 -x1147 -x1148 -x1149 -x1150 -x1151 -x1152 -x1153 -x1154 -x1155 -x1156 -x1157 -x1158 -x1159 -x1160 -x1161 -x1162 -x1163 -x1164 -x1165 -x1166 -x1167 -x1168 -x1169 -x1170 x1171 -x1172 -x1173 -x1174 -x1175 -x1176 -x1177 -x1178 -x1179 -x1180 -x1181 -x1182 -x1183 -x1184 -x1185 -x1186 -x1187 -x1188 -x1189 -x1190 -x1191 -x1192 -x1193 -x1194 -x1195 -x1196 -x1197 -x1198 -x1199 -x1200 -x1201 -x1202 -x1203 -x1204 -x1205 -x1206 -x1207 -x1208 -x1209 -x1210 -x1211 -x1212 -x1213 -x1214 x1215 -x1216 -x1217 -x1218 -x1219 -x1220 -x1221 -x1222 -x1223 -x1224 -x1225 -x1226 -x1227 -x1228 x1229 -x1230 -x1231 -x1232 -x1233 -x1234 -x1235 -x1236 -x1237 -x1238 -x1239 -x1240 -x1241 -x1242 -x1243 -x1244 -x1245 -x1246 -x1247 -x1248 -x1249 -x1250 -x1251 -x1252 -x1253 -x1254 -x1255 -x1256 -x1257 -x1258 -x1259 -x1260 -x1261 -x1262 -x1263 -x1264 -x1265 -x1266 -x1267 -x1268 -x1269 -x1270 -x1271 x1272

Verifier Data 

OK	-42

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1858816-1244895592/watcher-1858816-1244895592 -o /tmp/evaluation-result-1858816-1244895592/solver-1858816-1244895592 -C 1800 -W 2000 -M 1800 perl HOME/pbclasp HOME/instance-1858816-1244895592.opb HOME HOME 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 14117
/proc/meminfo: memFree=1284104/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) R 14115 14117 13885 0 -1 4194304 353 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 320 1992294400 4194304 4206940 548682068784 18446744073709551615 221236335329 0 0 4224 0 0 0 0 17 0 0 0
/proc/14117/statm: 3067 323 245 3 0 167 0

[startup+0.016484 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 14117
/proc/meminfo: memFree=1284104/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 12268

[startup+0.101422 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 14117
/proc/meminfo: memFree=1284104/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 12268

[startup+0.301445 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 14117
/proc/meminfo: memFree=1284104/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 12268

[startup+0.701492 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 14117
/proc/meminfo: memFree=1284104/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 12268

[startup+1.50157 s]
/proc/loadavg: 0.92 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1260520/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=24400 CPUtime=1.34
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 7771 0 0 0 132 2 0 0 18 0 1 0 157159173 24985600 5814 1992294400 134512640 136070948 4294956272 18446744073709551615 134636578 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 6100 5814 193 380 0 5717 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1.73
Current children cumulated vsize (KiB) 43280

[startup+3.10174 s]
/proc/loadavg: 0.92 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1257768/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=36340 CPUtime=2.94
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 10755 0 0 0 290 4 0 0 20 0 1 0 157159173 37212160 8798 1992294400 134512640 136070948 4294956272 18446744073709551615 134614257 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 9085 8798 193 380 0 8702 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 3.33
Current children cumulated vsize (KiB) 55220

[startup+6.30208 s]
/proc/loadavg: 0.93 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1231656/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=59840 CPUtime=6.13
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 16619 0 0 0 607 6 0 0 25 0 1 0 157159173 61276160 14662 1992294400 134512640 136070948 4294956272 18446744073709551615 135456502 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 14960 14662 193 380 0 14577 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 6.52
Current children cumulated vsize (KiB) 78720

[startup+12.7028 s]
/proc/loadavg: 0.93 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1197160/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=90064 CPUtime=12.54
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 24156 0 0 0 1244 10 0 0 25 0 1 0 157159173 92225536 22199 1992294400 134512640 136070948 4294956272 18446744073709551615 134647509 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 22516 22199 193 380 0 22133 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 12.93
Current children cumulated vsize (KiB) 108944

[startup+25.5012 s]
/proc/loadavg: 0.95 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1153512/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=132072 CPUtime=25.32
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 34670 0 0 0 2518 14 0 0 25 0 1 0 157159173 135241728 32713 1992294400 134512640 136070948 4294956272 18446744073709551615 134647506 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 33018 32713 193 380 0 32635 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 25.71
Current children cumulated vsize (KiB) 150952

[startup+51.1019 s]
/proc/loadavg: 0.96 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1103656/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=181176 CPUtime=50.91
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 46929 0 0 0 5071 20 0 0 25 0 1 0 157159173 185524224 44972 1992294400 134512640 136070948 4294956272 18446744073709551615 134835576 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 45294 44972 193 380 0 44911 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 15 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 51.3
Current children cumulated vsize (KiB) 200056

[startup+102.305 s]
/proc/loadavg: 0.98 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1082920/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=201736 CPUtime=102.1
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 52101 0 0 0 10187 23 0 0 25 0 1 0 157159173 206577664 50144 1992294400 134512640 136070948 4294956272 18446744073709551615 134802175 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 50434 50144 193 380 0 50051 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 102.49
Current children cumulated vsize (KiB) 220616

[startup+162.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=1072424/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=213264 CPUtime=162.07
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 54982 0 0 0 16183 24 0 0 25 0 1 0 157159173 218382336 53025 1992294400 134512640 136070948 4294956272 18446744073709551615 135456502 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 53316 53025 193 380 0 52933 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 162.46
Current children cumulated vsize (KiB) 232144

[startup+222.301 s]

################
# More data... #
################

/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1421.97
Current children cumulated vsize (KiB) 352476

[startup+1482.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=950952/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=333596 CPUtime=1481.55
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 84924 0 0 0 148114 41 0 0 25 0 1 0 157159173 341602304 82967 1992294400 134512640 136070948 4294956272 18446744073709551615 134647506 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 83399 82967 193 380 0 83016 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1481.94
Current children cumulated vsize (KiB) 352476

[startup+1542.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=950952/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=333596 CPUtime=1541.52
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 84924 0 0 0 154111 41 0 0 25 0 1 0 157159173 341602304 82967 1992294400 134512640 136070948 4294956272 18446744073709551615 134835542 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 83399 82967 193 380 0 83016 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1541.91
Current children cumulated vsize (KiB) 352476

[startup+1602.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=950952/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=333596 CPUtime=1601.5
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 84924 0 0 0 160109 41 0 0 25 0 1 0 157159173 341602304 82967 1992294400 134512640 136070948 4294956272 18446744073709551615 134647506 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 83399 82967 193 380 0 83016 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1601.89
Current children cumulated vsize (KiB) 352476

[startup+1662.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=920808/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=363884 CPUtime=1661.48
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 92459 0 0 0 166102 46 0 0 25 0 1 0 157159173 372617216 90502 1992294400 134512640 136070948 4294956272 18446744073709551615 134647506 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 90971 90502 193 380 0 90588 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1661.87
Current children cumulated vsize (KiB) 382764

[startup+1722.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=920744/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=363884 CPUtime=1721.46
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 92464 0 0 0 172100 46 0 0 25 0 1 0 157159173 372617216 90507 1992294400 134512640 136070948 4294956272 18446744073709551615 134835542 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 90971 90507 193 380 0 90588 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1721.85
Current children cumulated vsize (KiB) 382764

[startup+1782.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=918312/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=366276 CPUtime=1781.44
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 93064 0 0 0 178097 47 0 0 25 0 1 0 157159173 375066624 91107 1992294400 134512640 136070948 4294956272 18446744073709551615 134636586 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 91569 91107 193 380 0 91186 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1781.83
Current children cumulated vsize (KiB) 385156



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=918312/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=366276 CPUtime=1799.64
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 93064 0 0 0 179917 47 0 0 25 0 1 0 157159173 375066624 91107 1992294400 134512640 136070948 4294956272 18446744073709551615 134835542 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 91569 91107 193 380 0 91186 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 385156

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 0.99 0.98 0.99 2/68 14122
/proc/meminfo: memFree=918312/2055920 swapFree=4182488/4192956
[pid=14117] ppid=14115 vsize=12268 CPUtime=0
/proc/14117/stat : 14117 (perl) S 14115 14117 13885 0 -1 4194304 453 0 0 0 0 0 0 0 18 0 1 0 157159172 12562432 413 1992294400 4194304 4206940 548682068784 18446744073709551615 221245390740 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/14117/statm: 3067 413 319 3 0 167 0
[pid=14119] ppid=14117 vsize=5356 CPUtime=0.39
/proc/14119/stat : 14119 (sh) S 14117 14117 13885 0 -1 4194304 305 150 0 0 0 0 39 0 16 0 1 0 157159173 5484544 227 1992294400 4194304 4889804 548682068624 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14119/statm: 1339 227 188 169 0 50 0
[pid=14121] ppid=14119 vsize=366276 CPUtime=1799.64
/proc/14121/stat : 14121 (clasp) R 14119 14117 13885 0 -1 4194304 93064 0 0 0 179917 47 0 0 25 0 1 0 157159173 375066624 91107 1992294400 134512640 136070948 4294956272 18446744073709551615 134835542 0 0 4096 16386 0 0 0 17 0 0 0
/proc/14121/statm: 91569 91107 193 380 0 91186 0
[pid=14122] ppid=14119 vsize=1256 CPUtime=0
/proc/14122/stat : 14122 (pbout) S 14119 14117 13885 0 -1 4194304 131 0 0 0 0 0 0 0 16 0 1 0 157159173 1286144 108 1992294400 134512640 135606965 4294956320 18446744073709551615 135107374 0 0 4096 16386 18446744071563648864 0 0 17 1 0 0
/proc/14122/statm: 314 108 96 267 0 44 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 385156

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14117 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=402938
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=15997
# CPU time returned by wait4() is 0.418935
# while last known CPU time is 1800.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.53
CPU time (s): 1800.03
CPU user time (s): 1799.56
CPU system time (s): 0.47
CPU usage (%): 99.9724
Max. virtual memory (cumulated for all children) (KiB): 385156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.402938
system time used= 0.015997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1446
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 52
involuntary context switches= 14

runsolver used 1.51977 second user time and 5.04123 second system time

The end

Launcher Data 

Begin job on node21 at 2009-06-13 14:19:52
IDJOB=1858816
IDBENCH=2259
IDSOLVER=687
FILE ID=node21/1858816-1244895592
PBS_JOBID= 9354464
Free space on /tmp= 66124 MiB

SOLVER NAME= pbclasp 2009-04-24
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/~kexu/benchmarks/frb53-24-opb/normalized-frb53-24-1.opb
COMMAND LINE= perl HOME/pbclasp BENCHNAME HOME TMPDIR
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1858816-1244895592/watcher-1858816-1244895592 -o /tmp/evaluation-result-1858816-1244895592/solver-1858816-1244895592 -C 1800 -W 2000 -M 1800  perl HOME/pbclasp HOME/instance-1858816-1244895592.opb HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 604c6b786f56b09c749bc0d6b7c8f76d
RANDOM SEED=1765659872

node21.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1284712 kB
Buffers:         67956 kB
Cached:         625848 kB
SwapCached:       4216 kB
Active:          40852 kB
Inactive:       660284 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1284712 kB
SwapTotal:     4192956 kB
SwapFree:      4182488 kB
Dirty:            6728 kB
Writeback:           0 kB
Mapped:          13380 kB
Slab:            56052 kB
Committed_AS:   138304 kB
PageTables:       1380 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-1858816-1244895592.opb

Free space on /tmp at the end= 66120 MiB
End job on node21 at 2009-06-13 14:49:54