Trace number 3703559

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)160 1800.02 900.341

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/
manquinho/ttp/normalized-circ8_3.opb
MD5SUMd431323968e1ca4dc95d181076d01437
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark148
Best CPU time to get the best result obtained on this benchmark1800.05
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 154
Optimality of the best value was proved NO
Number of variables1344
Total number of constraints16096
Number of constraints which are clauses8208
Number of constraints which are cardinality constraints (but not clauses)496
Number of constraints which are nor clauses,nor cardinality constraints7392
Minimum length of a constraint2
Maximum length of a constraint28
Number of terms in the objective function 448
Biggest coefficient in the objective function 4
Number of bits for the biggest coefficient in the objective function 3
Sum of the numbers in the objective function 1024
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 24
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 1024
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703559-1338088983.opb.
0.00/0.00	c Instance file HOME/instance-3703559-1338088983.opb
0.00/0.00	c File size is 912900 bytes.
0.01/0.08	c Cost Offset: 0
0.01/0.08	c Highest Coefficient sum: 60
0.01/0.08	c ============================[ Problem Statistics ]=============================
0.01/0.08	c |                                                                             |
0.01/0.08	c |  Parsing time:          0.08         s                                      |
0.01/0.08	c |  Number Variables:      1344                                                |
0.01/0.08	c |  Number Clauses:        8488                                                |
0.01/0.08	c |  Number Cardinality:    496                                                 |
0.01/0.08	c |  Number PB Constraints: 7392                                                |
0.01/0.08	c |                                                                             |
0.01/0.08	c |  Problem Type:          Optimization                                        |
0.01/0.08	c |  Objective Function:    Cardinality Constraint                              |
0.01/0.08	c |                                                                             |
0.01/0.08	c ===============================================================================
1800.02/900.31	o 206
1800.02/900.31	o 204
1800.02/900.31	o 202
1800.02/900.31	o 194
1800.02/900.31	o 192
1800.02/900.31	o 186
1800.02/900.31	o 180
1800.02/900.31	o 178
1800.02/900.31	o 174
1800.02/900.31	o 172
1800.02/900.31	o 170
1800.02/900.31	o 168
1800.02/900.31	o 164
1800.02/900.31	o 160
1800.02/900.31	c ===============================================================================
1800.02/900.31	c Wall Clock Time: 900.31 s
1800.02/900.31	c Best Solution: 160
1800.02/900.31	s SATISFIABLE
1800.02/900.31	v x897 x898 -x899 -x900 x901 x902 -x903 x904 -x905 -x906 -x907 -x908 -x909 -x910 -x911 -x912 x913 -x914 -x915 -x916 -x917 -x918 -x919 -x920 x921 -x922 -x923 -x924 x925 -x926 -x927 -x928 -x929 -x930 -x931 -x932 -x933 -x934 -x935 -x936 -x937 x938 x939 -x940 -x941 -x942 -x943 -x944 -x945 x946 -x947 -x948 -x949 -x950 -x951 -x952 x953 -x954 -x955 -x956 -x957 -x958 -x959 -x960 x961 x962 x963 -x964 -x965 x966 -x967 x968 -x969 -x970 -x971 -x972 -x973 -x974 -x975 -x976 -x977 -x978 x979 -x980 -x981 -x982 -x983 -x984 x985 -x986 -x987 -x988 x989 -x990 -x991 -x992 -x993 -x994 x995 -x996 -x997 -x998 -x999 -x1000 -x1001 -x1002 x1003 -x1004 -x1005 -x1006 -x1007 -x1008 x1009 -x1010 -x1011 -x1012 -x1013 -x1014 -x1015 -x1016 x1017 -x1018 -x1019 -x1020 -x1021 -x1022 -x1023 -x1024 x1025 -x1026 x1027 -x1028 x1029 -x1030 -x1031 x1032 -x1033 -x1034 -x1035 -x1036 -x1037 -x1038 x1039 -x1040 -x1041 -x1042 -x1043 -x1044 -x1045 -x1046 -x1047 -x1048 x1049 -x1050 -x1051 -x1052 -x1053 -x1054 x1055 -x1056 -x1057 x1058 -x1059 -x1060 -x1061 -x1062 -x1063 -x1064 -x1065 x1066 -x1067 -x1068 -x1069 -x1070 -x1071 -x1072 -x1073 x1074 -x1075 -x1076 -x1077 -x1078 -x1079 -x1080 x1081 -x1082 -x1083 -x1084 -x1085 -x1086 -x1087 -x1088 x1089 x1090 x1091 x1092 -x1093 -x1094 -x1095 x1096 -x1097 -x1098 -x1099 x1100 -x1101 -x1102 -x1103 -x1104 -x1105 -x1106 -x1107 -x1108 -x1109 x1110 -x1111 -x1112 -x1113 -x1114 x1115 -x1116 -x1117 -x1118 -x1119 -x1120 -x1121 x1122 -x1123 -x1124 -x1125 -x1126 -x1127 -x1128 -x1129 -x1130 x1131 -x1132 -x1133 -x1134 -x1135 -x1136 x1137 -x1138 -x1139 -x1140 -x1141 -x1142 -x1143 -x1144 x1145 -x1146 -x1147 -x1148 x1149 -x1150 -x1151 -x1152 x1153 x1154 -x1155 -x1156 -x1157 -x1158 -x1159 x1160 -x1161 -x1162 -x1163 -x1164 -x1165 -x1166 -x1167 -x1168 x1169 -x1170 x1171 -x1172 -x1173 -x1174 -x1175 -x1176 -x1177 -x1178 x1179 -x1180 -x1181 -x1182 -x1183 -x1184 x1185 -x1186 -x1187 -x1188 -x1189 -x1190 -x1191 -x1192 -x1193 -x1194 x1195 -x1196 -x1197 -x1198 -x1199 -x1200 -x1201 x1202 -x1203 -x1204 -x1205 -x1206 -x1207 -x1208 x1209 -x1210 -x1211 x1212 x1213 -x1214 -x1215 x1216 x1217 x1218 -x1219 -x1220 -x1221 -x1222 -x1223 x1224 -x1225 -x1226 -x1227 -x1228 -x1229 -x1230 x1231 -x1232 -x1233 x1234 -x1235 -x1236 -x1237 -x1238 -x1239 -x1240 -x1241 -x1242 -x1243 -x1244 x1245 -x1246 -x1247 x1248 -x1249 -x1250 -x1251 -x1252 -x1253 -x1254 -x1255 -x1256 x1257 -x1258 -x1259 -x1260 -x1261 -x1262 -x1263 -x1264 -x1265 x1266 -x1267 -x1268 -x1269 -x1270 x1271 -x1272 -x1273 -x1274 x1275 -x1276 -x1277 -x1278 -x1279 x1280 x1281 -x1282 -x1283 -x1284 -x1285 -x1286 -x1287 x1288 x1289 -x1290 -x1291 -x1292 -x1293 -x1294 -x1295 -x1296 x1297 -x1298 -x1299 -x1300 -x1301 -x1302 -x1303 -x1304 -x1305 -x1306 -x1307 -x1308 x1309 -x1310 -x1311 -x1312 -x1313 -x1314 -x1315 x1316 -x1317 -x1318 -x1319 -x1320 -x1321 -x1322 x1323 -x1324 -x1325 -x1326 -x1327 x1328 -x1329 -x1330 -x1331 -x1332 -x1333 x1334 -x1335 -x1336 -x1337 x1338 -x1339 -x1340 -x1341 -x1342 x1343 x1344 x2 -x66 -x130 -x194 -x258 -x322 -x386 -x450 -x514 -x578 -x642 -x706 -x770 -x834 -x3 -x67 -x131 -x195 -x259 -x323 -x387 -x451 -x515 -x579 -x643 x707 -x771 -x835 -x4 -x68 -x132 -x196 -x260 -x324 -x388 -x452 -x516 -x580 -x644 -x708 x772 -x836 -x5 -x69 -x133 -x197 -x261 -x325 -x389 -x453 -x517 -x581 -x645 -x709 -x773 x837 -x6 -x70 -x134 -x198 -x262 -x326 -x390 x454 -x518 -x582 -x646 -x710 -x774 -x838 -x7 -x71 -x135 -x199 x263 -x327 -x391 -x455 -x519 -x583 -x647 -x711 -x775 -x839 -x8 -x72 -x136 -x200 -x264 -x328 -x392 -x456 x520 -x584 -x648 -x712 -x776 -x840 -x9 -x73 -x137 -x201 -x265 -x329 -x393 -x457 -x521 x585 -x649 -x713 -x777 -x841 -x11 x75 -x139 -x203 -x267 -x331 -x395 -x459 -x523 -x587 -x651 -x715 -x779 -x843 -x12 -x76 -x140 -x204 -x268 -x332 -x396 x460 -x524 -x588 -x652 -x716 -x780 -x844 -x13 -x77 -x141 -x205 x269 -x333 -x397 -x461 -x525 -x589 -x653 -x717 -x781 -x845 -x14 -x78 -x142 -x206 -x270 x334 -x398 -x462 -x526 -x590 -x654 -x718 -x782 -x846 -x15 -x79 -x143 -x207 -x271 -x335 -x399 -x463 x527 -x591 -x655 -x719 -x783 -x847 -x16 -x80 -x144 -x208 -x272 -x336 -x400 -x464 -x528 -x592 -x656 -x720 -x784 x848 -x17 -x81 -x145 -x209 -x273 x337 -x401 -x465 -x529 -x593 -x657 -x721 -x785 -x849 -x18 -x82 -x146 -x210 -x274 -x338 x402 -x466 -x530 -x594 -x658 -x722 -x786 -x850 x20 -x84 -x148 -x212 -x276 -x340 -x404 -x468 -x532 -x596 -x660 -x724 -x788 -x852 -x21 -x85 -x149 -x213 -x277 -x341 -x405 -x469 -x533 -x597 x661 -x725 -x789 -x853 -x22 -x86 -x150 -x214 -x278 -x342 -x406 -x470 x534 -x598 -x662 -x726 -x790 -x854 -x23 -x87 -x151 -x215 -x279 -x343 -x407 -x471 -x535 x599 -x663 -x727 -x791 -x855 -x24 -x88 -x152 -x216 x280 -x344 -x408 -x472 -x536 -x600 -x664 -x728 -x792 -x856 -x25 -x89 x153 -x217 -x281 -x345 -x409 -x473 -x537 -x601 -x665 -x729 -x793 -x857 -x26 -x90 -x154 -x218 -x282 -x346 -x410 -x474 -x538 -x602 x666 -x730 -x794 -x858 -x27 -x91 -x155 x219 -x283 -x347 -x411 -x475 -x539 -x603 -x667 -x731 -x795 -x859 -x29 -x93 -x157 -x221 -x285 x349 -x413 -x477 -x541 -x605 -x669 -x733 -x797 -x861 -x30 x94 -x158 -x222 -x286 -x350 -x414 -x478 -x542 -x606 -x670 -x734 -x798 -x862 -x31 -x95 -x159 -x223 -x287 -x351 -x415 -x479 -x543 -x607 -x671 -x735 -x799 x863 -x32 -x96 -x160 -x224 -x288 -x352 -x416 -x480 -x544 x608 -x672 -x736 -x800 -x864 -x33 -x97 -x161 -x225 -x289 -x353 x417 -x481 -x545 -x609 -x673 -x737 -x801 -x865 -x34 -x98 x162 -x226 -x290 -x354 -x418 -x482 -x546 -x610 -x674 -x738 -x802 -x866 -x35 -x99 -x163 -x227 -x291 -x355 -x419 x483 -x547 -x611 -x675 -x739 -x803 -x867 -x36 -x100 -x164 -x228 -x292 -x356 -x420 -x484 x548 -x612 -x676 -x740 -x804 -x868 -x38 -x102 -x166 -x230 -x294 -x358 -x422 -x486 -x550 -x614 -x678 x742 -x806 -x870 x39 -x103 -x167 -x231 -x295 -x359 -x423 -x487 -x551 -x615 -x679 -x743 -x807 -x871 -x40 x104 -x168 -x232 -x296 -x360 -x424 -x488 -x552 -x616 -x680 -x744 -x808 -x872 -x41 -x105 -x169 x233 -x297 -x361 -x425 -x489 -x553 -x617 -x681 -x745 -x809 -x873 -x42 -x106 -x170 -x234 -x298 -x362 -x426 -x490 -x554 -x618 -x682 -x746 x810 -x874 -x43 -x107 -x171 -x235 -x299 -x363 -x427 -x491 -x555 -x619 -x683 -x747 -x811 x875 -x44 -x108 -x172 -x236 x300 -x364 -x428 -x492 -x556 -x620 -x684 -x748 -x812 -x876 -x45 -x109 -x173 -x237 -x301 -x365 -x429 -x493 -x557 x621 -x685 -x749 -x813 -x877 -x47 -x111 -x175 -x239 -x303 -x367 x431 -x495 -x559 -x623 -x687 -x751 -x815 -x879 x48 -x112 -x176 -x240 -x304 -x368 -x432 -x496 -x560 -x624 -x688 -x752 -x816 -x880 -x49 x113 -x177 -x241 -x305 -x369 -x433 -x497 -x561 -x625 -x689 -x753 -x817 -x881 -x50 -x114 -x178 x242 -x306 -x370 -x434 -x498 -x562 -x626 -x690 -x754 -x818 -x882 -x51 -x115 x179 -x243 -x307 -x371 -x435 -x499 -x563 -x627 -x691 -x755 -x819 -x883 -x52 -x116 -x180 -x244 -x308 -x372 -x436 -x500 -x564 -x628 -x692 x756 -x820 -x884 -x53 -x117 -x181 -x245 -x309 -x373 -x437 -x501 -x565 -x629 -x693 -x757 x821 -x885 -x54 -x118 -x182 -x246 -x310 -x374 -x438 -x502 -x566 -x630 x694 -x758 -x822 -x886 -x56 -x120 -x184 -x248 -x312 -x376 -x440 x504 -x568 -x632 -x696 -x760 -x824 -x888 -x57 -x121 -x185 -x249 -x313 -x377 -x441 -x505 -x569 -x633 x697 -x761 -x825 -x889 -x58 -x122 -x186 -x250 -x314 -x378 -x442 -x506 -x570 -x634 -x698 x762 -x826 -x890 -x59 -x123 -x187 -x251 -x315 -x379 -x443 -x507 -x571 -x635 -x699 -x763 x827 -x891 -x60 -x124 -x188 -x252 -x316 -x380 x444 -x508 -x572 -x636 -x700 -x764 -x828 -x892 -x61 -x125 -x189 x253 -x317 -x381 -x445 -x509 -x573 -x637 -x701 -x765 -x829 -x893 -x62 -x126 x190 -x254 -x318 -x382 -x446 -x510 -x574 -x638 -x702 -x766 -x830 -x894 -x63 -x127 -x191 -x255 -x319 x383 -x447 -x511 -x575 -x639 -x703 -x767 -x831 -x895 x10 -x74 x138 x202 -x266 -x330 x394 -x458 -x522 -x586 x650 x714 x778 -x842 -x19 x83 x147 x211 -x275 -x339 -x403 x467 -x531 -x595 -x659 x723 x787 x851 x28 -x92 -x156 -x220 x284 -x348 x412 x476 x540 -x604 -x668 x732 x796 -x860 -x37 -x101 -x165 x229 x293 x357 -x421 -x485 -x549 x613 x677 -x741 x805 x869 -x46 x110 x174 -x238 -x302 x366 -x430 x494 x558 -x622 x686 x750 -x814 -x878 x55 -x119 -x183 -x247 x311 x375 x439 -x503 x567 x631 -x695 -x759 -x823 x887 x64 x128 -x192 -x256 x320 -x384 -x448 x512 x576 x640 -x704 -x768 -x832 x896 -x1 x65 x129 x193 -x257 x321 x385 -x449 -x513 x577 x641 -x705 -x769 -x833

Verifier Data 

OK	160

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703559-1338088983/watcher-3703559-1338088983 -o /tmp/evaluation-result-3703559-1338088983/solver-3703559-1338088983 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703559-1338088983.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 3.95 3.64 2/171 18359
/proc/meminfo: memFree=31343036/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=5688 CPUtime=0 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) R 18357 18359 18125 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 275022903 5824512 476 33554432000 4194304 5965102 140734497120960 140733322010184 5137146 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 1422 476 169 433 0 763 0

[startup+0.016303 s]
/proc/loadavg: 3.84 3.95 3.64 2/171 18359
/proc/meminfo: memFree=31343036/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=6516 CPUtime=0.01 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) R 18357 18359 18125 0 -1 4202496 771 0 0 0 1 0 0 0 20 0 1 0 275022903 6672384 723 33554432000 4194304 5965102 140734497120960 140733322010184 5137146 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 1629 723 202 433 0 970 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 6516

[startup+0.100153 s]
/proc/loadavg: 3.84 3.95 3.64 2/171 18359
/proc/meminfo: memFree=31343036/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=172876 CPUtime=0.1 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 4451 0 0 0 9 1 0 0 20 0 3 0 275022903 177025024 4146 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 43219 4146 198 433 0 42783 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 172876

[startup+0.300166 s]
/proc/loadavg: 3.84 3.95 3.64 2/171 18359
/proc/meminfo: memFree=31343036/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181012 CPUtime=0.5 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 10206 0 0 0 47 3 0 0 20 0 3 0 275022903 185356288 9868 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45253 9868 209 433 0 44817 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 181012

[startup+0.700165 s]
/proc/loadavg: 3.84 3.95 3.64 2/171 18359
/proc/meminfo: memFree=31343036/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181012 CPUtime=1.3 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 13895 0 0 0 126 4 0 0 20 0 3 0 275022903 185356288 13557 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45253 13557 209 433 0 44817 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 181012

[startup+1.50029 s]
/proc/loadavg: 3.85 3.95 3.64 5/181 18376
/proc/meminfo: memFree=31254644/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181012 CPUtime=2.89 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 18754 0 0 0 284 5 0 0 20 0 3 0 275022903 185356288 18416 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45253 18416 209 433 0 44817 0
[pid=18359/tid=18373] ppid=18357 vsize=181012 CPUtime=1.4 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 11240 0 0 0 136 4 0 0 20 0 3 0 275022911 185356288 18416 33554432000 4194304 5965102 140734497120960 140294751476168 5131650 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=181012 CPUtime=1.4 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 3975 0 0 0 139 1 0 0 20 0 3 0 275022911 185356288 18417 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.89
Current children cumulated vsize (KiB) 181012

[startup+3.10028 s]
/proc/loadavg: 3.85 3.95 3.64 5/181 18376
/proc/meminfo: memFree=31232324/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181012 CPUtime=6.1 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 20893 0 0 0 604 6 0 0 20 0 3 0 275022903 185356288 20555 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45253 20555 209 433 0 44817 0
[pid=18359/tid=18373] ppid=18357 vsize=181012 CPUtime=2.99 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 12632 0 0 0 295 4 0 0 20 0 3 0 275022911 185356288 20555 33554432000 4194304 5965102 140734497120960 140294751475752 4404407 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=181012 CPUtime=3 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 4722 0 0 0 298 2 0 0 20 0 3 0 275022911 185356288 20555 33554432000 4194304 5965102 140734497120960 140294740986168 4400902 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.1
Current children cumulated vsize (KiB) 181012

[startup+6.30035 s]
/proc/loadavg: 3.85 3.95 3.64 5/181 18376
/proc/meminfo: memFree=31207524/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181012 CPUtime=12.49 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 23966 0 0 0 1242 7 0 0 20 0 3 0 275022903 185356288 23586 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45253 23586 209 433 0 44817 0
[pid=18359/tid=18373] ppid=18357 vsize=181012 CPUtime=6.18 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 14194 0 0 0 614 4 0 0 20 0 3 0 275022911 185356288 23586 33554432000 4194304 5965102 140734497120960 140294751476248 4401015 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=181012 CPUtime=6.18 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 6233 0 0 0 616 2 0 0 20 0 3 0 275022911 185356288 23586 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.49
Current children cumulated vsize (KiB) 181012

[startup+12.7004 s]
/proc/loadavg: 3.95 3.97 3.65 5/181 18376
/proc/meminfo: memFree=31173952/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=181796 CPUtime=25.28 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 29027 0 0 0 2518 10 0 0 20 0 3 0 275022903 186159104 28822 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 45449 28822 209 433 0 45013 0
[pid=18359/tid=18373] ppid=18357 vsize=181796 CPUtime=12.56 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 16546 0 0 0 1251 5 0 0 20 0 3 0 275022911 186159104 28822 33554432000 4194304 5965102 140734497120960 140294751475752 4401026 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=181796 CPUtime=12.56 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 8942 0 0 0 1252 4 0 0 20 0 3 0 275022911 186159104 28822 33554432000 4194304 5965102 140734497120960 140294740986168 4404735 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 181796

[startup+25.5003 s]
/proc/loadavg: 3.96 3.97 3.66 5/181 18376
/proc/meminfo: memFree=31134388/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=247700 CPUtime=50.88 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 33744 0 0 0 5074 14 0 0 20 0 3 0 275022903 253644800 33427 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 61925 33427 209 433 0 61489 0
[pid=18359/tid=18373] ppid=18357 vsize=247700 CPUtime=25.32 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 18125 0 0 0 2526 6 0 0 20 0 3 0 275022911 253644800 33427 33554432000 4194304 5965102 140734497120960 140294751475640 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=247700 CPUtime=25.33 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 12080 0 0 0 2527 6 0 0 20 0 3 0 275022911 253644800 33427 33554432000 4194304 5965102 140734497120960 140294740986040 4401107 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.88
Current children cumulated vsize (KiB) 247700

[startup+51.1003 s]
/proc/loadavg: 3.97 3.97 3.66 5/181 18376
/proc/meminfo: memFree=31079284/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=248620 CPUtime=102.05 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 42510 0 0 0 10185 20 0 0 20 0 3 0 275022903 254586880 41946 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 62155 41946 209 433 0 61719 0
[pid=18359/tid=18373] ppid=18357 vsize=248620 CPUtime=50.84 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 21486 0 0 0 5075 9 0 0 20 0 3 0 275022911 254586880 41946 33554432000 4194304 5965102 140734497120960 140294751475616 4401064 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=248620 CPUtime=50.86 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 17485 0 0 0 5077 9 0 0 20 0 3 0 275022911 254586880 41946 33554432000 4194304 5965102 140734497120960 140294740986272 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.05
Current children cumulated vsize (KiB) 248620

[startup+102.306 s]
/proc/loadavg: 3.99 3.97 3.68 5/181 18376
/proc/meminfo: memFree=30964024/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=316932 CPUtime=204.43 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 61844 0 0 0 20408 35 0 0 20 0 3 0 275022903 324538368 62564 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 79233 62564 209 433 0 78797 0
[pid=18359/tid=18373] ppid=18357 vsize=316932 CPUtime=101.91 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 29411 0 0 0 10175 16 0 0 20 0 3 0 275022911 324538368 62564 33554432000 4194304 5965102 140734497120960 140294751475512 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=316932 CPUtime=101.91 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 28894 0 0 0 10172 19 0 0 20 0 3 0 275022911 324538368 62564 33554432000 4194304 5965102 140734497120960 140294740986168 4400981 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.43
Current children cumulated vsize (KiB) 316932

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.70 5/181 18376
/proc/meminfo: memFree=30853384/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=448136 CPUtime=324.4 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 83089 0 0 0 32391 49 0 0 20 0 3 0 275022903 458891264 83608 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 112034 83608 209 433 0 111598 0
[pid=18359/tid=18373] ppid=18357 vsize=448136 CPUtime=161.75 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 37358 0 0 0 16154 21 0 0 20 0 3 0 275022911 458891264 83608 33554432000 4194304 5965102 140734497120960 140294751476248 4390210 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=448136 CPUtime=161.74 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 42192 0 0 0 16143 31 0 0 20 0 3 0 275022911 458891264 83608 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.4
Current children cumulated vsize (KiB) 448136

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.71 5/181 18376
/proc/meminfo: memFree=30804708/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=449228 CPUtime=444.37 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 83382 0 0 0 44388 49 0 0 20 0 3 0 275022903 460009472 83925 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 112307 83925 209 433 0 111871 0
[pid=18359/tid=18373] ppid=18357 vsize=449228 CPUtime=221.6 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 37391 0 0 0 22138 22 0 0 20 0 3 0 275022911 460009472 83925 33554432000 4194304 5965102 140734497120960 140294751475616 4401050 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=449228 CPUtime=221.57 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 42452 0 0 0 22125 32 0 0 20 0 3 0 275022911 460009472 83925 33554432000 4194304 5965102 140734497120960 140294740985928 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.37
Current children cumulated vsize (KiB) 449228

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.73 5/181 18377
/proc/meminfo: memFree=30722096/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=516016 CPUtime=564.33 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 97961 0 0 0 56352 81 0 0 20 0 3 0 275022903 528400384 98462 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 129004 98462 209 433 0 128568 0
[pid=18359/tid=18373] ppid=18357 vsize=516016 CPUtime=281.42 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 37565 0 0 0 28119 23 0 0 20 0 3 0 275022911 528400384 98462 33554432000 4194304 5965102 140734497120960 140294751476248 4374493 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=516016 CPUtime=281.4 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 56857 0 0 0 28075 65 0 0 20 0 3 0 275022911 528400384 98462 33554432000 4194304 5965102 140734497120960 140294740986168 4401582 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.33
Current children cumulated vsize (KiB) 516016

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.74 5/181 18377
/proc/meminfo: memFree=30619452/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=581696 CPUtime=684.3 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 121595 0 0 0 68313 117 0 0 20 0 3 0 275022903 595656704 122082 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 145424 122082 209 433 0 144988 0

################
# More data... #
################

[pid=18359/tid=18374] ppid=18357 vsize=581696 CPUtime=341.23 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 63770 0 0 0 34044 79 0 0 20 0 3 0 275022911 595656704 122082 33554432000 4194304 5965102 140734497120960 140294740985976 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.3
Current children cumulated vsize (KiB) 581696

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.75 5/181 18377
/proc/meminfo: memFree=30553976/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=584008 CPUtime=804.28 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 132748 0 0 0 80293 135 0 0 20 0 3 0 275022903 598024192 133235 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 146002 133235 209 433 0 145566 0
[pid=18359/tid=18373] ppid=18357 vsize=584008 CPUtime=401.11 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 65280 0 0 0 40045 66 0 0 20 0 3 0 275022911 598024192 133235 33554432000 4194304 5965102 140734497120960 140294751475704 4401114 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=584008 CPUtime=401.07 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 63929 0 0 0 40027 80 0 0 20 0 3 0 275022911 598024192 133235 33554432000 4194304 5965102 140734497120960 140294740985928 4400894 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.28
Current children cumulated vsize (KiB) 584008

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.77 5/182 18380
/proc/meminfo: memFree=30503244/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=649956 CPUtime=924.26 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 137275 0 0 0 92280 146 0 0 20 0 3 0 275022903 665554944 137761 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 162489 137761 209 433 0 162053 0
[pid=18359/tid=18373] ppid=18357 vsize=649956 CPUtime=460.95 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 69411 0 0 0 46019 76 0 0 20 0 3 0 275022911 665554944 137761 33554432000 4194304 5965102 140734497120960 140294751475512 4400972 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=649956 CPUtime=460.92 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 64325 0 0 0 46011 81 0 0 20 0 3 0 275022911 665554944 137761 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.26
Current children cumulated vsize (KiB) 649956

[startup+522.3 s]
/proc/loadavg: 3.99 3.97 3.78 5/181 18380
/proc/meminfo: memFree=30423400/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=716524 CPUtime=1044.24 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 152548 0 0 0 104242 182 0 0 20 0 3 0 275022903 733720576 153034 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 179131 153035 209 433 0 178695 0
[pid=18359/tid=18373] ppid=18357 vsize=716524 CPUtime=520.8 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 72947 0 0 0 51994 86 0 0 20 0 3 0 275022911 733720576 153035 33554432000 4194304 5965102 140734497120960 140294751475512 4389664 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=716524 CPUtime=520.76 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 76063 0 0 0 51968 108 0 0 20 0 3 0 275022911 733720576 153035 33554432000 4194304 5965102 140734497120960 140294740986168 4410742 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.24
Current children cumulated vsize (KiB) 716524

[startup+582.3 s]
/proc/loadavg: 3.99 3.97 3.79 5/181 18381
/proc/meminfo: memFree=30311416/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=849112 CPUtime=1164.22 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 176153 0 0 0 116197 225 0 0 20 0 3 0 275022903 869490688 176822 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 212278 176822 209 433 0 211842 0
[pid=18359/tid=18373] ppid=18357 vsize=849112 CPUtime=580.65 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 82997 0 0 0 57958 107 0 0 20 0 3 0 275022911 869490688 176822 33554432000 4194304 5965102 140734497120960 140294751475512 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=849112 CPUtime=580.6 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 89617 0 0 0 57927 133 0 0 20 0 3 0 275022911 869490688 176822 33554432000 4194304 5965102 140734497120960 140294740986168 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.22
Current children cumulated vsize (KiB) 849112

[startup+642.3 s]
/proc/loadavg: 3.99 3.97 3.80 5/181 18381
/proc/meminfo: memFree=30240516/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=850344 CPUtime=1284.17 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 191764 0 0 0 128170 247 0 0 20 0 3 0 275022903 870752256 192713 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 212586 192713 209 433 0 212150 0
[pid=18359/tid=18373] ppid=18357 vsize=850344 CPUtime=640.47 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 86992 0 0 0 63934 113 0 0 20 0 3 0 275022911 870752256 192713 33554432000 4194304 5965102 140734497120960 140294751475512 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=850344 CPUtime=640.43 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 101233 0 0 0 63892 151 0 0 20 0 3 0 275022911 870752256 192713 33554432000 4194304 5965102 140734497120960 140294740986168 4401050 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.17
Current children cumulated vsize (KiB) 850344

[startup+702.3 s]
/proc/loadavg: 3.99 3.97 3.81 5/181 18381
/proc/meminfo: memFree=30167880/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=916668 CPUtime=1404.11 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 209762 0 0 0 140127 284 0 0 20 0 3 0 275022903 938668032 210730 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 229167 210730 209 433 0 228731 0
[pid=18359/tid=18373] ppid=18357 vsize=916668 CPUtime=700.31 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 94081 0 0 0 69901 130 0 0 20 0 3 0 275022911 938668032 210730 33554432000 4194304 5965102 140734497120960 140294751475720 4401155 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=916668 CPUtime=700.22 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 112142 0 0 0 69850 172 0 0 20 0 3 0 275022911 938668032 210730 33554432000 4194304 5965102 140734497120960 140294740986168 4404383 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.11
Current children cumulated vsize (KiB) 916668

[startup+762.307 s]
/proc/loadavg: 3.99 3.97 3.82 5/182 18382
/proc/meminfo: memFree=30102816/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=983064 CPUtime=1524.09 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 225486 0 0 0 152098 311 0 0 20 0 3 0 275022903 1006657536 226504 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 245766 226504 209 433 0 245330 0
[pid=18359/tid=18373] ppid=18357 vsize=983064 CPUtime=760.14 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 96926 0 0 0 75874 140 0 0 20 0 3 0 275022911 1006657536 226504 33554432000 4194304 5965102 140734497120960 140294751475512 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=983064 CPUtime=760.06 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 125021 0 0 0 75814 192 0 0 20 0 3 0 275022911 1006657536 226504 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.09
Current children cumulated vsize (KiB) 983064

[startup+822.3 s]
/proc/loadavg: 4.03 3.99 3.83 5/181 18382
/proc/meminfo: memFree=30025252/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=1116104 CPUtime=1644.03 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 242757 0 0 0 164051 352 0 0 20 0 3 0 275022903 1142890496 243773 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 279026 243773 209 433 0 278590 0
[pid=18359/tid=18373] ppid=18357 vsize=1116104 CPUtime=819.96 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 102730 0 0 0 81836 160 0 0 20 0 3 0 275022911 1142890496 243773 33554432000 4194304 5965102 140734497120960 140294751475512 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=1116104 CPUtime=819.88 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 136488 0 0 0 81773 215 0 0 20 0 3 0 275022911 1142890496 243773 33554432000 4194304 5965102 140734497120960 140294740986168 4400986 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.03
Current children cumulated vsize (KiB) 1116104

[startup+882.3 s]
/proc/loadavg: 4.01 3.99 3.84 5/181 18383
/proc/meminfo: memFree=29944700/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=1116536 CPUtime=1764.01 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 260951 0 0 0 176023 378 0 0 20 0 3 0 275022903 1143332864 261961 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 279134 261961 209 433 0 278698 0
[pid=18359/tid=18373] ppid=18357 vsize=1116536 CPUtime=879.8 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 109023 0 0 0 87811 169 0 0 20 0 3 0 275022911 1143332864 261961 33554432000 4194304 5965102 140734497120960 140294751475752 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=1116536 CPUtime=879.72 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 148389 0 0 0 87739 233 0 0 20 0 3 0 275022911 1143332864 261961 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.01
Current children cumulated vsize (KiB) 1116536



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.01 3.99 3.84 5/181 18383
/proc/meminfo: memFree=29917048/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=1116536 CPUtime=1800.02 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 266470 0 0 0 179616 386 0 0 20 0 3 0 275022903 1143332864 267480 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 279134 267480 209 433 0 278698 0
[pid=18359/tid=18373] ppid=18357 vsize=1116536 CPUtime=897.76 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 110977 0 0 0 89603 173 0 0 20 0 3 0 275022911 1143332864 267480 33554432000 4194304 5965102 140734497120960 140294751475704 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=1116536 CPUtime=897.68 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 151954 0 0 0 89531 237 0 0 20 0 3 0 275022911 1143332864 267480 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1116536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.01 3.99 3.84 5/181 18383
/proc/meminfo: memFree=29917048/32873844 swapFree=6080/6080
[pid=18359] ppid=18357 vsize=1116536 CPUtime=1800.02 cores=0,2,4,6
/proc/18359/stat : 18359 (pwbo2.0) S 18357 18359 18125 0 -1 4202496 266470 0 0 0 179616 386 0 0 20 0 3 0 275022903 1143332864 267480 33554432000 4194304 5965102 140734497120960 140734497120480 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18359/statm: 279134 267480 209 433 0 278698 0
[pid=18359/tid=18373] ppid=18357 vsize=1116536 CPUtime=897.76 cores=0,2,4,6
/proc/18359/task/18373/stat : 18373 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 110977 0 0 0 89603 173 0 0 20 0 3 0 275022911 1143332864 267480 33554432000 4194304 5965102 140734497120960 140294751475704 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=18359/tid=18374] ppid=18357 vsize=1116536 CPUtime=897.68 cores=0,2,4,6
/proc/18359/task/18374/stat : 18374 (pwbo2.0) R 18357 18359 18125 0 -1 4202560 151954 0 0 0 89531 237 0 0 20 0 3 0 275022911 1143332864 267480 33554432000 4194304 5965102 140734497120960 140294740986168 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1116536

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18359 and gives
#  childrusage.ru_utime.tv_sec=1791
#  childrusage.ru_utime.tv_usec=440659
#  childrusage.ru_stime.tv_sec=4
#  childrusage.ru_stime.tv_usec=157367
# CPU time returned by wait4() is 1795.6
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.341
CPU time (s): 1800.02
CPU user time (s): 1796.16
CPU system time (s): 3.86
CPU usage (%): 199.927
Max. virtual memory (cumulated for all children) (KiB): 1116536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1791.44
system time used= 4.15737
maximum resident set size= 1069928
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 266472
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 889
involuntary context switches= 1935

runsolver used 1.84172 second user time and 4.87326 second system time

The end

Launcher Data 

Begin job on node139 at 2012-05-27 05:23:03
IDJOB=3703559
IDBENCH=2006
IDSOLVER=2279
FILE ID=node139/3703559-1338088983
RUNJOBID= node139-1338087173-18141
PBS_JOBID= 14624436
Free space on /tmp= 71660 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/ttp/normalized-circ8_3.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703559-1338088983/watcher-3703559-1338088983 -o /tmp/evaluation-result-3703559-1338088983/solver-3703559-1338088983 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703559-1338088983.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d431323968e1ca4dc95d181076d01437
RANDOM SEED=2030201805

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31343680 kB
Buffers:          293940 kB
Cached:           398672 kB
SwapCached:          284 kB
Active:           585704 kB
Inactive:         116612 kB
Active(anon):       3684 kB
Inactive(anon):     8052 kB
Active(file):     582020 kB
Inactive(file):   108560 kB
Unevictable:        6080 kB
Mlocked:            6080 kB
SwapTotal:      67108856 kB
SwapFree:       67106400 kB
Dirty:              6476 kB
Writeback:             0 kB
AnonPages:         15332 kB
Mapped:            11216 kB
Shmem:                 8 kB
Slab:             688540 kB
SReclaimable:     130636 kB
SUnreclaim:       557904 kB
KernelStack:        1432 kB
PageTables:         3960 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     103120 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71648 MiB
End job on node139 at 2012-05-27 05:38:06