Trace number 3725981

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)74 1800.15 900.316

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/golomb-rulers/normalized-OGR_11.opb
MD5SUM5946eb43fefc6e626d35d99afd3eec42
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark72
Best CPU time to get the best result obtained on this benchmark1800.02
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 75
Optimality of the best value was proved NO
Number of variables1287
Total number of constraints2430
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2430
Minimum length of a constraint14
Maximum length of a constraint29
Number of terms in the objective function 7
Biggest coefficient in the objective function 64
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 127
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 128
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 749
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725981-1338655450.opb.
0.00/0.00	c Instance file HOME/instance-3725981-1338655450.opb
0.00/0.00	c File size is 481040 bytes.
0.03/0.04	c Cost Offset: 0
0.03/0.04	c Highest Coefficient sum: 749
0.03/0.04	c ============================[ Problem Statistics ]=============================
0.03/0.04	c |                                                                             |
0.03/0.04	c |  Parsing time:          0.05         s                                      |
0.03/0.04	c |  Number Variables:      1287                                                |
0.03/0.04	c |  Number Clauses:        0                                                   |
0.03/0.04	c |  Number Cardinality:    0                                                   |
0.03/0.04	c |  Number PB Constraints: 2430                                                |
0.03/0.04	c |                                                                             |
0.03/0.05	c |  Problem Type:          Optimization                                        |
0.03/0.05	c |  Objective Function:    Cardinality Constraint                              |
0.03/0.05	c |                                                                             |
0.03/0.05	c ===============================================================================
1800.15/900.31	o 111
1800.15/900.31	o 110
1800.15/900.31	o 104
1800.15/900.31	o 96
1800.15/900.31	o 93
1800.15/900.31	o 91
1800.15/900.31	o 89
1800.15/900.31	o 88
1800.15/900.31	o 86
1800.15/900.31	o 85
1800.15/900.31	o 84
1800.15/900.31	o 82
1800.15/900.31	o 80
1800.15/900.31	o 77
1800.15/900.31	o 74
1800.15/900.31	c ===============================================================================
1800.15/900.31	c Wall Clock Time: 900.31 s
1800.15/900.31	c Best Solution: 74
1800.15/900.31	s SATISFIABLE
1800.15/900.31	v -x1 x2 -x3 x4 -x5 -x6 x7 -x64 x65 -x66 -x67 -x68 -x69 x70 -x71 -x72 -x73 x74 -x75 -x76 x77 -x1287 x57 -x58 -x59 -x60 x61 x62 -x63 -x1286 -x1285 -x1284 -x1283 -x1282 -x50 x51 -x52 -x53 -x54 x55 -x56 -x1281 -x1280 -x1279 -x1278 -x1277 -x1276 -x1275 -x1274 -x1273 -x1272 -x1271 x1270 x1269 x1268 x43 x44 x45 x46 x47 -x48 -x49 -x1267 -x1266 -x1265 -x1264 -x1263 -x1262 -x1261 -x1260 -x1259 x1258 x1257 -x1256 -x1255 -x1254 x1253 x1252 -x1251 x1250 x1249 x1248 -x1247 x1246 x1245 x1244 x1243 x1242 x1241 x1240 x1239 x1238 x36 -x37 x38 -x39 x40 -x41 -x42 -x1237 -x1236 -x1235 -x1234 -x1233 -x1232 -x1231 -x1230 -x1229 -x1228 -x1227 -x1226 -x1225 -x1224 -x1223 -x1222 -x1221 -x1220 -x1219 -x1218 x1217 x1216 x1215 x1214 x1213 x1212 -x1211 -x1210 -x1209 x1208 x1207 x1206 x1205 x1204 x1203 x1202 x1201 x1200 x1199 x1198 -x1197 -x1196 -x1195 x1194 x1193 x1192 x1191 x1190 x1189 x1188 x1187 x1186 x1185 x1184 -x1183 -x29 -x30 x31 x32 -x33 -x34 -x35 -x1182 -x1181 -x1180 -x1179 -x1178 -x1177 -x1176 -x1175 -x1174 -x1173 -x1172 -x1171 -x1170 -x1169 -x1168 -x1167 -x1166 -x1165 -x1164 -x1163 -x1162 -x1161 -x1160 x1159 x1158 -x1157 x1156 x1155 -x1154 x1153 x1152 x1151 -x1150 -x1149 -x1148 x1147 x1146 -x1145 x1144 x1143 x1142 -x1141 x1140 x1139 x1138 -x1137 x1136 x1135 x1134 x1133 -x1132 -x1131 -x1130 x1129 x1128 -x1127 x1126 x1125 x1124 -x1123 x1122 x1121 x1120 -x1119 -x1118 x1117 x1116 x1115 x1114 -x1113 -x1112 -x1111 -x1110 x1109 x1108 x1107 x1106 x1105 x1104 x1103 x1102 x1101 x1100 x1099 -x1098 x1097 x1096 x1095 x1094 x1093 x1092 x22 -x23 x24 -x25 -x26 -x27 -x28 -x1091 -x1090 -x1089 -x1088 -x1087 -x1086 -x1085 -x1084 -x1083 -x1082 -x1081 -x1080 -x1079 -x1078 -x1077 -x1076 -x1075 -x1074 x1073 -x1072 -x1071 -x1070 -x1069 -x1068 -x1067 -x1066 -x1065 -x1064 -x1063 -x1062 -x1061 -x1060 x1059 x1058 x1057 x1056 x1055 x1054 -x1053 -x1052 -x1051 -x1050 -x1049 -x1048 x1047 x1046 x1045 -x1044 x1043 x1042 x1041 -x1040 x1039 x1038 x1037 -x1036 x1035 x1034 x1033 x1032 -x1031 -x1030 -x1029 -x1028 -x1027 -x1026 x1025 x1024 x1023 -x1022 x1021 x1020 x1019 -x1018 -x1017 x1016 x1015 x1014 x1013 -x1012 x1011 x1010 x1009 x1008 -x1007 -x1006 -x1005 -x1004 x1003 x1002 x1001 x1000 x999 x998 -x997 x996 x995 x994 x993 -x992 x991 x990 x989 x988 -x987 -x986 x985 x984 x983 x982 x981 x980 -x979 x978 -x977 x976 x975 x974 x973 x972 x971 x970 x969 x968 x967 x966 -x965 x964 x963 x962 x961 x960 x959 x958 x957 x956 x955 x954 x953 x952 x8 -x9 -x10 -x11 -x12 -x13 -x14 -x951 -x950 -x949 -x948 -x947 -x946 -x945 -x944 -x943 -x942 -x941 -x940 -x939 -x938 -x937 -x936 -x935 -x934 -x933 -x932 -x931 x930 x929 -x928 -x927 -x926 -x925 -x924 -x923 -x922 -x921 -x920 -x919 -x918 -x917 x916 x915 -x914 x913 x912 x911 x910 x909 x908 -x907 -x906 -x905 -x904 -x903 -x902 x901 x900 -x899 -x898 x897 x896 x895 -x894 x893 x892 x891 -x890 x889 x888 x887 x886 x885 x884 x883 x882 -x881 -x880 -x879 -x878 -x877 -x876 x875 x874 x873 -x872 x871 x870 x869 -x868 -x867 x866 x865 x864 -x863 -x862 x861 x860 x859 x858 -x857 x856 x855 x854 x853 -x852 -x851 -x850 -x849 x848 x847 -x846 x845 x844 x843 -x842 x841 x840 x839 -x838 -x837 x836 x835 x834 x833 -x832 -x831 x830 x829 x828 x827 x826 -x825 x824 x823 x822 x821 x820 x819 -x818 -x817 -x816 x815 x814 x813 x812 x811 x810 x809 x808 x807 x806 x805 -x804 x803 x802 x801 x800 x799 -x798 x797 x796 x795 x794 x793 x792 -x791 x790 x789 x788 x787 x786 x785 x784 -x783 x782 x781 x780 x779 x778 x777 x776 x775 x774 x773 x772 x771 x770 -x769 x768 x767 x766 x765 x764 x763 x762 x761 x760 x759 x758 x757 x756 x755 x754 x753 x752 x751 x750 x749 x748 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x747 -x746 -x745 -x744 -x743 -x742 -x741 -x740 x739 -x738 -x737 -x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 x725 x724 x723 x722 -x721 -x720 -x719 -x718 -x717 -x716 -x715 -x714 -x713 -x712 -x711 -x710 x709 x708 -x707 x706 x705 x704 x703 x702 x701 x700 x699 x698 -x697 -x696 -x695 -x694 -x693 -x692 x691 x690 -x689 -x688 x687 x686 x685 -x684 x683 x682 x681 -x680 x679 x678 x677 x676 x675 x674 x673 x672 x671 x670 x669 x668 -x667 -x666 -x665 -x664 -x663 -x662 x661 x660 x659 -x658 x657 x656 x655 -x654 -x653 x652 x651 x650 -x649 -x648 x647 x646 x645 x644 -x643 x642 x641 x640 x639 -x638 x637 x636 x635 x634 x633 -x632 -x631 -x630 x629 x628 -x627 x626 x625 x624 -x623 x622 x621 x620 -x619 -x618 x617 x616 x615 x614 -x613 -x612 x611 x610 x609 x608 x607 -x606 x605 x604 x603 x602 x601 x600 x599 x598 x597 x596 x595 x594 -x593 -x592 -x591 x590 x589 x588 x587 x586 x585 x584 x583 x582 x581 x580 -x579 x578 x577 x576 x575 x574 -x573 x572 x571 x570 x569 x568 x567 -x566 x565 x564 x563 x562 x561 x560 x559 x558 x557 x556 x555 x554 x553 x552 -x551 x550 x549 x548 x547 x546 x545 x544 x543 x542 x541 x540 x539 x538 -x537 x536 x535 x534 x533 x532 x531 x530 x529 x528 x527 x526 x525 x524 x523 x522 x521 x520 x519 x518 x517 x516 x515 x514 x513 x512 x511 x510 x509 x508 x507 x506 x505 x504 x503 x502 x501 x500 x499 x498 x497 x496 x495 x494 x493 x492 x491 x490 x489 x488 x487 x486 x485 x484 x483 x482 x481 x480 x479 x478 x477 x476 x475 x474 x473 x472 x471 x470 x469 x468 x467 x466 x465 x464 x463 -x462 -x461 -x460 -x459 -x458 -x457 -x456 -x455 x454 x453 -x452 -x451 -x450 -x449 -x448 -x447 -x446 -x445 -x444 -x443 -x442 -x441 -x440 x439 x438 x437 x436 x435 x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 x421 x420 -x419 x418 x417 x416 x415 x414 x413 x412 x411 x410 x409 x408 x407 -x406 -x405 -x404 -x403 -x402 -x401 x400 x399 -x398 -x397 x396 x395 x394 -x393 x392 x391 x390 -x389 x388 x387 x386 x385 x384 x383 x382 x381 x380 x379 x378 x377 x376 x375 x374 x373 -x372 -x371 -x370 -x369 -x368 -x367 x366 x365 x364 -x363 x362 x361 x360 -x359 -x358 x357 x356 x355 -x354 -x353 x352 x351 x350 x349 -x348 x347 x346 x345 x344 -x343 x342 x341 x340 x339 x338 x337 x336 x335 x334 x333 -x332 -x331 -x330 x329 x328 -x327 x326 x325 x324 -x323 x322 x321 x320 -x319 -x318 x317 x316 x315 x314 -x313 -x312 x311 x310 x309 x308 x307 -x306 x305 x304 x303 x302 x301 x300 x299 x298 x297 x296 x295 x294 x293 x292 x291 x290 x289 x288 -x287 -x286 -x285 x284 x283 x282 x281 x280 x279 x278 x277 x276 x275 x274 -x273 x272 x271 x270 x269 x268 -x267 x266 x265 x264 x263 x262 x261 -x260 x259 x258 x257 x256 x255 x254 x253 x252 x251 x250 x249 x248 x247 x246 x245 x244 x243 x242 x241 x240 x239 -x238 x237 x236 x235 x234 x233 x232 x231 x230 x229 x228 x227 x226 x225 -x224 x223 x222 x221 x220 x219 x218 x217 x216 x215 x214 x213 x212 x211 x210 x209 x208 x207 x206 x205 x204 x203 x202 x201 x200 x199 x198 x197 x196 x195 x194 x193 x192 x191 x190 x189 x188 x187 x186 x185 x184 x183 x182 x181 x180 x179 x178 x177 x176 x175 x174 x173 x172 x171 x170 x169 x168 x167 x166 x165 x164 x163 x162 x161 x160 x159 x158 x157 x156 x155 x154 x153 x152 x151 x150 x149 x148 x147 x146 x145 x144 x143 x142 x141 x140 x139 x138 x137 x136 x135 x134 x133 x132 x131 x130 x129 x128 x127 x126 x125 x124 x123 x122 x121 x120 x119 x118 x117 x116 x115 x114 x113 x112 x111 x110 x109 x108 x107 x106 x105 x104 x103 x102 x101 x100 x99 x98 x97 x96 x95 x94 x93 x92 x91 x90 x89 x88 x87 x86 x85 x84 x83 x82 x81 x80 x79 x78

Verifier Data 

OK	74

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725981-1338655450/watcher-3725981-1338655450 -o /tmp/evaluation-result-3725981-1338655450/solver-3725981-1338655450 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725981-1338655450.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.93 3.89 2/173 28143
/proc/meminfo: memFree=26823716/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=4792 CPUtime=0 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) R 28141 28143 25747 0 -1 4202496 408 0 0 0 0 0 0 0 20 0 1 0 331669407 4907008 360 33554432000 4194304 5964478 140736169762096 140734072225560 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 1198 361 165 433 0 644 0

[startup+0.0414809 s]
/proc/loadavg: 3.68 3.93 3.89 2/173 28143
/proc/meminfo: memFree=26823716/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=10224 CPUtime=0.03 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) R 28141 28143 25747 0 -1 4202496 1870 0 0 0 3 0 0 0 20 0 1 0 331669407 10469376 1822 33554432000 4194304 5964478 140736169762096 140734072225560 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 2589 1829 256 433 0 2035 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 10224

[startup+0.100222 s]
/proc/loadavg: 3.68 3.93 3.89 2/173 28143
/proc/meminfo: memFree=26823716/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169348 CPUtime=0.14 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 4600 0 0 0 13 1 0 0 20 0 3 0 331669407 173412352 4434 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42337 4434 194 433 0 41901 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 169348

[startup+0.300161 s]
/proc/loadavg: 3.68 3.93 3.89 2/173 28143
/proc/meminfo: memFree=26823716/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169744 CPUtime=0.54 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 5259 0 0 0 52 2 0 0 20 0 3 0 331669407 173817856 5093 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42436 5093 206 433 0 42000 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 169744

[startup+0.70017 s]
/proc/loadavg: 3.68 3.93 3.89 2/173 28143
/proc/meminfo: memFree=26823716/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169744 CPUtime=1.34 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 5615 0 0 0 132 2 0 0 20 0 3 0 331669407 173817856 5449 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42436 5449 206 433 0 42000 0
Current children cumulated CPU time (s) 1.34
Current children cumulated vsize (KiB) 169744

[startup+1.50027 s]
/proc/loadavg: 3.68 3.93 3.89 3/177 28339
/proc/meminfo: memFree=26804192/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169744 CPUtime=2.93 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 5931 0 0 0 291 2 0 0 20 0 3 0 331669407 173817856 5765 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42436 5765 206 433 0 42000 0
[pid=28143/tid=28145] ppid=28141 vsize=169744 CPUtime=1.43 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 2804 0 0 0 141 2 0 0 20 0 3 0 331669412 173817856 5765 33554432000 4194304 5964478 140736169762096 140416938809896 4403721 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=169744 CPUtime=1.43 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 506 0 0 0 143 0 0 0 20 0 3 0 331669412 173817856 5765 33554432000 4194304 5964478 140736169762096 140416928319736 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 169744

[startup+3.10032 s]
/proc/loadavg: 3.68 3.93 3.89 3/177 28499
/proc/meminfo: memFree=26801160/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169744 CPUtime=6.14 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 6526 0 0 0 611 3 0 0 20 0 3 0 331669407 173817856 6360 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42436 6360 206 433 0 42000 0
[pid=28143/tid=28145] ppid=28141 vsize=169744 CPUtime=3.02 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 3267 0 0 0 300 2 0 0 20 0 3 0 331669412 173817856 6360 33554432000 4194304 5964478 140736169762096 140416938809672 4400067 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=169744 CPUtime=3.03 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 638 0 0 0 303 0 0 0 20 0 3 0 331669412 173817856 6360 33554432000 4194304 5964478 140736169762096 140416928319608 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 169744

[startup+6.3003 s]
/proc/loadavg: 3.54 3.90 3.88 3/174 28963
/proc/meminfo: memFree=26801616/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169888 CPUtime=12.54 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 7661 0 0 0 1249 5 0 0 20 0 3 0 331669407 173965312 7495 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42472 7495 206 433 0 42036 0
[pid=28143/tid=28145] ppid=28141 vsize=169888 CPUtime=6.22 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 4234 0 0 0 618 4 0 0 20 0 3 0 331669412 173965312 7495 33554432000 4194304 5964478 140736169762096 140416938809336 4220672 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=169888 CPUtime=6.22 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 806 0 0 0 622 0 0 0 20 0 3 0 331669412 173965312 7495 33554432000 4194304 5964478 140736169762096 140416928319848 4222314 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.54
Current children cumulated vsize (KiB) 169888

[startup+12.7003 s]
/proc/loadavg: 3.58 3.90 3.88 5/181 28979
/proc/meminfo: memFree=26758504/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169888 CPUtime=25.34 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 9978 0 0 0 2528 6 0 0 20 0 3 0 331669407 173965312 9775 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42472 9775 206 433 0 42036 0
[pid=28143/tid=28145] ppid=28141 vsize=169888 CPUtime=12.6 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 6280 0 0 0 1256 4 0 0 20 0 3 0 331669412 173965312 9775 33554432000 4194304 5964478 140736169762096 140416938809248 4403719 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=169888 CPUtime=12.6 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 1077 0 0 0 1260 0 0 0 20 0 3 0 331669412 173965312 9775 33554432000 4194304 5964478 140736169762096 140416928319904 4403708 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.34
Current children cumulated vsize (KiB) 169888

[startup+25.5003 s]
/proc/loadavg: 3.82 3.94 3.89 5/181 28979
/proc/meminfo: memFree=26734456/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=169888 CPUtime=50.91 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 10136 0 0 0 5085 6 0 0 20 0 3 0 331669407 173965312 9962 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42472 9962 206 433 0 42036 0
[pid=28143/tid=28145] ppid=28141 vsize=169888 CPUtime=25.35 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 6298 0 0 0 2531 4 0 0 20 0 3 0 331669412 173965312 9962 33554432000 4194304 5964478 140736169762096 140416938809440 4403370 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=169888 CPUtime=25.37 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 1217 0 0 0 2536 1 0 0 20 0 3 0 331669412 173965312 9962 33554432000 4194304 5964478 140736169762096 140416928319800 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.91
Current children cumulated vsize (KiB) 169888

[startup+51.1004 s]
/proc/loadavg: 3.88 3.94 3.89 5/181 29019
/proc/meminfo: memFree=26739128/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=170068 CPUtime=102.11 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 11772 0 0 0 10203 8 0 0 20 0 3 0 331669407 174149632 12792 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42517 12792 206 433 0 42081 0
[pid=28143/tid=28145] ppid=28141 vsize=170068 CPUtime=50.88 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 7157 0 0 0 5084 4 0 0 20 0 3 0 331669412 174149632 12792 33554432000 4194304 5964478 140736169762096 140416938809880 4222320 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=170068 CPUtime=50.9 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 1994 0 0 0 5088 2 0 0 20 0 3 0 331669412 174149632 12792 33554432000 4194304 5964478 140736169762096 140416928319608 4403727 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 170068

[startup+102.307 s]
/proc/loadavg: 4.10 3.98 3.91 5/181 29019
/proc/meminfo: memFree=26657836/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=170712 CPUtime=204.49 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 13903 0 0 0 20438 11 0 0 20 0 3 0 331669407 174809088 14923 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42678 14923 206 433 0 42242 0
[pid=28143/tid=28145] ppid=28141 vsize=170712 CPUtime=101.95 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 7982 0 0 0 10188 7 0 0 20 0 3 0 331669412 174809088 14923 33554432000 4194304 5964478 140736169762096 140416938809144 4221984 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=170712 CPUtime=101.98 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 3300 0 0 0 10193 5 0 0 20 0 3 0 331669412 174809088 14923 33554432000 4194304 5964478 140736169762096 140416928319608 4392918 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.49
Current children cumulated vsize (KiB) 170712

[startup+162.3 s]
/proc/loadavg: 4.03 3.98 3.91 5/181 29019
/proc/meminfo: memFree=26586756/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=171192 CPUtime=324.45 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 18335 0 0 0 32427 18 0 0 20 0 3 0 331669407 175300608 19415 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42798 19415 206 433 0 42362 0
[pid=28143/tid=28145] ppid=28141 vsize=171192 CPUtime=161.78 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 11692 0 0 0 16164 14 0 0 20 0 3 0 331669412 175300608 19415 33554432000 4194304 5964478 140736169762096 140416938809144 4403370 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=171192 CPUtime=161.81 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 4022 0 0 0 16174 7 0 0 20 0 3 0 331669412 175300608 19415 33554432000 4194304 5964478 140736169762096 140416928319848 4392797 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.45
Current children cumulated vsize (KiB) 171192

[startup+222.3 s]
/proc/loadavg: 4.01 3.98 3.91 5/181 29219
/proc/meminfo: memFree=26637164/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=171192 CPUtime=444.42 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 22631 0 0 0 44418 24 0 0 20 0 3 0 331669407 175300608 23723 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 42798 23723 206 433 0 42362 0
[pid=28143/tid=28145] ppid=28141 vsize=171192 CPUtime=221.62 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 14946 0 0 0 22142 20 0 0 20 0 3 0 331669412 175300608 23723 33554432000 4194304 5964478 140736169762096 140416938809248 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=171192 CPUtime=221.66 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 5064 0 0 0 22157 9 0 0 20 0 3 0 331669412 175300608 23723 33554432000 4194304 5964478 140736169762096 140416928319904 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.42
Current children cumulated vsize (KiB) 171192

[startup+282.3 s]
/proc/loadavg: 4.00 3.98 3.91 5/181 29220
/proc/meminfo: memFree=26586044/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=236728 CPUtime=564.39 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 25662 0 0 0 56410 29 0 0 20 0 3 0 331669407 242409472 26853 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59182 26853 206 433 0 58746 0
[pid=28143/tid=28145] ppid=28141 vsize=236728 CPUtime=281.45 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 17975 0 0 0 28119 26 0 0 20 0 3 0 331669412 242409472 26853 33554432000 4194304 5964478 140736169762096 140416938809384 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=236728 CPUtime=281.5 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 5066 0 0 0 28140 10 0 0 20 0 3 0 331669412 242409472 26853 33554432000 4194304 5964478 140736169762096 140416928319904 4222304 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.39
Current children cumulated vsize (KiB) 236728

[startup+342.3 s]
/proc/loadavg: 4.00 3.98 3.91 5/181 29220
/proc/meminfo: memFree=26550364/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=236728 CPUtime=684.37 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 28790 0 0 0 68403 34 0 0 20 0 3 0 331669407 242409472 29981 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59182 29981 206 433 0 58746 0

################
# More data... #
################

[pid=28143/tid=28146] ppid=28141 vsize=236728 CPUtime=341.35 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 5066 0 0 0 34124 11 0 0 20 0 3 0 331669412 242409472 29981 33554432000 4194304 5964478 140736169762096 140416928319712 4222314 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 684.37
Current children cumulated vsize (KiB) 236728

[startup+402.3 s]
/proc/loadavg: 4.03 4.00 3.91 5/182 29223
/proc/meminfo: memFree=26484972/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=237088 CPUtime=804.34 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 30977 0 0 0 80396 38 0 0 20 0 3 0 331669407 242778112 32190 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59272 32190 206 433 0 58836 0
[pid=28143/tid=28145] ppid=28141 vsize=237088 CPUtime=401.13 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 22475 0 0 0 40078 35 0 0 20 0 3 0 331669412 242778112 32190 33554432000 4194304 5964478 140736169762096 140416938809384 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=237088 CPUtime=401.19 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 5881 0 0 0 40105 14 0 0 20 0 3 0 331669412 242778112 32190 33554432000 4194304 5964478 140736169762096 140416928319608 4400024 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 804.34
Current children cumulated vsize (KiB) 237088

[startup+462.3 s]
/proc/loadavg: 4.01 4.00 3.91 5/181 29223
/proc/meminfo: memFree=26453220/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=237088 CPUtime=924.31 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 33593 0 0 0 92389 42 0 0 20 0 3 0 331669407 242778112 34879 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59272 34879 206 433 0 58836 0
[pid=28143/tid=28145] ppid=28141 vsize=237088 CPUtime=460.96 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 24840 0 0 0 46057 39 0 0 20 0 3 0 331669412 242778112 34879 33554432000 4194304 5964478 140736169762096 140416938809384 4222330 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=237088 CPUtime=461.04 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 6132 0 0 0 46088 16 0 0 20 0 3 0 331669412 242778112 34879 33554432000 4194304 5964478 140736169762096 140416928319608 4403290 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 924.31
Current children cumulated vsize (KiB) 237088

[startup+522.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29223
/proc/meminfo: memFree=26397412/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=238096 CPUtime=1044.28 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 38184 0 0 0 104378 50 0 0 20 0 3 0 331669407 243810304 39470 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59524 39470 206 433 0 59088 0
[pid=28143/tid=28145] ppid=28141 vsize=238096 CPUtime=520.8 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 28504 0 0 0 52034 46 0 0 20 0 3 0 331669412 243810304 39470 33554432000 4194304 5964478 140736169762096 140416938809144 4399938 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=238096 CPUtime=520.88 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 7059 0 0 0 52070 18 0 0 20 0 3 0 331669412 243810304 39470 33554432000 4194304 5964478 140736169762096 140416928319608 4222330 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1044.28
Current children cumulated vsize (KiB) 238096

[startup+582.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29224
/proc/meminfo: memFree=26365436/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=238420 CPUtime=1164.26 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 40284 0 0 0 116372 54 0 0 20 0 3 0 331669407 244142080 41570 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59605 41570 206 433 0 59169 0
[pid=28143/tid=28145] ppid=28141 vsize=238420 CPUtime=580.64 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 30581 0 0 0 58013 51 0 0 20 0 3 0 331669412 244142080 41570 33554432000 4194304 5964478 140736169762096 140416938809384 4399920 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=238420 CPUtime=580.73 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 7082 0 0 0 58054 19 0 0 20 0 3 0 331669412 244142080 41570 33554432000 4194304 5964478 140736169762096 140416928319608 4378816 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.26
Current children cumulated vsize (KiB) 238420

[startup+642.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29224
/proc/meminfo: memFree=26342172/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=238744 CPUtime=1284.25 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 41575 0 0 0 128369 56 0 0 20 0 3 0 331669407 244473856 42840 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 59686 42840 206 433 0 59250 0
[pid=28143/tid=28145] ppid=28141 vsize=238744 CPUtime=640.49 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 31742 0 0 0 63996 53 0 0 20 0 3 0 331669412 244473856 42840 33554432000 4194304 5964478 140736169762096 140416938809144 4403370 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=238744 CPUtime=640.58 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 7212 0 0 0 64038 20 0 0 20 0 3 0 331669412 244473856 42840 33554432000 4194304 5964478 140736169762096 140416928319848 4400787 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.25
Current children cumulated vsize (KiB) 238744

[startup+702.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29224
/proc/meminfo: memFree=26274944/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=304604 CPUtime=1404.21 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 46309 0 0 0 140355 66 0 0 20 0 3 0 331669407 311914496 47625 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76151 47625 206 433 0 75715 0
[pid=28143/tid=28145] ppid=28141 vsize=304604 CPUtime=700.32 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 33943 0 0 0 69974 58 0 0 20 0 3 0 331669412 311914496 47625 33554432000 4194304 5964478 140736169762096 140416938809384 4222314 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=304604 CPUtime=700.42 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9745 0 0 0 70015 27 0 0 20 0 3 0 331669412 311914496 47625 33554432000 4194304 5964478 140736169762096 140416928319800 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1404.21
Current children cumulated vsize (KiB) 304604

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29224
/proc/meminfo: memFree=26242424/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=304604 CPUtime=1524.2 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 47393 0 0 0 152353 67 0 0 20 0 3 0 331669407 311914496 48873 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76151 48873 206 433 0 75715 0
[pid=28143/tid=28145] ppid=28141 vsize=304604 CPUtime=760.16 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 34906 0 0 0 75956 60 0 0 20 0 3 0 331669412 311914496 48873 33554432000 4194304 5964478 140736169762096 140416938809336 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=304604 CPUtime=760.27 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9866 0 0 0 75999 28 0 0 20 0 3 0 331669412 311914496 48873 33554432000 4194304 5964478 140736169762096 140416928319608 4400038 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1524.2
Current children cumulated vsize (KiB) 304604

[startup+822.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 29224
/proc/meminfo: memFree=26203816/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=306276 CPUtime=1644.17 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 51037 0 0 0 164344 73 0 0 20 0 3 0 331669407 313626624 52515 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76569 52515 206 433 0 76133 0
[pid=28143/tid=28145] ppid=28141 vsize=306276 CPUtime=819.99 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 38450 0 0 0 81932 67 0 0 20 0 3 0 331669412 313626624 52515 33554432000 4194304 5964478 140736169762096 140416938809336 4403376 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=306276 CPUtime=820.11 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9966 0 0 0 81982 29 0 0 20 0 3 0 331669412 313626624 52515 33554432000 4194304 5964478 140736169762096 140416928319672 4403727 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1644.17
Current children cumulated vsize (KiB) 306276

[startup+882.3 s]
/proc/loadavg: 4.03 4.01 3.92 5/181 29225
/proc/meminfo: memFree=26193864/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=306276 CPUtime=1764.14 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 51543 0 0 0 176341 73 0 0 20 0 3 0 331669407 313626624 53020 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76569 53020 206 433 0 76133 0
[pid=28143/tid=28145] ppid=28141 vsize=306276 CPUtime=879.84 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 38954 0 0 0 87915 69 0 0 20 0 3 0 331669412 313626624 53020 33554432000 4194304 5964478 140736169762096 140416938809384 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=306276 CPUtime=879.96 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9968 0 0 0 87966 30 0 0 20 0 3 0 331669412 313626624 53020 33554432000 4194304 5964478 140736169762096 140416928319672 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1764.14
Current children cumulated vsize (KiB) 306276



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.02 4.01 3.92 5/181 29225
/proc/meminfo: memFree=26186404/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=306276 CPUtime=1800.15 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 52874 0 0 0 179940 75 0 0 20 0 3 0 331669407 313626624 54351 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76569 54351 206 433 0 76133 0
[pid=28143/tid=28145] ppid=28141 vsize=306276 CPUtime=897.8 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 40285 0 0 0 89710 70 0 0 20 0 3 0 331669412 313626624 54351 33554432000 4194304 5964478 140736169762096 140416938809384 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=306276 CPUtime=897.92 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9968 0 0 0 89762 30 0 0 20 0 3 0 331669412 313626624 54351 33554432000 4194304 5964478 140736169762096 140416928319672 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 306276

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.02 4.01 3.92 5/181 29225
/proc/meminfo: memFree=26186404/32873844 swapFree=7628/7628
[pid=28143] ppid=28141 vsize=306276 CPUtime=1800.15 cores=1,3,5,7
/proc/28143/stat : 28143 (pwbo2.02) S 28141 28143 25747 0 -1 4202496 52874 0 0 0 179940 75 0 0 20 0 3 0 331669407 313626624 54351 33554432000 4194304 5964478 140736169762096 140736169761616 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/28143/statm: 76569 54351 206 433 0 76133 0
[pid=28143/tid=28145] ppid=28141 vsize=306276 CPUtime=897.8 cores=1,3,5,7
/proc/28143/task/28145/stat : 28145 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 40285 0 0 0 89710 70 0 0 20 0 3 0 331669412 313626624 54351 33554432000 4194304 5964478 140736169762096 140416938809384 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=28143/tid=28146] ppid=28141 vsize=306276 CPUtime=897.92 cores=1,3,5,7
/proc/28143/task/28146/stat : 28146 (pwbo2.02) R 28141 28143 25747 0 -1 4202560 9968 0 0 0 89762 30 0 0 20 0 3 0 331669412 313626624 54351 33554432000 4194304 5964478 140736169762096 140416928319672 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 306276

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28143 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=782151
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=22844
# CPU time returned by wait4() is 1795.81
# while last known CPU time is 1800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.316
CPU time (s): 1800.15
CPU user time (s): 1799.4
CPU system time (s): 0.75
CPU usage (%): 199.946
Max. virtual memory (cumulated for all children) (KiB): 306276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.78
system time used= 1.02284
maximum resident set size= 217408
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 52875
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 162
involuntary context switches= 2619

runsolver used 2.21166 second user time and 5.16621 second system time

The end

Launcher Data 

Begin job on node145 at 2012-06-02 18:44:10
IDJOB=3725981
IDBENCH=2643
IDSOLVER=2309
FILE ID=node145/3725981-1338655450
RUNJOBID= node145-1338651838-27486
PBS_JOBID= 14636435
Free space on /tmp= 70916 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/golomb-rulers/normalized-OGR_11.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725981-1338655450/watcher-3725981-1338655450 -o /tmp/evaluation-result-3725981-1338655450/solver-3725981-1338655450 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725981-1338655450.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5946eb43fefc6e626d35d99afd3eec42
RANDOM SEED=1077675304

node145.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5313.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26824088 kB
Buffers:          425184 kB
Cached:          4760764 kB
SwapCached:            0 kB
Active:          1602976 kB
Inactive:        3594528 kB
Active(anon):       2652 kB
Inactive(anon):    10928 kB
Active(file):    1600324 kB
Inactive(file):  3583600 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              5920 kB
Writeback:             0 kB
AnonPages:         17680 kB
Mapped:            13912 kB
Shmem:               200 kB
Slab:             714996 kB
SReclaimable:     156352 kB
SUnreclaim:       558644 kB
KernelStack:        1432 kB
PageTables:         4396 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104108 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70916 MiB
End job on node145 at 2012-06-02 18:59:13