Trace number 3725964

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)77 1800.2 900.314

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_11.opb
MD5SUMc19ad978a977652a94fc03b8ce63204a
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark72
Best CPU time to get the best result obtained on this benchmark1800.01
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 74
Optimality of the best value was proved NO
Number of variables1288
Total number of constraints2431
Number of constraints which are clauses1
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2430
Minimum length of a constraint1
Maximum length of a constraint29
Number of terms in the objective function 8
Biggest coefficient in the objective function 64
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 182
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 175
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 802
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725964-1338656926.opb.
0.00/0.00	c Instance file HOME/instance-3725964-1338656926.opb
0.00/0.00	c File size is 481988 bytes.
0.04/0.04	c Cost Offset: 0
0.04/0.04	c Highest Coefficient sum: 802
0.04/0.04	c ============================[ Problem Statistics ]=============================
0.04/0.04	c |                                                                             |
0.04/0.04	c |  Parsing time:          0.05         s                                      |
0.04/0.04	c |  Number Variables:      1288                                                |
0.04/0.04	c |  Number Clauses:        1                                                   |
0.04/0.04	c |  Number Cardinality:    0                                                   |
0.04/0.04	c |  Number PB Constraints: 2430                                                |
0.04/0.04	c |                                                                             |
0.04/0.05	c |  Problem Type:          Optimization                                        |
0.04/0.05	c |  Objective Function:    Cardinality Constraint                              |
0.04/0.05	c |                                                                             |
0.04/0.05	c ===============================================================================
1800.20/900.31	o 118
1800.20/900.31	o 111
1800.20/900.31	o 102
1800.20/900.31	o 100
1800.20/900.31	o 96
1800.20/900.31	o 95
1800.20/900.31	o 94
1800.20/900.31	o 87
1800.20/900.31	o 85
1800.20/900.31	o 84
1800.20/900.31	o 82
1800.20/900.31	o 80
1800.20/900.31	o 79
1800.20/900.31	o 78
1800.20/900.31	o 77
1800.20/900.31	c ===============================================================================
1800.20/900.31	c Wall Clock Time: 900.31 s
1800.20/900.31	c Best Solution: 77
1800.20/900.31	s SATISFIABLE
1800.20/900.31	v -x1 x2 x3 -x4 x5 -x6 -x7 x1288 -x64 -x65 -x66 -x67 -x68 x69 -x70 x71 -x72 -x73 x74 x75 -x76 -x77 x1287 -x57 -x58 -x59 -x60 -x61 x62 -x63 -x1286 -x1285 -x1284 x1283 -x1282 x50 -x51 -x52 -x53 -x54 x55 -x56 -x1281 -x1280 x1279 -x1278 -x1277 -x1276 x1275 -x1274 x1273 x1272 -x1271 x1270 x1269 x1268 -x43 x44 -x45 -x46 x47 -x48 -x49 -x1267 -x1266 -x1265 -x1264 -x1263 -x1262 -x1261 -x1260 -x1259 -x1258 -x1257 -x1256 -x1255 -x1254 -x1253 -x1252 -x1251 -x1250 -x1249 -x1248 -x1247 -x1246 -x1245 -x1244 -x1243 -x1242 x1241 -x1240 -x1239 -x1238 -x36 x37 -x38 -x39 x40 -x41 -x42 -x1237 -x1236 -x1235 -x1234 x1233 -x1232 -x1231 -x1230 -x1229 -x1228 -x1227 -x1226 x1225 -x1224 -x1223 -x1222 -x1221 -x1220 -x1219 -x1218 -x1217 -x1216 -x1215 x1214 x1213 x1212 -x1211 -x1210 -x1209 -x1208 -x1207 -x1206 -x1205 -x1204 -x1203 -x1202 x1201 x1200 x1199 x1198 x1197 x1196 -x1195 x1194 x1193 x1192 x1191 x1190 x1189 x1188 x1187 x1186 x1185 x1184 x1183 x29 -x30 -x31 x32 -x33 -x34 -x35 -x1182 -x1181 -x1180 -x1179 -x1178 -x1177 -x1176 -x1175 -x1174 -x1173 -x1172 -x1171 -x1170 -x1169 -x1168 -x1167 -x1166 -x1165 -x1164 -x1163 -x1162 -x1161 -x1160 -x1159 -x1158 -x1157 -x1156 -x1155 -x1154 x1153 -x1152 -x1151 -x1150 -x1149 -x1148 -x1147 -x1146 -x1145 -x1144 -x1143 -x1142 -x1141 x1140 -x1139 -x1138 -x1137 x1136 x1135 x1134 -x1133 -x1132 -x1131 -x1130 -x1129 -x1128 -x1127 x1126 -x1125 -x1124 -x1123 x1122 x1121 x1120 x1119 x1118 x1117 x1116 x1115 x1114 x1113 -x1112 -x1111 -x1110 x1109 -x1108 -x1107 x1106 x1105 x1104 -x1103 x1102 x1101 x1100 x1099 x1098 x1097 x1096 x1095 x1094 x1093 -x1092 x22 -x23 -x24 -x25 -x26 -x27 -x28 -x1091 -x1090 -x1089 -x1088 -x1087 -x1086 -x1085 -x1084 -x1083 -x1082 -x1081 -x1080 -x1079 -x1078 -x1077 -x1076 -x1075 -x1074 -x1073 -x1072 -x1071 -x1070 -x1069 -x1068 -x1067 -x1066 -x1065 -x1064 -x1063 -x1062 -x1061 -x1060 -x1059 -x1058 -x1057 x1056 -x1055 -x1054 -x1053 -x1052 -x1051 -x1050 -x1049 -x1048 -x1047 -x1046 -x1045 -x1044 -x1043 -x1042 -x1041 -x1040 -x1039 -x1038 -x1037 -x1036 x1035 x1034 x1033 -x1032 -x1031 -x1030 -x1029 -x1028 -x1027 -x1026 -x1025 -x1024 -x1023 -x1022 x1021 x1020 x1019 -x1018 -x1017 x1016 x1015 x1014 x1013 -x1012 x1011 x1010 x1009 x1008 x1007 -x1006 -x1005 -x1004 -x1003 -x1002 -x1001 -x1000 -x999 -x998 -x997 x996 x995 x994 x993 -x992 x991 x990 x989 x988 x987 -x986 x985 x984 x983 x982 x981 -x980 -x979 -x978 -x977 x976 -x975 -x974 x973 x972 x971 -x970 x969 x968 x967 x966 x965 x964 x963 x962 x961 x960 -x959 x958 x957 x956 x955 x954 x953 x952 -x8 x9 -x10 -x11 -x12 -x13 -x14 -x951 -x950 -x949 -x948 -x947 -x946 -x945 x944 -x943 -x942 -x941 -x940 -x939 -x938 -x937 -x936 -x935 -x934 -x933 -x932 -x931 x930 x929 -x928 -x927 -x926 -x925 -x924 -x923 -x922 -x921 -x920 -x919 -x918 -x917 -x916 -x915 -x914 x913 -x912 -x911 x910 x909 x908 -x907 -x906 -x905 -x904 -x903 -x902 -x901 -x900 -x899 -x898 -x897 -x896 -x895 -x894 -x893 -x892 -x891 -x890 x889 x888 x887 -x886 x885 x884 x883 x882 -x881 -x880 -x879 -x878 -x877 -x876 -x875 -x874 -x873 -x872 x871 x870 x869 -x868 -x867 x866 x865 x864 x863 -x862 x861 x860 x859 x858 x857 x856 x855 x854 x853 x852 -x851 -x850 -x849 -x848 -x847 -x846 -x845 -x844 -x843 -x842 x841 x840 x839 x838 -x837 x836 x835 x834 x833 x832 -x831 x830 x829 x828 x827 x826 -x825 x824 x823 x822 x821 x820 x819 -x818 -x817 -x816 x815 -x814 -x813 x812 x811 x810 -x809 x808 x807 x806 x805 x804 x803 x802 x801 x800 x799 -x798 x797 x796 x795 x794 x793 x792 x791 x790 x789 x788 x787 x786 x785 x784 x783 x782 x781 x780 x779 x778 x777 x776 x775 x774 x773 x772 x771 x770 x769 x768 x767 x766 x765 x764 x763 x762 x761 x760 x759 x758 x757 x756 x755 x754 x753 x752 x751 x750 x749 x748 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x747 -x746 -x745 -x744 -x743 -x742 -x741 x740 x739 -x738 -x737 -x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 x725 -x724 x723 -x722 -x721 -x720 -x719 -x718 -x717 -x716 -x715 -x714 -x713 -x712 -x711 -x710 -x709 -x708 -x707 x706 -x705 -x704 x703 x702 x701 x700 x699 x698 -x697 -x696 -x695 -x694 -x693 -x692 -x691 -x690 -x689 -x688 -x687 -x686 -x685 -x684 -x683 -x682 -x681 -x680 x679 x678 -x677 -x676 x675 x674 x673 x672 x671 x670 x669 x668 -x667 -x666 -x665 -x664 -x663 -x662 -x661 -x660 -x659 -x658 x657 x656 x655 -x654 -x653 x652 x651 x650 -x649 -x648 x647 x646 x645 x644 x643 x642 x641 x640 x639 x638 x637 x636 x635 x634 x633 -x632 -x631 -x630 -x629 -x628 -x627 -x626 -x625 -x624 -x623 x622 x621 x620 -x619 -x618 x617 x616 x615 x614 -x613 -x612 x611 x610 x609 x608 x607 -x606 x605 x604 x603 x602 x601 x600 x599 x598 x597 x596 x595 x594 -x593 -x592 -x591 x590 -x589 -x588 x587 x586 -x585 -x584 x583 x582 x581 x580 x579 x578 x577 x576 x575 x574 -x573 x572 x571 x570 x569 x568 x567 -x566 x565 x564 x563 x562 x561 x560 x559 x558 x557 x556 x555 x554 x553 x552 x551 x550 -x549 x548 x547 x546 x545 x544 x543 x542 x541 x540 x539 x538 x537 x536 x535 x534 x533 x532 x531 x530 x529 x528 x527 x526 x525 x524 x523 x522 x521 x520 x519 x518 x517 x516 x515 x514 x513 x512 x511 x510 x509 x508 x507 x506 -x505 x504 x503 x502 x501 x500 x499 x498 x497 x496 x495 x494 x493 x492 x491 x490 x489 x488 x487 x486 x485 x484 x483 x482 x481 x480 x479 x478 x477 x476 x475 x474 x473 x472 x471 x470 x469 x468 x467 x466 x465 x464 -x463 -x462 -x461 -x460 -x459 -x458 -x457 -x456 x455 x454 x453 -x452 -x451 -x450 -x449 -x448 -x447 -x446 -x445 -x444 -x443 -x442 -x441 -x440 x439 -x438 x437 -x436 x435 x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 -x421 -x420 -x419 x418 -x417 -x416 x415 x414 x413 x412 x411 x410 x409 x408 x407 -x406 -x405 -x404 -x403 -x402 -x401 -x400 -x399 -x398 -x397 -x396 -x395 -x394 -x393 -x392 -x391 -x390 -x389 x388 x387 -x386 -x385 x384 x383 x382 x381 x380 x379 x378 x377 x376 x375 x374 x373 -x372 -x371 -x370 -x369 -x368 -x367 -x366 -x365 -x364 -x363 x362 x361 x360 -x359 -x358 x357 x356 x355 -x354 -x353 x352 x351 x350 x349 x348 x347 x346 x345 x344 x343 x342 x341 x340 x339 x338 x337 x336 x335 x334 x333 -x332 -x331 -x330 -x329 -x328 -x327 -x326 -x325 -x324 -x323 x322 x321 x320 -x319 -x318 x317 x316 x315 x314 -x313 -x312 x311 x310 x309 x308 x307 -x306 x305 x304 x303 x302 x301 x300 x299 x298 x297 x296 x295 x294 x293 x292 x291 x290 x289 x288 -x287 -x286 -x285 x284 -x283 -x282 x281 x280 -x279 -x278 x277 x276 x275 x274 x273 x272 x271 x270 x269 x268 -x267 x266 x265 x264 x263 x262 x261 -x260 x259 x258 x257 x256 x255 x254 x253 x252 x251 x250 x249 x248 x247 x246 x245 x244 x243 x242 x241 x240 x239 x238 x237 -x236 x235 x234 x233 x232 x231 x230 x229 x228 x227 x226 x225 x224 x223 x222 x221 x220 x219 x218 x217 x216 x215 x214 x213 x212 x211 x210 x209 x208 x207 x206 x205 x204 x203 x202 x201 x200 x199 x198 x197 x196 x195 x194 x193 x192 x191 x190 x189 x188 x187 x186 x185 -x184 x183 x182 x181 x180 x179 x178 x177 x176 x175 x174 x173 x172 x171 x170 x169 x168 x167 x166 x165 x164 x163 x162 x161 x160 x159 x158 x157 x156 x155 x154 x153 x152 x151 x150 x149 x148 x147 x146 x145 x144 x143 -x142 x141 x140 x139 x138 x137 x136 x135 x134 x133 x132 x131 x130 x129 x128 x127 x126 x125 x124 x123 x122 x121 x120 x119 x118 x117 x116 x115 x114 x113 x112 x111 x110 x109 x108 x107 x106 x105 x104 x103 x102 x101 x100 x99 x98 x97 x96 x95 x94 x93 x92 x91 x90 x89 x88 x87 x86 x85 x84 x83 x82 x81 x80 x79 x78

Verifier Data 

OK	77

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725964-1338656926/watcher-3725964-1338656926 -o /tmp/evaluation-result-3725964-1338656926/solver-3725964-1338656926 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725964-1338656926.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 3.99 3.92 4/178 13070
/proc/meminfo: memFree=28199396/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=4792 CPUtime=0 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) R 13068 13070 10982 0 -1 4202496 419 0 0 0 0 0 0 0 20 0 1 0 331817155 4907008 371 33554432000 4194304 5964478 140736084844064 140736084842424 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 1198 371 165 433 0 644 0

[startup+0.043445 s]
/proc/loadavg: 4.00 3.99 3.92 4/178 13070
/proc/meminfo: memFree=28199396/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=10616 CPUtime=0.04 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) R 13068 13070 10982 0 -1 4202496 1955 0 0 0 4 0 0 0 20 0 1 0 331817155 10870784 1907 33554432000 4194304 5964478 140736084844064 140736084842424 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 2654 1909 261 433 0 2100 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 10616

[startup+0.100225 s]
/proc/loadavg: 4.00 3.99 3.92 4/178 13070
/proc/meminfo: memFree=28199396/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=169352 CPUtime=0.13 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 3672 0 0 0 13 0 0 0 20 0 3 0 331817155 173416448 3506 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42338 3506 192 433 0 41902 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 169352

[startup+0.300162 s]
/proc/loadavg: 4.00 3.99 3.92 4/178 13070
/proc/meminfo: memFree=28199396/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=169352 CPUtime=0.53 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 3746 0 0 0 53 0 0 0 20 0 3 0 331817155 173416448 3580 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42338 3580 195 433 0 41902 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 169352

[startup+0.700176 s]
/proc/loadavg: 4.00 3.99 3.92 4/178 13070
/proc/meminfo: memFree=28199396/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170336 CPUtime=1.33 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 4257 0 0 0 133 0 0 0 20 0 3 0 331817155 174424064 4091 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42584 4091 204 433 0 42148 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 170336

[startup+1.50034 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28183756/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170336 CPUtime=2.93 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 4554 0 0 0 292 1 0 0 20 0 3 0 331817155 174424064 4388 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42584 4388 204 433 0 42148 0
[pid=13070/tid=13072] ppid=13068 vsize=170336 CPUtime=1.43 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1268 0 0 0 143 0 0 0 20 0 3 0 331817160 174424064 4388 33554432000 4194304 5964478 140736084844064 139927029692216 4403692 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=170336 CPUtime=1.43 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 664 0 0 0 143 0 0 0 20 0 3 0 331817160 174424064 4388 33554432000 4194304 5964478 140736084844064 139927019202872 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 170336

[startup+3.10036 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28181632/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170336 CPUtime=6.13 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 5166 0 0 0 612 1 0 0 20 0 3 0 331817155 174424064 5000 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42584 5000 204 433 0 42148 0
[pid=13070/tid=13072] ppid=13068 vsize=170336 CPUtime=3.03 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1629 0 0 0 302 1 0 0 20 0 3 0 331817160 174424064 5000 33554432000 4194304 5964478 140736084844064 139927029692408 4221984 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=170336 CPUtime=3.03 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 915 0 0 0 303 0 0 0 20 0 3 0 331817160 174424064 5000 33554432000 4194304 5964478 140736084844064 139927019202920 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.13
Current children cumulated vsize (KiB) 170336

[startup+6.30036 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28176712/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170480 CPUtime=12.53 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 5715 0 0 0 1251 2 0 0 20 0 3 0 331817155 174571520 5549 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42620 5549 204 433 0 42184 0
[pid=13070/tid=13072] ppid=13068 vsize=170480 CPUtime=6.22 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1995 0 0 0 621 1 0 0 20 0 3 0 331817160 174571520 5549 33554432000 4194304 5964478 140736084844064 139927029692456 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=170480 CPUtime=6.22 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1098 0 0 0 622 0 0 0 20 0 3 0 331817160 174571520 5549 33554432000 4194304 5964478 140736084844064 139927019202680 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.53
Current children cumulated vsize (KiB) 170480

[startup+12.7004 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28171616/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170552 CPUtime=25.32 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 6475 0 0 0 2530 2 0 0 20 0 3 0 331817155 174645248 6309 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42638 6309 204 433 0 42202 0
[pid=13070/tid=13072] ppid=13068 vsize=170552 CPUtime=12.6 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 2716 0 0 0 1258 2 0 0 20 0 3 0 331817160 174645248 6309 33554432000 4194304 5964478 140736084844064 139927029692216 4403727 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=170552 CPUtime=12.6 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1137 0 0 0 1260 0 0 0 20 0 3 0 331817160 174645248 6309 33554432000 4194304 5964478 140736084844064 139927019202680 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.32
Current children cumulated vsize (KiB) 170552

[startup+25.5004 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28160332/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=170768 CPUtime=50.92 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 8325 0 0 0 5088 4 0 0 20 0 3 0 331817155 174866432 8159 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42692 8159 204 433 0 42256 0
[pid=13070/tid=13072] ppid=13068 vsize=170768 CPUtime=25.37 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 3954 0 0 0 2534 3 0 0 20 0 3 0 331817160 174866432 8159 33554432000 4194304 5964478 140736084844064 139927029692408 4222324 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=170768 CPUtime=25.37 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 1749 0 0 0 2536 1 0 0 20 0 3 0 331817160 174866432 8159 33554432000 4194304 5964478 140736084844064 139927019202872 4392962 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.92
Current children cumulated vsize (KiB) 170768

[startup+51.1004 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13073
/proc/meminfo: memFree=28146024/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171288 CPUtime=102.11 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 11042 0 0 0 10203 8 0 0 20 0 3 0 331817155 175398912 10876 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42822 10876 204 433 0 42386 0
[pid=13070/tid=13072] ppid=13068 vsize=171288 CPUtime=50.9 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 6235 0 0 0 5084 6 0 0 20 0 3 0 331817160 175398912 10876 33554432000 4194304 5964478 140736084844064 139927029692456 4403664 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=171288 CPUtime=50.91 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 2185 0 0 0 5089 2 0 0 20 0 3 0 331817160 175398912 10876 33554432000 4194304 5964478 140736084844064 139927019202680 4403385 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 171288

[startup+102.307 s]
/proc/loadavg: 4.00 3.99 3.92 5/182 13077
/proc/meminfo: memFree=28114040/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171736 CPUtime=204.5 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 15302 0 0 0 20435 15 0 0 20 0 3 0 331817155 175857664 15415 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42934 15415 204 433 0 42498 0
[pid=13070/tid=13072] ppid=13068 vsize=171736 CPUtime=101.97 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 8406 0 0 0 10187 10 0 0 20 0 3 0 331817160 175857664 15415 33554432000 4194304 5964478 140736084844064 139927029692456 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=171736 CPUtime=101.97 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 4274 0 0 0 10191 6 0 0 20 0 3 0 331817160 175857664 15415 33554432000 4194304 5964478 140736084844064 139927019202872 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.5
Current children cumulated vsize (KiB) 171736

[startup+162.3 s]
/proc/loadavg: 3.95 3.97 3.91 5/181 13077
/proc/meminfo: memFree=28090632/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171060 CPUtime=324.44 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 18109 0 0 0 32425 19 0 0 20 0 3 0 331817155 175165440 19188 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42765 19188 206 433 0 42329 0
[pid=13070/tid=13072] ppid=13068 vsize=171060 CPUtime=161.79 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 10177 0 0 0 16165 14 0 0 20 0 3 0 331817160 175165440 19188 33554432000 4194304 5964478 140736084844064 139927029693368 4400038 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=171060 CPUtime=161.81 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 5310 0 0 0 16172 9 0 0 20 0 3 0 331817160 175165440 19188 33554432000 4194304 5964478 140736084844064 139927019202680 4399915 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.44
Current children cumulated vsize (KiB) 171060

[startup+222.3 s]
/proc/loadavg: 3.98 3.97 3.91 5/181 13077
/proc/meminfo: memFree=28079572/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171060 CPUtime=444.43 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 18114 0 0 0 44424 19 0 0 20 0 3 0 331817155 175165440 19193 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42765 19193 206 433 0 42329 0
[pid=13070/tid=13072] ppid=13068 vsize=171060 CPUtime=221.64 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 10179 0 0 0 22149 15 0 0 20 0 3 0 331817160 175165440 19193 33554432000 4194304 5964478 140736084844064 139927029693368 4403717 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=171060 CPUtime=221.66 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 5313 0 0 0 22156 10 0 0 20 0 3 0 331817160 175165440 19193 33554432000 4194304 5964478 140736084844064 139927019202680 4392918 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.43
Current children cumulated vsize (KiB) 171060

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 13077
/proc/meminfo: memFree=28068216/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171060 CPUtime=564.41 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 20041 0 0 0 56418 23 0 0 20 0 3 0 331817155 175165440 21220 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42765 21220 206 433 0 42329 0
[pid=13070/tid=13072] ppid=13068 vsize=171060 CPUtime=281.48 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 12091 0 0 0 28129 19 0 0 20 0 3 0 331817160 175165440 21220 33554432000 4194304 5964478 140736084844064 139927029692408 4403370 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=171060 CPUtime=281.5 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 5328 0 0 0 28139 11 0 0 20 0 3 0 331817160 175165440 21220 33554432000 4194304 5964478 140736084844064 139927019202920 4403512 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.41
Current children cumulated vsize (KiB) 171060

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 13077
/proc/meminfo: memFree=28043476/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=171060 CPUtime=684.39 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 24118 0 0 0 68411 28 0 0 20 0 3 0 331817155 175165440 25297 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 42765 25297 206 433 0 42329 0

################
# More data... #
################

[pid=13070/tid=13073] ppid=13068 vsize=171060 CPUtime=341.35 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 6180 0 0 0 34122 13 0 0 20 0 3 0 331817160 175165440 25297 33554432000 4194304 5964478 140736084844064 139927019202920 4403717 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 684.39
Current children cumulated vsize (KiB) 171060

[startup+402.3 s]
/proc/loadavg: 4.06 3.99 3.92 5/181 13078
/proc/meminfo: memFree=28031316/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=804.37 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 26511 0 0 0 80406 31 0 0 20 0 3 0 331817155 242274304 27690 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 27690 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=401.18 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 17627 0 0 0 40090 28 0 0 20 0 3 0 331817160 242274304 27690 33554432000 4194304 5964478 140736084844064 139927029692216 4221984 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=401.19 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 6262 0 0 0 40105 14 0 0 20 0 3 0 331817160 242274304 27690 33554432000 4194304 5964478 140736084844064 139927019202680 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 236596

[startup+462.3 s]
/proc/loadavg: 4.02 3.99 3.92 5/181 13078
/proc/meminfo: memFree=28009464/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=237680 CPUtime=924.34 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 29644 0 0 0 92398 36 0 0 20 0 3 0 331817155 243384320 30992 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59420 30992 206 433 0 58984 0
[pid=13070/tid=13072] ppid=13068 vsize=237680 CPUtime=461.01 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 20758 0 0 0 46067 34 0 0 20 0 3 0 331817160 243384320 30992 33554432000 4194304 5964478 140736084844064 139927029692456 4379152 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=237680 CPUtime=461.04 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 6264 0 0 0 46089 15 0 0 20 0 3 0 331817160 243384320 30992 33554432000 4194304 5964478 140736084844064 139927019202680 4400069 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 924.34
Current children cumulated vsize (KiB) 237680

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13078
/proc/meminfo: memFree=28005616/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1044.32 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 29908 0 0 0 104396 36 0 0 20 0 3 0 331817155 242274304 31049 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 31049 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=520.86 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 21022 0 0 0 52052 34 0 0 20 0 3 0 331817160 242274304 31049 33554432000 4194304 5964478 140736084844064 139927029693368 4403370 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=520.89 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 6264 0 0 0 52074 15 0 0 20 0 3 0 331817160 242274304 31049 33554432000 4194304 5964478 140736084844064 139927019202680 4222314 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1044.32
Current children cumulated vsize (KiB) 236596

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13078
/proc/meminfo: memFree=28002320/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1164.3 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 30705 0 0 0 116392 38 0 0 20 0 3 0 331817155 242274304 31846 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 31846 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=580.7 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 21024 0 0 0 58035 35 0 0 20 0 3 0 331817160 242274304 31846 33554432000 4194304 5964478 140736084844064 139927029693368 4400091 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=580.73 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 7059 0 0 0 58055 18 0 0 20 0 3 0 331817160 242274304 31846 33554432000 4194304 5964478 140736084844064 139927019202680 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.3
Current children cumulated vsize (KiB) 236596

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13078
/proc/meminfo: memFree=27995116/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1284.29 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 30728 0 0 0 128391 38 0 0 20 0 3 0 331817155 242274304 31918 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 31918 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=640.55 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 21046 0 0 0 64019 36 0 0 20 0 3 0 331817160 242274304 31918 33554432000 4194304 5964478 140736084844064 139927029693368 4399932 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=640.58 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 7060 0 0 0 64039 19 0 0 20 0 3 0 331817160 242274304 31918 33554432000 4194304 5964478 140736084844064 139927019202680 4399932 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.29
Current children cumulated vsize (KiB) 236596

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.92 5/182 13082
/proc/meminfo: memFree=27986800/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1404.26 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 30732 0 0 0 140388 38 0 0 20 0 3 0 331817155 242274304 31922 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 31922 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=700.39 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 21046 0 0 0 70002 37 0 0 20 0 3 0 331817160 242274304 31922 33554432000 4194304 5964478 140736084844064 139927029693368 4403370 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=700.42 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 7064 0 0 0 70022 20 0 0 20 0 3 0 331817160 242274304 31922 33554432000 4194304 5964478 140736084844064 139927019202680 4222336 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1404.26
Current children cumulated vsize (KiB) 236596

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.92 5/181 13082
/proc/meminfo: memFree=27984624/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1524.25 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 31259 0 0 0 152386 39 0 0 20 0 3 0 331817155 242274304 32449 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 32449 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=760.24 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 21046 0 0 0 75986 38 0 0 20 0 3 0 331817160 242274304 32449 33554432000 4194304 5964478 140736084844064 139927029693368 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=760.28 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 7591 0 0 0 76006 22 0 0 20 0 3 0 331817160 242274304 32449 33554432000 4194304 5964478 140736084844064 139927019202872 4403370 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1524.25
Current children cumulated vsize (KiB) 236596

[startup+822.3 s]
/proc/loadavg: 4.04 4.00 3.92 5/181 13082
/proc/meminfo: memFree=27972588/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236596 CPUtime=1644.22 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 33117 0 0 0 164381 41 0 0 20 0 3 0 331817155 242274304 34328 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59149 34328 206 433 0 58713 0
[pid=13070/tid=13072] ppid=13068 vsize=236596 CPUtime=820.09 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 22111 0 0 0 81969 40 0 0 20 0 3 0 331817160 242274304 34328 33554432000 4194304 5964478 140736084844064 139927029692408 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236596 CPUtime=820.11 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 8384 0 0 0 81986 25 0 0 20 0 3 0 331817160 242274304 34328 33554432000 4194304 5964478 140736084844064 139927019202872 4399946 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1644.22
Current children cumulated vsize (KiB) 236596

[startup+882.3 s]
/proc/loadavg: 4.08 4.02 3.93 5/181 13082
/proc/meminfo: memFree=27961916/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236956 CPUtime=1764.2 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 34804 0 0 0 176376 44 0 0 20 0 3 0 331817155 242642944 36094 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59239 36094 206 433 0 58803 0
[pid=13070/tid=13072] ppid=13068 vsize=236956 CPUtime=879.93 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 22635 0 0 0 87951 42 0 0 20 0 3 0 331817160 242642944 36094 33554432000 4194304 5964478 140736084844064 139927029692456 4400097 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236956 CPUtime=879.96 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 9547 0 0 0 87969 27 0 0 20 0 3 0 331817160 242642944 36094 33554432000 4194304 5964478 140736084844064 139927019202872 4403721 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1764.2
Current children cumulated vsize (KiB) 236956



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 3.90 3.98 3.92 5/181 13123
/proc/meminfo: memFree=28101044/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236956 CPUtime=1800.2 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 36515 0 0 0 179973 47 0 0 20 0 3 0 331817155 242642944 37805 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59239 37805 206 433 0 58803 0
[pid=13070/tid=13072] ppid=13068 vsize=236956 CPUtime=897.89 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 24223 0 0 0 89744 45 0 0 20 0 3 0 331817160 242642944 37805 33554432000 4194304 5964478 140736084844064 139927029692456 4222314 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236956 CPUtime=897.92 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 9670 0 0 0 89765 27 0 0 20 0 3 0 331817160 242642944 37805 33554432000 4194304 5964478 140736084844064 139927019202872 4222416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.2
Current children cumulated vsize (KiB) 236956

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 3.90 3.98 3.92 5/181 13123
/proc/meminfo: memFree=28101044/32873844 swapFree=7108/7108
[pid=13070] ppid=13068 vsize=236956 CPUtime=1800.2 cores=1,3,5,7
/proc/13070/stat : 13070 (pwbo2.02) S 13068 13070 10982 0 -1 4202496 36515 0 0 0 179973 47 0 0 20 0 3 0 331817155 242642944 37805 33554432000 4194304 5964478 140736084844064 140736084843584 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/13070/statm: 59239 37805 206 433 0 58803 0
[pid=13070/tid=13072] ppid=13068 vsize=236956 CPUtime=897.89 cores=1,3,5,7
/proc/13070/task/13072/stat : 13072 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 24223 0 0 0 89744 45 0 0 20 0 3 0 331817160 242642944 37805 33554432000 4194304 5964478 140736084844064 139927029692456 4222314 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=13070/tid=13073] ppid=13068 vsize=236956 CPUtime=897.92 cores=1,3,5,7
/proc/13070/task/13073/stat : 13073 (pwbo2.02) R 13068 13070 10982 0 -1 4202560 9670 0 0 0 89765 27 0 0 20 0 3 0 331817160 242642944 37805 33554432000 4194304 5964478 140736084844064 139927019202872 4222416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.2
Current children cumulated vsize (KiB) 236956

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 13070 and gives
#  childrusage.ru_utime.tv_sec=1795
#  childrusage.ru_utime.tv_usec=142096
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=751885
# CPU time returned by wait4() is 1795.89
# while last known CPU time is 1800.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.314
CPU time (s): 1800.2
CPU user time (s): 1799.73
CPU system time (s): 0.47
CPU usage (%): 199.952
Max. virtual memory (cumulated for all children) (KiB): 237680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.14
system time used= 0.751885
maximum resident set size= 151224
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36516
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 127
involuntary context switches= 1923

runsolver used 1.9737 second user time and 5.39118 second system time

The end

Launcher Data 

Begin job on node139 at 2012-06-02 19:08:46
IDJOB=3725964
IDBENCH=2940
IDSOLVER=2309
FILE ID=node139/3725964-1338656926
RUNJOBID= node139-1338651500-12376
PBS_JOBID= 14636441
Free space on /tmp= 71088 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/bounded_golomb_rulers/normalized-bogr_11.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725964-1338656926/watcher-3725964-1338656926 -o /tmp/evaluation-result-3725964-1338656926/solver-3725964-1338656926 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725964-1338656926.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c19ad978a977652a94fc03b8ce63204a
RANDOM SEED=31337993

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28199660 kB
Buffers:          483688 kB
Cached:          3229540 kB
SwapCached:          828 kB
Active:          1703572 kB
Inactive:        2096816 kB
Active(anon):      80708 kB
Inactive(anon):     7964 kB
Active(file):    1622864 kB
Inactive(file):  2088852 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67104688 kB
Dirty:             15080 kB
Writeback:             0 kB
AnonPages:         92460 kB
Mapped:            12336 kB
Shmem:                 8 kB
Slab:             732908 kB
SReclaimable:     174048 kB
SUnreclaim:       558860 kB
KernelStack:        1504 kB
PageTables:         3856 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     204128 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71084 MiB
End job on node139 at 2012-06-02 19:23:48