Trace number 4484138

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toulbar2 2025-06-13SAT (TO)2642 3600.04 3609.4

General information on the benchmark

NamePB24/normalized-PB06/OPT-LIN/web/www.ps.uni-sb.de/
~walser/benchmarks/course-ass/normalized-ws97-5.opb
MD5SUM9e8345160c873e2ecbeb2fceb1264fd1
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2642
Best CPU time to get the best result obtained on this benchmark0.045582
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables907
Total number of constraints403
Number of constraints which are clauses126
Number of constraints which are cardinality constraints (but not clauses)277
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint134
Number of terms in the objective function 748
Biggest coefficient in the objective function 240
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 33855
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 240
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 33855
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.19/0.22	o 2643
19.83/19.95	o 2642
3600.02/3609.40	o 2642
3600.02/3609.40	s SATISFIABLE
3600.02/3609.40	v x1 x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 x10 -x11 x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 x20 -x21 -x22 x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 x31 -x32 x33 -x34 -x35 -x36 x37 -x38 -x39 x40 -x41 -x42 -x43 -x44 -x45 x46 x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 x61 -x62 -x63 -x64 -x65 -x66 -x67 x68 -x69 -x70 -x71 x72 -x73 x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 x86 -x87 x88 x89 -x90 -x91 -x92 x93 x94 x95 -x96 x97 -x98 x99 -x100 -x101 -x102 -x103 -x104 x105 -x106 x107 -x108 x109 x110 -x111 -x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 x120 x121 -x122 -x123 x124 -x125 -x126 x127 -x128 -x129 -x130 -x131 -x132 -x133 x134 x135 -x136 -x137 -x138 x139 -x140 -x141 -x142 -x143 x144 -x145 -x146 x147 -x148 -x149 x150 x151 -x152 x153 x154 -x155 -x156 -x157 x158 -x159 -x160 x161 -x162 -x163 x164 x165 -x166 x167 -x168 x169 -x170 x171 -x172 -x173 -x174 -x175 x176 -x177 x178 x179 -x180 -x181 -x182 -x183 -x184 -x185 x186 -x187 x188 -x189 x190 -x191 -x192 -x193 -x194 -x195 -x196 x197 -x198 x199 -x200 x201 x202 x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 x227 x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 x237 x238 -x239 -x240 x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 x252 -x253 -x254 -x255 -x256 x257 x258 x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 x268 -x269 -x270 -x271 -x272 -x273 x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 x286 -x287 x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 x309 -x310 -x311 -x312 -x313 -x314 x315 -x316 x317 x318 x319 -x320 x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 x331 -x332 -x333 x334 x335 x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 x350 -x351 x352 -x353 -x354 x355 x356 -x357 x358 -x359 -x360 -x361 -x362 -x363 -x364 x365 x366 -x367 -x368 -x369 -x370 x371 -x372 -x373 x374 x375 -x376 x377 -x378 -x379 -x380 x381 x382 -x383 -x384 -x385 -x386 -x387 -x388 x389 -x390 -x391 x392 x393 -x394 x395 -x396 x397 -x398 -x399 -x400 -x401 -x402 -x403 x404 -x405 -x406 x407 x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 x420 -x421 x422 -x423 -x424 -x425 x426 x427 -x428 x429 -x430 -x431 x432 x433 x434 -x435 x436 x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 x456 -x457 x458 x459 -x460 -x461 -x462 x463 -x464 x465 -x466 -x467 x468 x469 x470 -x471 -x472 -x473 x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 x494 -x495 x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 x509 x510 x511 -x512 x513 x514 -x515 -x516 -x517 -x518 x519 -x520 x521 x522 x523 x524 x525 -x526 x527 x528 -x529 x530 x531 x532 x533 x534 x535 x536 -x537 x538 -x539 -x540 x541 -x542 -x543 x544 x545 -x546 x547 -x548 x549 x550 x551 -x552 -x553 -x554 x555 x556 x557 -x558 x559 x560 -x561 x562 x563 -x564 x565 -x566 -x567 x568 -x569 -x570 x571 -x572 x573 x574 -x575 x576 -x577 -x578 -x579 x580 -x581 x582 -x583 x584 x585 x586 x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 x634 -x635 -x636 -x637 -x638 -x639 -x640 x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 -x654 -x655 -x656 -x657 -x658 -x659 x660 -x661 -x662 x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 x673 -x674 -x675 -x676 -x677 -x678 -x679 x680 -x681 -x682 -x683 -x684 -x685 -x686 x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 x695 -x696 -x697 x698 -x699 -x700 -x701 -x702 -x703 x704 -x705 x706 -x707 -x708 -x709 -x710 x711 x712 x713 -x714 x715 -x716 -x717 -x718 -x719 -x720 -x721 -x722 x723 -x724 -x725 -x726 x727 x728 x729 -x730 x731 -x732 x733 -x734 -x735 -x736 -x737 -x738 x739 -x740 -x741 x742 -x743 x744 x745 x746 -x747 -x748 x749 -x750 -x751 -x752 -x753 x754 x755 -x756 x757 -x758 -x759 x760 -x761 x762 -x763 -x764 x765 x766 x767 -x768 x769 -x770 x771 x772 x773 x774 -x775 x776 -x777 -x778 -x779 x780 -x781 -x782 x783 x784 x785 x786 -x787 x788 -x789 -x790 -x791 -x792 -x793 -x794 -x795 -x796 -x797 -x798 -x799 -x800 -x801 -x802 -x803 -x804 x805 -x806 -x807 x808 -x809 x810 x811 -x812 -x813 -x814 -x815 x816 -x817 -x818 -x819 x820 -x821 x822 -x823 -x824 -x825 x826 -x827 -x828 -x829 -x830 -x831 -x832 -x833 x834 x835 -x836 x837 -x838 -x839 -x840 -x841 -x842 x843 -x844 -x845 -x846 -x847 -x848 -x849 -x850 x851 -x852 -x853 -x854 -x855 x856 -x857 x858 x859 x860 -x861 -x862 -x863 x864 -x865 x866 -x867 x868 x869 x870 x871 x872 -x873 x874 x875 -x876 x877 -x878 -x879 -x880 x881 x882 -x883 x884 x885 x886 x887 -x888 -x889 x890 -x891 x892 x893 -x894 x895 -x896 x897 x898 -x899 -x900 -x901 -x902 -x903 x904 -x905 -x906 -x907

Verifier Data 

OK	2642

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63708 MiB (62834 MiB free)
  memory of node 1: 64465 MiB (62741 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4484138-1751288234/watcher-4484138-1751288234 -o /tmp/evaluation-result-4484138-1751288234/solver-4484138-1751288234 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC019-1751281013-36619 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4484138-1751288234.opb -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=37302, runsolver pid=37299

[startup+0.10006 s]*
/proc/loadavg: 4.06 4.08 4.09 4/265 37304
/proc/meminfo: memFree=128582216/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=22224 memory=13056 CPUtime=0.09 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2346 0 0 0 9 0 0 0 20 0 1 0 44500966 22757376 3264 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5556 3264 1024 1162 0 4165 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 26416 KiB
Current children cumulated memory: 16000 KiB

[startup+0.205748 s]*
/proc/loadavg: 4.06 4.08 4.09 4/265 37304
/proc/meminfo: memFree=128582152/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23616 memory=14720 CPUtime=0.19 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2756 0 0 0 19 0 0 0 20 0 1 0 44500966 24182784 3680 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5904 3680 1024 1162 0 4513 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 27808 KiB
Current children cumulated memory: 17664 KiB

[startup+0.305583 s]*
/proc/loadavg: 4.06 4.08 4.09 3/262 37304
/proc/meminfo: memFree=129699512/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=15616 CPUtime=0.29 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2857 0 0 0 29 0 0 0 20 0 1 0 44500966 24346624 3904 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 3904 1184 1162 0 4553 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 18560 KiB

[startup+0.70017 s]
/proc/loadavg: 4.06 4.08 4.09 4/261 37321
/proc/meminfo: memFree=129706676/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=15616 CPUtime=0.68 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2858 0 0 0 68 0 0 0 20 0 1 0 44500966 24346624 3904 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 3904 1184 1162 0 4553 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 18560 KiB

[startup+1.50014 s]
/proc/loadavg: 4.06 4.08 4.09 3/260 37358
/proc/meminfo: memFree=129795260/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=15744 CPUtime=1.48 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2867 0 0 0 148 0 0 0 20 0 1 0 44500966 24346624 3936 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 3936 1184 1162 0 4553 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 18688 KiB

[startup+3.10527 s]
/proc/loadavg: 4.06 4.08 4.09 5/270 37434
/proc/meminfo: memFree=129534380/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=15744 CPUtime=3.08 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2867 0 0 0 308 0 0 0 20 0 1 0 44500966 24346624 3936 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 3936 1184 1162 0 4553 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 18688 KiB

[startup+6.30015 s]
/proc/loadavg: 4.13 4.10 4.09 5/270 37434
/proc/meminfo: memFree=129491040/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=15744 CPUtime=6.26 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2867 0 0 0 626 0 0 0 20 0 1 0 44500966 24346624 3936 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 3936 1184 1162 0 4553 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 18688 KiB

[startup+12.7001 s]
/proc/loadavg: 4.12 4.10 4.09 5/270 37434
/proc/meminfo: memFree=129476232/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=23776 memory=19584 CPUtime=12.64 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 2877 0 0 0 1264 0 0 0 20 0 1 0 44500966 24346624 4896 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 5944 4896 1184 1162 0 4553 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 27968 KiB
Current children cumulated memory: 22528 KiB

[startup+25.5002 s]
/proc/loadavg: 4.17 4.11 4.10 5/270 37436
/proc/meminfo: memFree=129477980/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=24284 memory=22600 CPUtime=25.41 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 3022 0 0 0 2541 0 0 0 20 0 1 0 44500966 24866816 5650 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 6071 5650 1184 1162 0 4680 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 28476 KiB
Current children cumulated memory: 25544 KiB

[startup+51.105 s]
/proc/loadavg: 4.11 4.10 4.09 5/270 37436
/proc/meminfo: memFree=129468416/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=24284 memory=22600 CPUtime=50.95 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 3030 0 0 0 5095 0 0 0 20 0 1 0 44500966 24866816 5650 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 6071 5650 1184 1162 0 4680 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 28476 KiB
Current children cumulated memory: 25544 KiB

[startup+102.3 s]
/proc/loadavg: 4.10 4.10 4.09 5/270 37484
/proc/meminfo: memFree=128741688/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=24956 memory=23028 CPUtime=102.01 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 3254 0 0 0 10201 0 0 0 20 0 1 0 44500966 25554944 5757 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 6239 5757 1184 1162 0 4848 0
Current children cumulated CPU time: 102.01 s
Current children cumulated vsize: 29148 KiB
Current children cumulated memory: 25972 KiB

[startup+162.3 s]
/proc/loadavg: 4.15 4.11 4.09 5/271 37487
/proc/meminfo: memFree=127034664/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=25724 memory=23468 CPUtime=161.86 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 3585 0 0 0 16186 0 0 0 20 0 1 0 44500966 26341376 5867 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 6431 5867 1184 1162 0 5040 0
Current children cumulated CPU time: 161.86 s
Current children cumulated vsize: 29916 KiB
Current children cumulated memory: 26412 KiB

[startup+222.3 s]
/proc/loadavg: 4.05 4.08 4.09 5/271 37489
/proc/meminfo: memFree=126538564/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=25724 memory=23596 CPUtime=221.7 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 3612 0 0 0 22170 0 0 0 20 0 1 0 44500966 26341376 5899 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 6431 5899 1184 1162 0 5040 0
Current children cumulated CPU time: 221.7 s
Current children cumulated vsize: 29916 KiB

################
# More data... #
################

/proc/loadavg: 4.43 4.24 4.14 5/268 37641
/proc/meminfo: memFree=125918984/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34388 CPUtime=3034.39 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5024 0 0 0 303434 5 0 0 20 0 1 0 44500966 38531072 8597 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8597 1184 1162 0 8016 0
Current children cumulated CPU time: 3034.39 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37332 KiB

[startup+3102.3 s]
/proc/loadavg: 4.21 4.20 4.13 5/268 37644
/proc/meminfo: memFree=125919360/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34388 CPUtime=3094.24 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5030 0 0 0 309419 5 0 0 20 0 1 0 44500966 38531072 8597 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8597 1184 1162 0 8016 0
Current children cumulated CPU time: 3094.24 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37332 KiB

[startup+3162.3 s]
/proc/loadavg: 4.20 4.20 4.13 5/268 37646
/proc/meminfo: memFree=125920008/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34388 CPUtime=3154.08 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5032 0 0 0 315403 5 0 0 20 0 1 0 44500966 38531072 8597 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8597 1184 1162 0 8016 0
Current children cumulated CPU time: 3154.08 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37332 KiB

[startup+3222.3 s]
/proc/loadavg: 4.33 4.25 4.16 5/269 37650
/proc/meminfo: memFree=125920388/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34388 CPUtime=3213.93 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5037 0 0 0 321388 5 0 0 20 0 1 0 44500966 38531072 8597 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8597 1184 1162 0 8016 0
Current children cumulated CPU time: 3213.93 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37332 KiB

[startup+3282.3 s]
/proc/loadavg: 4.12 4.20 4.14 5/270 37653
/proc/meminfo: memFree=125922064/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3273.77 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5038 0 0 0 327372 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3273.77 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

[startup+3342.3 s]
/proc/loadavg: 4.16 4.19 4.14 5/269 37655
/proc/meminfo: memFree=125920212/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3333.61 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5039 0 0 0 333356 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3333.61 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

[startup+3402.3 s]
/proc/loadavg: 4.12 4.17 4.14 5/268 37657
/proc/meminfo: memFree=125916636/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3393.46 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5049 0 0 0 339341 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3393.46 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

[startup+3462.3 s]
/proc/loadavg: 4.09 4.15 4.13 5/268 37658
/proc/meminfo: memFree=125916812/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3453.3 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5051 0 0 0 345325 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3453.3 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

[startup+3522.3 s]
/proc/loadavg: 4.10 4.14 4.13 5/268 37660
/proc/meminfo: memFree=125916444/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3513.15 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5051 0 0 0 351310 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3513.15 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

[startup+3582.3 s]
/proc/loadavg: 4.09 4.13 4.12 5/268 37669
/proc/meminfo: memFree=125914024/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3572.99 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5053 0 0 0 357294 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3572.99 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3609.4 s]
/proc/loadavg: 4.13 4.13 4.12 5/267 37670
/proc/meminfo: memFree=125913968/131250000 swapFree=33010684/33010684
[pid=37302] ppid=37299 vsize=4192 memory=2944 CPUtime=0 cores=4,6
/proc/37302/stat : 37302 (toulbar2.sh) S 37299 37302 36608 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 44500965 4292608 736 18446744073709551615 93931295277056 93931296171589 140732381807776 0 0 0 65536 4 65538 1 0 0 17 6 0 0 0 0 0 93931296410640 93931296458384 93931328729088 140732381817143 140732381817319 140732381817319 140732381822921 0
/proc/37302/statm: 1048 736 672 219 0 110 0
[pid=37304] ppid=37302 vsize=37628 memory=34516 CPUtime=3600.02 cores=4,6
/proc/37304/stat : 37304 (toulbar2) R 37302 37302 36608 0 -1 4194304 5053 0 0 0 359997 5 0 0 20 0 1 0 44500966 38531072 8629 18446744073709551615 4198400 8956741 140721763644416 0 0 0 0 0 33570818 0 0 0 17 4 0 0 0 0 0 9785056 9890480 12312576 140721763649909 140721763650028 140721763650028 140721763655628 0
/proc/37304/statm: 9407 8629 1184 1162 0 8016 0
Current children cumulated CPU time: 3600.02 s
Current children cumulated vsize: 41820 KiB
Current children cumulated memory: 37460 KiB

Sending SIGTERM to process tree (bottom up)

[startup+3609.4 s]
# the end of solver process 37302 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3599.98 s, system=0.059712 s

Solver just ended.
Sleeping 2 seconds
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0

Real time (s): 3609.4
CPU time (s): 3600.04
CPU user time (s): 3599.98
CPU system time (s): 0.059712
CPU usage (%): 99.7406
Max. virtual memory (cumulated for all children) (KiB): 41820
Max. memory (cumulated for all children) (KiB): 37460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3599.98
system time used= 0.059712
maximum resident set size= 35852
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5269
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 76
involuntary context switches= 1705


# summary of solver processes directly reported to runsolver:
#   pid: 37302
#   total CPU time (s): 3600.04
#   total CPU user time (s): 3599.98
#   total CPU system time (s): 0.059712

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.64249 second user time and 13.219 second system time

The end

Launcher Data 

Begin job on nodeC019 at 2025-06-30 14:57:15
IDJOB=4484138
IDBENCH=146650
IDSOLVER=3371
FILE ID=nodeC019/4484138-1751288234
RUNJOBID= nodeC019-1751281013-36619
SLURM_JOB_ID= 9594232
Free space on /tmp= 433020 MiB

SOLVER NAME= toulbar2 2025-06-13
BENCH NAME= PB24/normalized-PB06/OPT-LIN/web/www.ps.uni-sb.de/~walser/benchmarks/course-ass/normalized-ws97-5.opb
COMMAND LINE= toulbar2.sh toulbar2 BENCHNAME -timer=TIMELIMIT -hve=512 -f=3 -n: -precision=0
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4484138-1751288234/watcher-4484138-1751288234 -o /tmp/evaluation-result-4484138-1751288234/solver-4484138-1751288234 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC019-1751281013-36619 --watchdog 3760  toulbar2.sh toulbar2 HOME/instance-4484138-1751288234.opb -timer=3600 -hve=512 -f=3 -n: -precision=0

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 9e8345160c873e2ecbeb2fceb1264fd1
RANDOM SEED=763706356

nodeC019 Linux 5.14.0-503.14.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 15 12:04:32 UTC 2024

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.651
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.334
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.450
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3597.972
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3607.214
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.400
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.665
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3597.934
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131250000 kB
MemFree:        128590028 kB
MemAvailable:   128569352 kB
Buffers:            3280 kB
Cached:           787416 kB
SwapCached:            0 kB
Active:          1539004 kB
Inactive:         530536 kB
Active(anon):    1296908 kB
Inactive(anon):        0 kB
Active(file):     242096 kB
Inactive(file):   530536 kB
Unevictable:        3072 kB
Mlocked:               0 kB
SwapTotal:      33010684 kB
SwapFree:       33010684 kB
Zswap:                 0 kB
Zswapped:              0 kB
Dirty:              6596 kB
Writeback:             0 kB
AnonPages:       1278384 kB
Mapped:           113196 kB
Shmem:             18064 kB
KReclaimable:      91864 kB
Slab:             177720 kB
SReclaimable:      91864 kB
SUnreclaim:        85856 kB
KernelStack:        4416 kB
PageTables:         5608 kB
SecPageTables:         0 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    98635684 kB
Committed_AS:    1600176 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      150600 kB
VmallocChunk:          0 kB
Percpu:             3776 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1189888 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
CmaTotal:              0 kB
CmaFree:               0 kB
Unaccepted:            0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      176852 kB
DirectMap2M:     9031680 kB
DirectMap1G:    126877696 kB

Free space on /tmp at the end= 433020 MiB
End job on nodeC019 at 2025-06-30 15:57:24