Trace number 4526363

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toulbar2 2025-06-13MSAT (TO) 3600.07 3610.3

General information on the benchmark

NamePB24/WBO/PARTIAL-LIN/wcsp/spot5/
normalized-spot5-509_wcsp.wbo
MD5SUM506a92b17493b20cc36a94510db5babf
Bench CategoryPARTIAL-LIN (WBO, both soft and hard constraints, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark36446
Best CPU time to get the best result obtained on this benchmark1.64065
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables1000
Total number of constraints12591
Number of soft constraints12243
Number of constraints which are clauses12243
Number of constraints which are cardinality constraints (but not clauses)348
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint4
Top cost 55572
Min constraint cost 1
Max constraint cost 55572
Sum of constraints costs 661084511
Biggest number in a constraint 2
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 5
Number of bits of the biggest sum of numbers3
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.68/0.79	o 45483
0.78/0.90	o 45476
0.88/0.91	o 44479
0.88/1.00	o 44478
0.98/1.01	o 43479
0.98/1.05	o 43478
1.18/1.26	o 43476
1.18/1.26	o 42481
1.18/1.27	o 42480
1.18/1.27	o 42479
1.18/1.27	o 42478
1.18/1.29	o 41480
1.28/1.31	o 41479
1.28/1.32	o 41478
1.28/1.32	o 41477
1.28/1.32	o 41475
1.28/1.35	o 40476
1.28/1.36	o 40475
1.38/1.41	o 40474
1.38/1.43	o 39477
1.38/1.45	o 39476
1.38/1.45	o 39475
1.38/1.49	o 38477
1.38/1.49	o 38476
1.48/1.51	o 38475
1.48/1.53	o 38473
1.48/1.53	o 38472
1.48/1.57	o 38470
1.48/1.57	o 38468
1.58/1.62	o 38467
1.58/1.64	o 38466
1.58/1.67	o 38461
1.58/1.68	o 38460
1.58/1.68	o 38459
1.58/1.69	o 38458
1.58/1.69	o 38457
1.68/1.70	o 38456
1.68/1.75	o 38455
1.68/1.77	o 37463
2.17/2.27	o 37461
2.47/2.53	o 37457
360.33/361.48	o 37449
360.42/361.54	o 36455
360.42/361.54	o 36454
360.42/361.54	o 36453
360.42/361.54	o 36452
3600.05/3610.30	o 36452
3600.05/3610.30	s SATISFIABLE
3600.05/3610.30	v -x1 x2 -x3 -x4 -x5 x6 -x7 -x8 -x9 -x10 x11 -x12 -x13 x14 -x15 -x16 -x17 x18 -x19 x20 -x21 x22 x23 -x24 -x25 -x26 -x27 x28 -x29 x30 -x31 -x32 -x33 -x34 -x35 x36 -x37 x38 -x39 x40 -x41 x42 -x43 x44 -x45 x46 x47 -x48 -x49 x50 -x51 x52 -x53 -x54 -x55 -x56 -x57 x58 -x59 x60 -x61 x62 -x63 x64 -x65 x66 x67 -x68 -x69 x70 -x71 x72 -x73 x74 -x75 -x76 -x77 x78 -x79 x80 -x81 -x82 x83 -x84 -x85 -x86 -x87 x88 -x89 x90 -x91 x92 -x93 -x94 x95 -x96 -x97 x98 x99 -x100 -x101 x102 -x103 x104 x105 -x106 -x107 x108 x109 -x110 -x111 x112 x113 -x114 -x115 x116 -x117 x118 -x119 x120 -x121 x122 -x123 x124 -x125 -x126 -x127 x128 -x129 x130 -x131 x132 -x133 x134 -x135 x136 -x137 x138 -x139 x140 -x141 -x142 -x143 x144 -x145 -x146 -x147 x148 -x149 x150 -x151 -x152 -x153 x154 -x155 x156 -x157 x158 -x159 x160 -x161 x162 -x163 x164 -x165 x166 -x167 x168 -x169 x170 -x171 -x172 x173 -x174 -x175 x176 x177 -x178 x179 -x180 -x181 x182 x183 -x184 -x185 x186 -x187 x188 x189 -x190 -x191 x192 -x193 x194 x195 -x196 x197 -x198 -x199 -x200 -x201 x202 -x203 -x204 -x205 x206 -x207 -x208 x209 -x210 x211 -x212 -x213 -x214 -x215 x216 -x217 -x218 -x219 x220 -x221 -x222 -x223 x224 -x225 x226 -x227 x228 -x229 -x230 -x231 x232 -x233 x234 -x235 x236 -x237 -x238 x239 -x240 -x241 x242 -x243 x244 -x245 x246 x247 -x248 -x249 -x250 -x251 -x252 -x253 x254 -x255 x256 -x257 -x258 -x259 x260 -x261 x262 -x263 -x264 x265 -x266 -x267 x268 -x269 x270 -x271 x272 x273 -x274 -x275 -x276 -x277 x278 -x279 x280 -x281 -x282 -x283 x284 -x285 -x286 -x287 x288 -x289 x290 -x291 x292 -x293 -x294 x295 -x296 -x297 x298 -x299 x300 -x301 x302 -x303 x304 x305 -x306 -x307 -x308 -x309 x310 -x311 x312 -x313 x314 x315 -x316 -x317 x318 -x319 x320 -x321 x322 -x323 x324 -x325 -x326 x327 -x328 -x329 x330 x331 -x332 -x333 -x334 x335 -x336 -x337 x338 -x339 x340 -x341 x342 -x343 -x344 -x345 -x346 -x347 x348 x349 -x350 -x351 -x352 -x353 x354 -x355 -x356 -x357 x358 -x359 -x360 -x361 x362 -x363 x364 -x365 x366 -x367 -x368 -x369 x370 -x371 -x372 -x373 x374 x375 -x376 -x377 x378 -x379 x380 -x381 -x382 -x383 x384 -x385 x386 -x387 x388 -x389 -x390 -x391 -x392 x393 -x394 x395 -x396 -x397 -x398 -x399 -x400 -x401 x402 -x403 x404 -x405 -x406 x407 -x408 x409 -x410 -x411 -x412 -x413 x414 -x415 -x416 -x417 -x418 x419 -x420 x421 -x422 -x423 -x424 -x425 x426 -x427 x428 -x429 -x430 x431 -x432 -x433 x434 -x435 -x436 -x437 x438 -x439 x440 -x441 x442 -x443 x444 x445 -x446 -x447 x448 -x449 -x450 -x451 x452 -x453 x454 x455 -x456 -x457 -x458 -x459 x460 -x461 -x462 -x463 x464 -x465 x466 -x467 x468 -x469 x470 -x471 x472 -x473 x474 -x475 -x476 -x477 x478 -x479 x480 -x481 -x482 -x483 x484 -x485 -x486 -x487 x488 -x489 x490 -x491 x492 -x493 x494 -x495 x496 x497 -x498 -x499 x500 -x501 x502 -x503 x504 -x505 x506 -x507 x508 -x509 x510 -x511 x512 -x513 -x514 -x515 x516 x517 -x518 -x519 x520 -x521 -x522 -x523 x524 -x525 x526 -x527 -x528 x529 -x530 -x531 x532 x533 -x534 -x535 -x536 -x537 x538 -x539 -x540 -x541 x542 -x543 x544 -x545 x546 -x547 -x548 -x549 x550 -x551 x552 -x553 x554 -x555 x556 -x557 -x558 -x559 x560 -x561 x562 -x563 -x564 x565 -x566 -x567 -x568 -x569 x570 -x571 x572 x573 -x574 -x575 -x576 -x577 -x578 -x579 x580 -x581 x582 -x583 x584 -x585 -x586 -x587 x588 -x589 x590 -x591 -x592 -x593 x594 -x595 -x596 -x597 x598 -x599 -x600 -x601 x602 -x603 -x604 -x605 x606 -x607 x608 -x609 x610 -x611 x612 -x613 x614 -x615 -x616 -x617 x618 -x619 -x620 x621 -x622 -x623 x624 x625 -x626 -x627 -x628 -x629 x630 -x631 x632 -x633 -x634 -x635 x636 -x637 -x638 -x639 x640 -x641 -x642 -x643 x644 -x645 x646 -x647 x648 -x649 x650 -x651 x652 -x653 x654 -x655 -x656 -x657 x658 -x659 -x660 -x661 x662 -x663 -x664 -x665 x666 -x667 x668 -x669 -x670 -x671 x672 -x673 x674 -x675 x676 -x677 x678 -x679 -x680 -x681 x682 -x683 -x684 -x685 x686 -x687 -x688 -x689 x690 x691 -x692 -x693 -x694 -x695 -x696 -x697 x698 -x699 -x700 -x701 x702 -x703 x704 -x705 -x706 -x707 x708 -x709 -x710 x711 -x712 -x713 x714 -x715 x716 -x717 -x718 -x719 x720 -x721 -x722 -x723 x724 -x725 -x726 -x727 x728 -x729 x730 -x731 x732 -x733 -x734 -x735 x736 -x737 -x738 -x739 x740 -x741 -x742 -x743 x744 -x745 -x746 -x747 x748 -x749 -x750 -x751 x752 -x753 x754 x755 -x756 -x757 -x758 -x759 x760 -x761 -x762 -x763 -x764 -x765 x766 -x767 -x768 -x769 x770 -x771 -x772 -x773 x774 -x775 -x776 -x777 x778 -x779 x780 -x781 x782 -x783 x784 -x785 x786 -x787 -x788 -x789 x790 -x791 -x792 -x793 x794 -x795 x796 -x797 -x798 -x799 x800 x801 -x802 -x803 -x804 -x805 x806 -x807 -x808 -x809 -x810 x811 -x812 -x813 x814 -x815 x816 -x817 x818 -x819 -x820 -x821 x822 -x823 x824 -x825 -x826 -x827 x828 -x829 -x830 -x831 x832 -x833 -x834 -x835 x836 x837 -x838 -x839 -x840 -x841 -x842 -x843 x844 -x845 x846 -x847 -x848 -x849 -x850 x851 -x852 -x853 x854 -x855 x856 -x857 x858 -x859 x860 -x861 -x862 -x863 x864 -x865 -x866 -x867 x868 -x869 -x870 -x871 x872 -x873 x874 -x875 x876 -x877 x878 -x879 x880 -x881 x882 -x883 x884 -x885 -x886 -x887 x888 -x889 -x890 -x891 x892 -x893 x894 -x895 -x896 -x897 x898 x899 -x900 -x901 -x902 -x903 -x904 -x905 x906 -x907 x908 -x909 -x910 -x911 -x912 -x913 x914 -x915 x916 -x917 -x918 -x919 x920 -x921 x922 -x923 -x924 -x925 x926 -x927 x928 -x929 -x930 -x931 x932 -x933 -x934 x935 -x936 -x937 x938 -x939 -x940 -x941 x942 -x943 -x944 -x945 x946 -x947 -x948 -x949 x950 -x951 x952 -x953 -x954 x955 -x956 -x957 -x958 -x959 -x960 -x961 x962 -x963 -x964 x965 -x966 -x967 x968 -x969 -x970 x971 -x972 -x973 -x974 -x975 -x976 x977 -x978 -x979 -x980 x981 -x982 x983 -x984 -x985 -x986 -x987 -x988 x989 -x990 -x991 x992 -x993 -x994 x995 -x996 -x997 x998 x999 -x1000

Verifier Data

OK	36452

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63708 MiB (62793 MiB free)
  memory of node 1: 64465 MiB (47725 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4526363-1751630522/watcher-4526363-1751630522 -o /tmp/evaluation-result-4526363-1751630522/solver-4526363-1751630522 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC035-1751623294-89821 --watchdog 3760 toulbar2.sh toulbar2 HOME/instance-4526363-1751630522.wbo -timer=3600 -hve=512 -f=3 -n: -precision=0 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 5.14.0-503.14.1.el9_5.x86_64
Current StackSize limit: 8192 KiB

solver pid=90973, runsolver pid=90970

[startup+0.100061 s]*
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113127948/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=63276 memory=53504 CPUtime=0.09 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 12603 0 0 0 8 1 0 0 20 0 1 0 78726770 64794624 13376 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 15819 13376 928 1162 0 14428 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 67468 KiB
Current children cumulated memory: 56448 KiB

[startup+0.205554 s]*
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113082840/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=109732 memory=100008 CPUtime=0.19 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 24239 0 0 0 16 3 0 0 20 0 1 0 78726770 112365568 25002 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 27433 25002 992 1162 0 26042 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 113924 KiB
Current children cumulated memory: 102952 KiB

[startup+0.305464 s]*
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113076036/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=116828 memory=107096 CPUtime=0.29 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 26095 0 0 0 26 3 0 0 20 0 1 0 78726770 119631872 26774 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 29207 26774 1024 1162 0 27816 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 121020 KiB
Current children cumulated memory: 110040 KiB

[startup+0.700196 s]
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113068980/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=133356 memory=123736 CPUtime=0.68 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 30237 0 0 0 64 4 0 0 20 0 1 0 78726770 136556544 30934 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 33339 30934 1024 1162 0 31948 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 137548 KiB
Current children cumulated memory: 126680 KiB

[startup+1.50021 s]
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113052852/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=139420 memory=131288 CPUtime=1.48 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 31987 0 0 0 144 4 0 0 20 0 1 0 78726770 142766080 32822 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 34855 32822 1184 1162 0 33464 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 143612 KiB
Current children cumulated memory: 134232 KiB

[startup+3.10536 s]
/proc/loadavg: 4.11 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113045544/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=140852 memory=132440 CPUtime=3.08 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 32289 0 0 0 304 4 0 0 20 0 1 0 78726770 144232448 33110 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 35213 33110 1184 1162 0 33822 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 145044 KiB
Current children cumulated memory: 135384 KiB

[startup+6.30016 s]
/proc/loadavg: 4.10 4.15 4.15 5/267 90975
/proc/meminfo: memFree=113033508/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=141620 memory=133080 CPUtime=6.26 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 32439 0 0 0 622 4 0 0 20 0 1 0 78726770 145018880 33270 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 35405 33270 1184 1162 0 34014 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 145812 KiB
Current children cumulated memory: 136024 KiB

[startup+12.7002 s]
/proc/loadavg: 4.09 4.14 4.15 5/267 90975
/proc/meminfo: memFree=113042076/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=141620 memory=133208 CPUtime=12.64 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 32477 0 0 0 1260 4 0 0 20 0 1 0 78726770 145018880 33302 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 35405 33302 1184 1162 0 34014 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 145812 KiB
Current children cumulated memory: 136152 KiB

[startup+25.5002 s]
/proc/loadavg: 4.07 4.14 4.14 5/267 90975
/proc/meminfo: memFree=113029716/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=142392 memory=134104 CPUtime=25.41 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 32692 0 0 0 2536 5 0 0 20 0 1 0 78726770 145809408 33526 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 35598 33526 1184 1162 0 34207 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 146584 KiB
Current children cumulated memory: 137048 KiB

[startup+51.1053 s]
/proc/loadavg: 4.04 4.12 4.14 5/267 90976
/proc/meminfo: memFree=113023552/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=143548 memory=134680 CPUtime=50.94 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 33273 0 0 0 5089 5 0 0 20 0 1 0 78726770 146993152 33670 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 35887 33670 1184 1162 0 34496 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 147740 KiB
Current children cumulated memory: 137624 KiB

[startup+102.3 s]
/proc/loadavg: 4.06 4.12 4.13 5/268 91071
/proc/meminfo: memFree=126382436/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=146620 memory=136760 CPUtime=101.98 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 34082 0 0 0 10193 5 0 0 20 0 1 0 78726770 150138880 34190 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 36655 34190 1184 1162 0 35264 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 150812 KiB
Current children cumulated memory: 139704 KiB

[startup+162.3 s]
/proc/loadavg: 4.12 4.12 4.13 5/268 91210
/proc/meminfo: memFree=126315308/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=152764 memory=143148 CPUtime=161.81 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 35150 0 0 0 16175 6 0 0 20 0 1 0 78726770 156430336 35787 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 38191 35787 1184 1162 0 36800 0
Current children cumulated CPU time: 161.81 s
Current children cumulated vsize: 156956 KiB
Current children cumulated memory: 146092 KiB

[startup+222.3 s]
/proc/loadavg: 4.14 4.13 4.13 5/268 91533
/proc/meminfo: memFree=122072320/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=152764 memory=143532 CPUtime=221.62 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 35270 0 0 0 22155 7 0 0 20 0 1 0 78726770 156430336 35883 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 38191 35883 1184 1162 0 36800 0
Current children cumulated CPU time: 221.62 s
Current children cumulated vsize: 156956 KiB
Current children cumulated memory: 146476 KiB

################
# More data... #
################

/proc/90975/statm: 44375 43315 1184 1162 0 42984 0
Current children cumulated CPU time: 3093.46 s
Current children cumulated vsize: 181692 KiB
Current children cumulated memory: 176204 KiB

[startup+3162.3 s]
/proc/loadavg: 3.74 4.03 4.06 4/260 92121
/proc/meminfo: memFree=126158992/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=177500 memory=173260 CPUtime=3153.29 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37273 0 0 0 315320 9 0 0 20 0 1 0 78726770 181760000 43315 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 44375 43315 1184 1162 0 42984 0
Current children cumulated CPU time: 3153.29 s
Current children cumulated vsize: 181692 KiB
Current children cumulated memory: 176204 KiB

[startup+3222.3 s]
/proc/loadavg: 3.33 3.85 4.00 4/260 92123
/proc/meminfo: memFree=126140980/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=174396 CPUtime=3213.13 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37634 0 0 0 321303 10 0 0 20 0 1 0 78726770 206925824 43599 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 43599 1184 1162 0 49128 0
Current children cumulated CPU time: 3213.13 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 177340 KiB

[startup+3282.3 s]
/proc/loadavg: 3.17 3.71 3.94 4/260 92125
/proc/meminfo: memFree=126141100/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=174396 CPUtime=3272.96 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37643 0 0 0 327286 10 0 0 20 0 1 0 78726770 206925824 43599 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 43599 1184 1162 0 49128 0
Current children cumulated CPU time: 3272.96 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 177340 KiB

[startup+3342.3 s]
/proc/loadavg: 3.13 3.60 3.88 4/260 92128
/proc/meminfo: memFree=126101580/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=174396 CPUtime=3332.79 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37645 0 0 0 333269 10 0 0 20 0 1 0 78726770 206925824 43599 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 43599 1184 1162 0 49128 0
Current children cumulated CPU time: 3332.79 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 177340 KiB

[startup+3402.3 s]
/proc/loadavg: 3.10 3.50 3.83 4/261 92133
/proc/meminfo: memFree=126102108/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=176476 CPUtime=3392.63 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37655 0 0 0 339253 10 0 0 20 0 1 0 78726770 206925824 44119 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44119 1184 1162 0 49128 0
Current children cumulated CPU time: 3392.63 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 179420 KiB

[startup+3462.3 s]
/proc/loadavg: 3.08 3.42 3.78 4/261 92135
/proc/meminfo: memFree=126102228/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=176476 CPUtime=3452.46 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37659 0 0 0 345236 10 0 0 20 0 1 0 78726770 206925824 44119 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44119 1184 1162 0 49128 0
Current children cumulated CPU time: 3452.46 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 179420 KiB

[startup+3522.3 s]
/proc/loadavg: 3.06 3.36 3.74 4/261 92137
/proc/meminfo: memFree=126098488/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=176476 CPUtime=3512.29 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37663 0 0 0 351219 10 0 0 20 0 1 0 78726770 206925824 44119 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44119 1184 1162 0 49128 0
Current children cumulated CPU time: 3512.29 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 179420 KiB

[startup+3582.3 s]
/proc/loadavg: 3.06 3.30 3.69 4/261 92150
/proc/meminfo: memFree=126100248/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=176476 CPUtime=3572.13 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37665 0 0 0 357203 10 0 0 20 0 1 0 78726770 206925824 44119 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44119 1184 1162 0 49128 0
Current children cumulated CPU time: 3572.13 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 179420 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3610.3 s]
/proc/loadavg: 3.10 3.29 3.68 4/261 92150
/proc/meminfo: memFree=126100248/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=178572 CPUtime=3600.05 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37668 0 0 0 359995 10 0 0 20 0 1 0 78726770 206925824 44643 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44643 1184 1162 0 49128 0
Current children cumulated CPU time: 3600.05 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 181516 KiB

Sending SIGTERM to process tree (bottom up)

[startup+3610.3 s]
# the end of solver process 90973 was just reported to runsolver
# Child ended because it received signal 15 (SIGTERM)

# cumulated CPU time of all completed processes:  user=0 s, system=0.002008 s
Sleeping 2 seconds

[startup+3610.3 s]
# the end of solver process 90975 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3599.96 s, system=0.110389 s
# this solver process was not waited by its parent and was adopted by runsolver

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3610.3 s]
/proc/loadavg: 3.10 3.29 3.68 4/261 92150
/proc/meminfo: memFree=126100248/131249992 swapFree=33009392/33010684
[pid=90973] ppid=90970 vsize=4192 memory=2944 CPUtime=0 cores=0,2
/proc/90973/stat : 90973 (toulbar2.sh) S 90970 90973 89811 0 -1 4194304 203 0 0 0 0 0 0 0 20 0 1 0 78726770 4292608 736 18446744073709551615 94259483246592 94259484141125 140731925749600 0 0 0 65536 4 65538 1 0 0 17 2 0 0 0 0 0 94259484380176 94259484427920 94259489984512 140731925752117 140731925752293 140731925752293 140731925757897 0
/proc/90973/statm: 1048 736 672 219 0 110 0
[pid=90975] ppid=90973 vsize=202076 memory=178572 CPUtime=3600.05 cores=0,2
/proc/90975/stat : 90975 (toulbar2) R 90973 90973 89811 0 -1 4194304 37668 0 0 0 359995 10 0 0 20 0 1 0 78726770 206925824 44643 18446744073709551615 4198400 8956741 140722894339472 0 0 0 0 0 33570818 0 0 0 17 0 0 0 0 0 0 9785056 9890480 24236032 140722894342515 140722894342634 140722894342634 140722894348236 0
/proc/90975/statm: 50519 44643 1184 1162 0 49128 0
Current children cumulated CPU time: 3600.05 s
Current children cumulated vsize: 206268 KiB
Current children cumulated memory: 181516 KiB

Child status: 0

Real time (s): 3610.3
CPU time (s): 3600.07
CPU user time (s): 3599.96
CPU system time (s): 0.110389
CPU usage (%): 99.7164
Max. virtual memory (cumulated for all children) (KiB): 230848
Max. memory (cumulated for all children) (KiB): 201920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3599.96
system time used= 0.110389
maximum resident set size= 198976
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37872
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 90
involuntary context switches= 8647


# summary of solver processes directly reported to runsolver:
#   pid: 90973,90975
#   total CPU time (s): 3600.07
#   total CPU user time (s): 3599.96
#   total CPU system time (s): 0.110389

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.0264 second user time and 15.4917 second system time

The end

Launcher Data

Begin job on nodeC035 at 2025-07-04 14:02:02
IDJOB=4526363
IDBENCH=144048
IDSOLVER=3383
FILE ID=nodeC035/4526363-1751630522
RUNJOBID= nodeC035-1751623294-89821
SLURM_JOB_ID= 9598943
Free space on /tmp= 432756 MiB

SOLVER NAME= toulbar2 2025-06-13
BENCH NAME= PB24/WBO/PARTIAL-LIN/wcsp/spot5/normalized-spot5-509_wcsp.wbo
COMMAND LINE= toulbar2.sh toulbar2 BENCHNAME -timer=TIMELIMIT -hve=512 -f=3 -n: -precision=0
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4526363-1751630522/watcher-4526363-1751630522 -o /tmp/evaluation-result-4526363-1751630522/solver-4526363-1751630522 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC035-1751623294-89821 --watchdog 3760  toulbar2.sh toulbar2 HOME/instance-4526363-1751630522.wbo -timer=3600 -hve=512 -f=3 -n: -precision=0

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 506a92b17493b20cc36a94510db5babf
RANDOM SEED=1041216464

nodeC035 Linux 5.14.0-503.14.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 15 12:04:32 UTC 2024

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3598.068
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.779
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.772
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.465
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.736
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.764
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3605.388
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3625.981
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_violation_ve
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit mmio_stale_data
bogomips	: 6999.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131249992 kB
MemFree:        113171724 kB
MemAvailable:   115842548 kB
Buffers:             664 kB
Cached:          3420676 kB
SwapCached:          332 kB
Active:         14138048 kB
Inactive:        3118328 kB
Active(anon):   13831684 kB
Inactive(anon):    21052 kB
Active(file):     306364 kB
Inactive(file):  3097276 kB
Unevictable:        3072 kB
Mlocked:               0 kB
SwapTotal:      33010684 kB
SwapFree:       33009392 kB
Zswap:                 0 kB
Zswapped:              0 kB
Dirty:              6588 kB
Writeback:             0 kB
AnonPages:      13837560 kB
Mapped:           118444 kB
Shmem:             17700 kB
KReclaimable:     212844 kB
Slab:             303928 kB
SReclaimable:     212844 kB
SUnreclaim:        91084 kB
KernelStack:        4268 kB
PageTables:        30368 kB
SecPageTables:         0 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    98635680 kB
Committed_AS:   14390540 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      150600 kB
VmallocChunk:          0 kB
Percpu:             3776 kB
HardwareCorrupted:     0 kB
AnonHugePages:    598016 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
CmaTotal:              0 kB
CmaFree:               0 kB
Unaccepted:            0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      205524 kB
DirectMap2M:     7954432 kB
DirectMap1G:    127926272 kB

Free space on /tmp at the end= 432712 MiB
End job on nodeC035 at 2025-07-04 15:02:13