Trace number 3299494

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095SAT 2253.09 564.219

General information on the benchmark

NameCRAFTED/rbsat/random/forced/
rbsat-v945c61409gyes5.cnf
MD5SUMccc3b90e7796ba48b01939580fe6357c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark4.34434
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...051763/instance-3299494-1304051763.cnf
0.09/0.16	c Solving...
2252.81/564.14	c Answer: 1
2252.81/564.14	v -1 -2 -3 -4 -5 -6 -7 -8 -9 -10 -11 -12 -13 -14 15 -16 -17 -18 -19 -20 -21
2252.81/564.14	v -22 -23 -24 -25 -26 -27 -28 -29 -30 -31 -32 -33 -34 -35 -36 -37 -38 -39
2252.81/564.14	v -40 -41 42 -43 -44 45 -46 -47 -48 -49 -50 -51 -52 -53 -54 -55 -56 -57 -58
2252.81/564.14	v -59 -60 -61 -62 -63 -64 -65 -66 -67 -68 -69 -70 -71 -72 -73 74 -75 -76
2252.81/564.14	v -77 -78 -79 -80 -81 -82 -83 -84 -85 -86 -87 -88 -89 -90 -91 -92 -93 -94
2252.81/564.14	v 95 -96 -97 -98 -99 -100 -101 -102 -103 -104 -105 -106 -107 -108 -109 -110
2252.81/564.14	v -111 -112 -113 -114 -115 -116 117 -118 -119 -120 -121 -122 -123 -124 -125
2252.81/564.14	v -126 -127 -128 -129 -130 -131 -132 -133 -134 -135 -136 -137 -138 -139 -140
2252.81/564.14	v -141 -142 -143 144 -145 -146 -147 -148 -149 -150 -151 -152 -153 -154 -155
2252.81/564.14	v 156 -157 -158 -159 -160 -161 -162 -163 -164 -165 -166 -167 -168 -169 -170
2252.81/564.14	v -171 -172 -173 -174 -175 -176 -177 -178 -179 -180 181 -182 -183 -184 -185
2252.81/564.14	v -186 -187 -188 -189 -190 -191 -192 -193 -194 -195 -196 -197 -198 -199 -200
2252.81/564.14	v -201 -202 203 -204 -205 -206 -207 -208 -209 -210 -211 -212 213 -214 -215
2252.81/564.14	v -216 -217 -218 -219 -220 -221 -222 -223 -224 -225 -226 -227 -228 -229 -230
2252.81/564.14	v -231 232 -233 -234 -235 -236 -237 -238 -239 -240 -241 -242 -243 -244 -245
2252.81/564.14	v -246 -247 -248 -249 -250 -251 -252 -253 -254 -255 256 -257 -258 -259 -260
2252.81/564.14	v -261 -262 -263 -264 -265 -266 -267 -268 -269 -270 -271 -272 -273 -274 -275
2252.81/564.14	v -276 -277 -278 -279 -280 -281 -282 -283 -284 -285 -286 -287 288 -289 -290
2252.81/564.14	v -291 -292 -293 -294 -295 -296 -297 -298 -299 -300 -301 -302 -303 304 -305
2252.81/564.14	v -306 -307 -308 -309 -310 -311 -312 -313 -314 -315 -316 -317 -318 -319 -320
2252.81/564.14	v -321 -322 -323 -324 -325 -326 -327 -328 329 -330 -331 -332 -333 -334 -335
2252.81/564.14	v -336 -337 -338 339 -340 -341 -342 -343 -344 -345 -346 -347 -348 -349 -350
2252.81/564.14	v -351 -352 -353 -354 -355 -356 -357 -358 -359 -360 -361 -362 -363 -364 -365
2252.81/564.14	v -366 -367 -368 -369 -370 -371 -372 -373 -374 375 -376 -377 -378 -379 -380
2252.81/564.14	v -381 -382 -383 384 -385 -386 -387 -388 -389 -390 -391 -392 -393 -394 -395
2252.81/564.14	v -396 -397 -398 -399 -400 -401 -402 403 -404 -405 -406 -407 -408 -409 -410
2252.81/564.14	v -411 -412 -413 -414 -415 -416 -417 -418 -419 -420 -421 -422 -423 -424 -425
2252.81/564.14	v -426 -427 -428 429 -430 -431 -432 -433 -434 -435 -436 -437 -438 -439 -440
2252.81/564.14	v -441 -442 443 -444 -445 -446 -447 -448 -449 -450 -451 -452 -453 -454 -455
2252.81/564.14	v -456 -457 -458 -459 -460 -461 -462 -463 -464 -465 -466 -467 -468 -469 -470
2252.81/564.14	v -471 -472 -473 -474 -475 -476 -477 -478 -479 480 -481 -482 -483 -484 485
2252.81/564.14	v -486 -487 -488 -489 -490 -491 -492 -493 -494 -495 -496 -497 -498 -499 -500
2252.81/564.14	v -501 -502 -503 -504 -505 -506 -507 -508 -509 -510 -511 -512 -513 -514 -515
2252.81/564.14	v -516 -517 -518 -519 -520 -521 -522 -523 -524 525 -526 -527 -528 -529 -530
2252.81/564.14	v -531 -532 -533 -534 -535 -536 537 -538 -539 -540 -541 -542 -543 -544 -545
2252.81/564.14	v -546 -547 -548 -549 550 -551 -552 -553 -554 -555 -556 -557 -558 -559 -560
2252.81/564.14	v -561 -562 -563 -564 -565 -566 -567 -568 -569 -570 -571 -572 -573 -574 -575
2252.81/564.14	v 576 -577 -578 -579 -580 -581 -582 -583 -584 -585 -586 -587 -588 -589 -590
2252.81/564.14	v -591 -592 -593 -594 -595 -596 -597 -598 -599 -600 -601 -602 -603 -604 -605
2252.81/564.14	v -606 -607 -608 609 610 -611 -612 -613 -614 -615 -616 -617 -618 -619 -620
2252.81/564.14	v -621 -622 -623 -624 -625 -626 -627 -628 -629 -630 -631 -632 -633 -634 -635
2252.81/564.14	v -636 -637 -638 -639 -640 -641 -642 643 -644 -645 -646 -647 -648 -649 -650
2252.81/564.14	v -651 -652 -653 -654 -655 -656 -657 -658 -659 -660 -661 -662 -663 -664 665
2252.81/564.14	v -666 -667 -668 -669 -670 -671 -672 -673 -674 -675 -676 -677 -678 -679 -680
2252.81/564.14	v -681 -682 -683 -684 -685 -686 687 -688 -689 -690 -691 -692 -693 -694 -695
2252.81/564.14	v -696 -697 -698 -699 -700 -701 -702 -703 -704 -705 706 -707 -708 -709 -710
2252.81/564.14	v -711 -712 -713 -714 -715 -716 -717 -718 719 -720 -721 -722 -723 -724 -725
2252.81/564.14	v -726 -727 -728 -729 -730 -731 -732 -733 -734 -735 -736 -737 -738 739 -740
2252.81/564.14	v -741 -742 -743 -744 -745 -746 -747 -748 -749 -750 -751 -752 -753 -754 -755
2252.81/564.14	v -756 -757 -758 759 -760 -761 -762 -763 -764 -765 -766 -767 -768 -769 -770
2252.81/564.14	v -771 -772 -773 -774 -775 -776 -777 -778 -779 -780 -781 -782 -783 -784 -785
2252.81/564.14	v -786 -787 -788 -789 -790 -791 -792 -793 -794 795 -796 -797 -798 -799 -800
2252.81/564.14	v -801 -802 -803 -804 -805 -806 -807 808 -809 -810 -811 -812 -813 -814 -815
2252.81/564.14	v -816 -817 -818 -819 -820 -821 -822 -823 -824 -825 -826 -827 -828 -829 -830
2252.81/564.14	v -831 832 -833 -834 -835 -836 -837 -838 -839 -840 -841 -842 -843 -844 -845
2252.81/564.14	v -846 -847 -848 849 -850 -851 -852 -853 -854 -855 -856 -857 -858 -859 -860
2252.81/564.14	v -861 -862 -863 -864 -865 -866 -867 -868 -869 -870 -871 -872 -873 -874 -875
2252.81/564.14	v -876 -877 -878 -879 -880 881 -882 -883 -884 -885 -886 -887 -888 -889 -890
2252.81/564.14	v -891 -892 -893 -894 -895 896 -897 -898 -899 -900 -901 -902 -903 -904 -905
2252.81/564.14	v -906 -907 -908 -909 -910 -911 -912 -913 -914 915 -916 -917 -918 -919 -920
2252.81/564.14	v -921 -922 -923 -924 -925 -926 -927 -928 -929 -930 -931 -932 -933 -934 -935
2252.81/564.14	v -936 937 -938 -939 -940 -941 -942 -943 -944 -945 0
2253.06/564.21	s SATISFIABLE
2253.06/564.21	
2253.06/564.21	c Models        : 1+    
2253.06/564.21	c Time          : 564.165s (Solving: 564.00s 1st Model: 563.97s Unsat: 0.00s)
2253.06/564.21	c CPU Time      : 2253.020s

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299494-1304051763/watcher-3299494-1304051763 -o /tmp/evaluation-result-3299494-1304051763/solver-3299494-1304051763 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299494-1304051763.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=21532 CPUtime=0 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 678 0 0 0 0 0 0 0 22 0 1 0 497591946 22048768 601 33554432000 4194304 4964704 140735966536288 18446744073709551615 270338044613 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/3987/statm: 5383 601 385 189 0 257 0

[startup+0.037579 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=24768 CPUtime=0.03 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 1684 0 0 0 3 0 0 0 22 0 1 0 497591946 25362432 1428 33554432000 4194304 4964704 140735966536288 18446744073709551615 4607562 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/3987/statm: 6192 1428 398 189 0 1066 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 24768

[startup+0.100598 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=24900 CPUtime=0.09 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 1725 0 0 0 9 0 0 0 22 0 1 0 497591946 25497600 1469 33554432000 4194304 4964704 140735966536288 18446744073709551615 270338044613 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/3987/statm: 6225 1469 399 189 0 1099 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24900

[startup+0.378773 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=237316 CPUtime=1.46 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 3492 0 0 0 145 1 0 0 18 0 4 0 497591946 243011584 3115 33554432000 4194304 4964704 140735966536288 18446744073709551615 270338427063 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 59547 3941 458 189 0 53896 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 237316

[startup+1.09333 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=238320 CPUtime=3.83 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 4960 0 0 0 381 2 0 0 19 0 4 0 497591946 244039680 4583 33554432000 4194304 4964704 140735966536288 18446744073709551615 4669056 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 59580 4583 458 189 0 53929 0
Current children cumulated CPU time (s) 3.83
Current children cumulated vsize (KiB) 238320

[startup+1.50025 s]
/proc/loadavg: 7.43 7.96 7.90 2/174 3987
/proc/meminfo: memFree=31785396/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=239320 CPUtime=5.45 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 5882 0 0 0 543 2 0 0 19 0 4 0 497591946 245063680 5505 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 59830 5506 458 189 0 54179 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 239320

[startup+3.10094 s]
/proc/loadavg: 7.48 7.96 7.90 9/184 4000
/proc/meminfo: memFree=31727212/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=240648 CPUtime=11.85 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 6708 0 0 0 1182 3 0 0 24 0 4 0 497591946 246423552 6331 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627412 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 60162 6331 460 189 0 54511 0
[pid=3987/tid=3995] ppid=3985 vsize=240648 CPUtime=2.9 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 1183 0 0 0 290 0 0 0 24 0 4 0 497591963 246423552 6331 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=240648 CPUtime=2.92 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 1350 0 0 0 292 0 0 0 24 0 4 0 497591963 246423552 6331 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=240648 CPUtime=2.92 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 1264 0 0 0 291 1 0 0 25 0 4 0 497591963 246423552 6331 33554432000 4194304 4964704 140735966536288 18446744073709551615 4378516 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.85
Current children cumulated vsize (KiB) 240648

[startup+6.3003 s]
/proc/loadavg: 7.48 7.96 7.90 9/184 4000
/proc/meminfo: memFree=31691780/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=241708 CPUtime=24.63 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 8732 0 0 0 2459 4 0 0 25 0 4 0 497591946 247508992 8355 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 60427 8355 460 189 0 54776 0
[pid=3987/tid=3995] ppid=3985 vsize=241708 CPUtime=6.08 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 1656 0 0 0 608 0 0 0 25 0 4 0 497591963 247508992 8355 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627540 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=241708 CPUtime=6.12 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 1852 0 0 0 612 0 0 0 25 0 4 0 497591963 247508992 8355 33554432000 4194304 4964704 140735966536288 18446744073709551615 4668928 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=241708 CPUtime=6.11 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 1798 0 0 0 610 1 0 0 25 0 4 0 497591963 247508992 8355 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.63
Current children cumulated vsize (KiB) 241708

[startup+12.706 s]
/proc/loadavg: 7.56 7.96 7.90 9/184 4000
/proc/meminfo: memFree=31624720/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=247568 CPUtime=50.22 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 13541 0 0 0 5016 6 0 0 25 0 4 0 497591946 253509632 13164 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670271 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 61892 13164 460 189 0 56241 0
[pid=3987/tid=3995] ppid=3985 vsize=247568 CPUtime=12.46 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 3456 0 0 0 1245 1 0 0 25 0 4 0 497591963 253509632 13164 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670560 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=247568 CPUtime=12.52 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 3097 0 0 0 1251 1 0 0 25 0 4 0 497591963 253509632 13164 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=247568 CPUtime=12.52 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 2710 0 0 0 1250 2 0 0 25 0 4 0 497591963 253509632 13164 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.22
Current children cumulated vsize (KiB) 247568

[startup+25.5005 s]
/proc/loadavg: 7.62 7.97 7.90 9/184 4000
/proc/meminfo: memFree=31565560/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=254340 CPUtime=101.33 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 18307 0 0 0 10123 10 0 0 25 0 4 0 497591946 260444160 17749 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627290 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 63585 17749 460 189 0 57934 0
[pid=3987/tid=3995] ppid=3985 vsize=254340 CPUtime=25.18 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 4528 0 0 0 2516 2 0 0 25 0 4 0 497591963 260444160 17749 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321065 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=254340 CPUtime=25.32 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 4630 0 0 0 2529 3 0 0 25 0 4 0 497591963 260444160 17749 33554432000 4194304 4964704 140735966536288 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=254340 CPUtime=25.31 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 3529 0 0 0 2529 2 0 0 25 0 4 0 497591963 260444160 17749 33554432000 4194304 4964704 140735966536288 18446744073709551615 4660364 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.33
Current children cumulated vsize (KiB) 254340

[startup+51.1004 s]
/proc/loadavg: 7.83 7.98 7.91 9/184 4001
/proc/meminfo: memFree=31475144/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=266364 CPUtime=203.61 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 27183 0 0 0 20343 18 0 0 25 0 4 0 497591946 272756736 26326 33554432000 4194304 4964704 140735966536288 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 66591 26326 460 189 0 60940 0
[pid=3987/tid=3995] ppid=3985 vsize=266364 CPUtime=50.65 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 7320 0 0 0 5062 3 0 0 25 0 4 0 497591963 272756736 26326 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=266364 CPUtime=50.92 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 7650 0 0 0 5087 5 0 0 25 0 4 0 497591963 272756736 26326 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=266364 CPUtime=50.91 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 4822 0 0 0 5088 3 0 0 25 0 4 0 497591963 272756736 26326 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.61
Current children cumulated vsize (KiB) 266364

[startup+102.3 s]
/proc/loadavg: 8.00 8.00 7.91 9/184 4002
/proc/meminfo: memFree=31387208/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=268920 CPUtime=408.12 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 33626 0 0 0 40787 25 0 0 25 0 4 0 497591946 275374080 32692 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 67230 32692 460 189 0 61579 0
[pid=3987/tid=3995] ppid=3985 vsize=268920 CPUtime=101.56 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 9167 0 0 0 10151 5 0 0 25 0 4 0 497591963 275374080 32692 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321105 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=268920 CPUtime=102.12 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 9646 0 0 0 10205 7 0 0 25 0 4 0 497591963 275374080 32692 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=268920 CPUtime=102.12 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 6554 0 0 0 10206 6 0 0 25 0 4 0 497591963 275374080 32692 33554432000 4194304 4964704 140735966536288 18446744073709551615 270338039137 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.12
Current children cumulated vsize (KiB) 268920

[startup+162.306 s]
/proc/loadavg: 8.07 8.02 7.92 9/184 4004
/proc/meminfo: memFree=31319232/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=278264 CPUtime=647.82 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 40453 0 0 0 64750 32 0 0 25 0 4 0 497591946 284942336 39437 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627465 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 69566 39437 460 189 0 63915 0
[pid=3987/tid=3995] ppid=3985 vsize=278264 CPUtime=161.23 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 10863 0 0 0 16116 7 0 0 25 0 4 0 497591963 284942336 39437 33554432000 4194304 4964704 140735966536288 18446744073709551615 4332387 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=278264 CPUtime=162.14 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 12005 0 0 0 16205 9 0 0 25 0 4 0 497591963 284942336 39437 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=278264 CPUtime=162.12 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 8586 0 0 0 16204 8 0 0 25 0 4 0 497591963 284942336 39437 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.82
Current children cumulated vsize (KiB) 278264

[startup+222.3 s]
/proc/loadavg: 8.17 8.04 7.93 9/184 4006
/proc/meminfo: memFree=31239600/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=283008 CPUtime=887.46 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 46584 0 0 0 88708 38 0 0 25 0 4 0 497591946 289800192 45402 33554432000 4194304 4964704 140735966536288 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 70752 45402 460 189 0 65101 0
[pid=3987/tid=3995] ppid=3985 vsize=283008 CPUtime=220.9 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 12844 0 0 0 22081 9 0 0 25 0 4 0 497591963 289800192 45402 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=283008 CPUtime=222.13 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 13676 0 0 0 22203 10 0 0 25 0 4 0 497591963 289800192 45402 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=283008 CPUtime=222.12 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 10466 0 0 0 22201 11 0 0 25 0 4 0 497591963 289800192 45402 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.46
Current children cumulated vsize (KiB) 283008

[startup+282.301 s]
/proc/loadavg: 8.19 8.06 7.94 9/184 4007
/proc/meminfo: memFree=31200872/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=288288 CPUtime=1127.14 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 48551 0 0 0 112674 40 0 0 25 0 4 0 497591946 295206912 47129 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670215 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 72072 47129 460 189 0 66421 0
[pid=3987/tid=3995] ppid=3985 vsize=288288 CPUtime=280.57 cores=1,3,5,7

################
# More data... #
################

/proc/3987/statm: 72315 50552 460 189 0 66664 0
[pid=3987/tid=3995] ppid=3985 vsize=289260 CPUtime=399.91 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 14477 0 0 0 39980 11 0 0 25 0 4 0 497591963 296202240 50552 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320924 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=289260 CPUtime=402.13 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 16040 0 0 0 40202 11 0 0 25 0 4 0 497591963 296202240 50552 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=289260 CPUtime=402.13 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 11931 0 0 0 40199 14 0 0 25 0 4 0 497591963 296202240 50552 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1606.49
Current children cumulated vsize (KiB) 289260

[startup+462.301 s]
/proc/loadavg: 8.06 8.08 7.96 9/184 4012
/proc/meminfo: memFree=31146484/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=289988 CPUtime=1846.17 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 54572 0 0 0 184569 48 0 0 25 0 4 0 497591946 296947712 52575 33554432000 4194304 4964704 140735966536288 18446744073709551615 4668942 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 72497 52575 460 189 0 66846 0
[pid=3987/tid=3995] ppid=3985 vsize=289988 CPUtime=459.58 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 14880 0 0 0 45947 11 0 0 25 0 4 0 497591963 296947712 52575 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=289988 CPUtime=462.14 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 16597 0 0 0 46202 12 0 0 25 0 4 0 497591963 296947712 52575 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=289988 CPUtime=462.13 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12179 0 0 0 46199 14 0 0 25 0 4 0 497591963 296947712 52575 33554432000 4194304 4964704 140735966536288 18446744073709551615 4363274 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1846.17
Current children cumulated vsize (KiB) 289988

[startup+522.301 s]
/proc/loadavg: 8.02 8.06 7.96 9/184 4014
/proc/meminfo: memFree=31115460/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=289988 CPUtime=2085.84 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 56391 0 0 0 208535 49 0 0 25 0 4 0 497591946 296947712 54298 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 72497 54298 460 189 0 66846 0
[pid=3987/tid=3995] ppid=3985 vsize=289988 CPUtime=519.24 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15190 0 0 0 51913 11 0 0 25 0 4 0 497591963 296947712 54298 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=289988 CPUtime=522.14 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18033 0 0 0 52201 13 0 0 25 0 4 0 497591963 296947712 54298 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=289988 CPUtime=522.13 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12251 0 0 0 52199 14 0 0 25 0 4 0 497591963 296947712 54298 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2085.84
Current children cumulated vsize (KiB) 289988

Solver just ended. Dumping a history of the last processes samples

[startup+538.101 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4014
/proc/meminfo: memFree=31096604/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=291836 CPUtime=2148.96 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57176 0 0 0 214846 50 0 0 25 0 4 0 497591946 298840064 55083 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670354 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 72959 55083 460 189 0 67308 0
[pid=3987/tid=3995] ppid=3985 vsize=291836 CPUtime=534.95 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15318 0 0 0 53484 11 0 0 25 0 4 0 497591963 298840064 55083 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=291836 CPUtime=537.94 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18663 0 0 0 53781 13 0 0 25 0 4 0 497591963 298840064 55083 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=291836 CPUtime=537.93 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12278 0 0 0 53779 14 0 0 25 0 4 0 497591963 298840064 55083 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2148.96
Current children cumulated vsize (KiB) 291836

[startup+550.9 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4014
/proc/meminfo: memFree=31077252/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2200.08 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57835 0 0 0 219957 51 0 0 25 0 4 0 497591946 366239744 55742 33554432000 4194304 4964704 140735966536288 18446744073709551615 4652163 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55742 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=547.69 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15880 0 0 0 54756 13 0 0 25 0 4 0 497591963 366239744 55742 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627293 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=550.74 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18746 0 0 0 55061 13 0 0 25 0 4 0 497591963 366239744 55742 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=550.73 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 55059 14 0 0 25 0 4 0 497591963 366239744 55742 33554432000 4194304 4964704 140735966536288 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2200.08
Current children cumulated vsize (KiB) 357656

[startup+557.301 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31062244/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2225.65 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57845 0 0 0 222514 51 0 0 25 0 4 0 497591946 366239744 55752 33554432000 4194304 4964704 140735966536288 18446744073709551615 4669009 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55752 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=554.05 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15881 0 0 0 55392 13 0 0 25 0 4 0 497591963 366239744 55752 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=557.14 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18746 0 0 0 55701 13 0 0 25 0 4 0 497591963 366239744 55752 33554432000 4194304 4964704 140735966536288 18446744073709551615 4660304 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=557.13 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 55699 14 0 0 25 0 4 0 497591963 366239744 55752 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2225.65
Current children cumulated vsize (KiB) 357656

[startup+560.506 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31062116/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2238.45 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57890 0 0 0 223794 51 0 0 25 0 4 0 497591946 366239744 55797 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55797 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=557.24 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15882 0 0 0 55711 13 0 0 25 0 4 0 497591963 366239744 55797 33554432000 4194304 4964704 140735966536288 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=560.35 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18790 0 0 0 56021 14 0 0 25 0 4 0 497591963 366239744 55797 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=560.33 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 56019 14 0 0 25 0 4 0 497591963 366239744 55797 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2238.45
Current children cumulated vsize (KiB) 357656

[startup+562.101 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31061864/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2244.82 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57936 0 0 0 224431 51 0 0 25 0 4 0 497591946 366239744 55843 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55843 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=558.83 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15882 0 0 0 55870 13 0 0 25 0 4 0 497591963 366239744 55843 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321076 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=561.95 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18836 0 0 0 56181 14 0 0 25 0 4 0 497591963 366239744 55843 33554432000 4194304 4964704 140735966536288 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=561.93 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 56179 14 0 0 25 0 4 0 497591963 366239744 55843 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2244.82
Current children cumulated vsize (KiB) 357656

[startup+562.901 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31061864/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2248.02 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 57958 0 0 0 224751 51 0 0 25 0 4 0 497591946 366239744 55865 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55865 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=559.62 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15882 0 0 0 55949 13 0 0 25 0 4 0 497591963 366239744 55865 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670431 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=562.75 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18858 0 0 0 56261 14 0 0 25 0 4 0 497591963 366239744 55865 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=562.73 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 56259 14 0 0 25 0 4 0 497591963 366239744 55865 33554432000 4194304 4964704 140735966536288 18446744073709551615 4631252 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2248.02
Current children cumulated vsize (KiB) 357656

[startup+563.701 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31061492/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2251.23 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 58001 0 0 0 225072 51 0 0 25 0 4 0 497591946 366239744 55908 33554432000 4194304 4964704 140735966536288 18446744073709551615 4380234 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55908 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=560.42 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15882 0 0 0 56029 13 0 0 25 0 4 0 497591963 366239744 55908 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=563.55 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18901 0 0 0 56341 14 0 0 25 0 4 0 497591963 366239744 55908 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=563.53 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 56339 14 0 0 25 0 4 0 497591963 366239744 55908 33554432000 4194304 4964704 140735966536288 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2251.23
Current children cumulated vsize (KiB) 357656

[startup+564.101 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31061492/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=357656 CPUtime=2252.81 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 58003 0 0 0 225230 51 0 0 25 0 4 0 497591946 366239744 55910 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670233 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/3987/statm: 89414 55910 460 189 0 83763 0
[pid=3987/tid=3995] ppid=3985 vsize=357656 CPUtime=560.81 cores=1,3,5,7
/proc/3987/task/3995/stat : 3995 (claspmt) R 3985 3987 3183 0 -1 4202560 15882 0 0 0 56068 13 0 0 25 0 4 0 497591963 366239744 55910 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3987/tid=3996] ppid=3985 vsize=357656 CPUtime=563.95 cores=1,3,5,7
/proc/3987/task/3996/stat : 3996 (claspmt) R 3985 3987 3183 0 -1 4202560 18903 0 0 0 56381 14 0 0 25 0 4 0 497591963 366239744 55910 33554432000 4194304 4964704 140735966536288 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3987/tid=3997] ppid=3985 vsize=357656 CPUtime=563.93 cores=1,3,5,7
/proc/3987/task/3997/stat : 3997 (claspmt) R 3985 3987 3183 0 -1 4202560 12292 0 0 0 56379 14 0 0 25 0 4 0 497591963 366239744 55910 33554432000 4194304 4964704 140735966536288 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2252.81
Current children cumulated vsize (KiB) 357656

[startup+564.201 s]
/proc/loadavg: 8.01 8.05 7.96 9/184 4015
/proc/meminfo: memFree=31061492/32951124 swapFree=67111356/67111528
[pid=3987] ppid=3985 vsize=352328 CPUtime=2253.06 cores=1,3,5,7
/proc/3987/stat : 3987 (claspmt) R 3985 3987 3183 0 -1 4202496 58013 0 0 0 225254 52 0 0 25 0 1 0 497591946 360783872 54562 33554432000 4194304 4964704 140735966536288 18446744073709551615 270338039980 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/3987/statm: 88082 54562 470 189 0 82431 0
Current children cumulated CPU time (s) 2253.06
Current children cumulated vsize (KiB) 352328

Child status: 10
Real time (s): 564.219
CPU time (s): 2253.09
CPU user time (s): 2252.56
CPU system time (s): 0.528919
CPU usage (%): 399.328
Max. virtual memory (cumulated for all children) (KiB): 357656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2252.56
system time used= 0.528919
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 58015
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2642
involuntary context switches= 15150

runsolver used 0.860869 second user time and 2.21466 second system time

The end

Launcher Data 

Begin job on node143 at 2011-04-29 06:36:03
IDJOB=3299494
IDBENCH=71354
IDSOLVER=1683
FILE ID=node143/3299494-1304051763
RUNJOBID= node143-1304051763-3974
PBS_JOBID= 13170399
Free space on /tmp= 72924 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v945c61409gyes5.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299494-1304051763/watcher-3299494-1304051763 -o /tmp/evaluation-result-3299494-1304051763/solver-3299494-1304051763 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299494-1304051763.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ccc3b90e7796ba48b01939580fe6357c
RANDOM SEED=347442531

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31785428 kB
Buffers:        183424 kB
Cached:         638016 kB
SwapCached:        168 kB
Active:         247028 kB
Inactive:       641828 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31785428 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:            2480 kB
Writeback:           0 kB
AnonPages:       66928 kB
Mapped:          14692 kB
Slab:           211916 kB
PageTables:       4468 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188436 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72920 MiB
End job on node143 at 2011-04-29 06:45:28