Trace number 3266974

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4SAT 763.303 191.78

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf
MD5SUM0906ad3a7678a4284d484fb4b8c72f61
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.414936
Satisfiable
(Un)Satisfiability was proved
Number of variables792
Number of clauses67279
Sum of the clauses size135290
Maximum clause length31
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 267249
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data 

0.04/0.04	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266974-1304108445.cnf 
0.04/0.04	c Using SATTIMEOUT of 4800
0.04/0.04	c Using SATRAM of 15500
0.04/0.04	c Size of subset node = 32
0.04/0.04	c Variables = 792
0.04/0.04	c Clauses = 67279
0.04/0.04	c Literals = 135290
0.04/0.04	c Reduced size:
0.04/0.04	c Variables = 792
0.04/0.04	c Clauses = 67279
0.04/0.04	c Literals = 135290
0.04/0.04	c a2
0.04/0.08	c a1
0.09/0.16	c Independent sub-problems = 1
0.09/0.16	c Sub-problem with 792 variables and 67279 clauses
0.09/0.16	c using permutation method 4
0.09/0.16	c count = 1
0.09/0.16	c Ordering finished 0.140 seconds
0.09/0.16	c mapped 0.150 seconds
0.09/0.16	c permuted 0.150 seconds
0.09/0.16	c about to sort
0.09/0.16	c sorted
0.29/0.30	c clauses now 67279
0.29/0.30	c init finished 0.170 seconds
0.29/0.30	c tree built 0.300 seconds
0.29/0.30	c 
0.29/0.30	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.29/0.30	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.29/0.30	c ................................ | ..........                    |                                  0.3         0.0             
0.29/0.31	c ................................ | ..........                  1 |                                  0.3         3.3             
0.29/0.31	c ................................ | ..........                  2 |                                  0.3         6.7             
0.29/0.31	c ................................ | ..........                  3 |                                  0.3        10.0             
0.29/0.31	c ................................ | ..........                  4 |                                  0.3        13.3             
0.29/0.31	c ................................ | ..........                  5 |                                  0.3        16.7             
0.29/0.31	c ................................ | ..........               1000 |              104                 0.3      3225.8         4140
95.83/24.34	c ................................ | ..........            6655000 | 21552        966092             96.0     69322.9     26458382
191.97/48.41	c ................................ | ..........           12539000 | 39792        1840569           192.0     65307.3     48732054
287.71/72.47	c ................................ | ..........           18159000 | 54117        2651164           288.0     63049.9     60757180
383.84/96.54	c ................................ | ..........           23702000 | 69385        3409108           384.0     61722.4     70793606
480.00/120.60	c ................................ | *.........           29054000 | 83422        4162256           480.0     60527.9     88671360
575.70/144.67	c ................................ | *.........           34472000 | 99976        4890303           576.0     59847.2    104038817
671.79/168.75	c ................................ | *.........           39448000 | 116954       5562661           672.0     58702.4    111342724
763.03/191.63	c Thread 1 found 0x1a585180
763.03/191.63	c Partial assignments = 43940642, improvements = 131825  ucps = 6181723 PA/sec = 57577.99, subset nodes = 118209900
763.03/191.63	s SATISFIABLE
763.03/191.63	v 1 -2 -3 -4 -5 -6 -7 -8 -9 -10 
763.03/191.63	v -11 -12 -13 -14 -15 -16 -17 -18 -19 -20 
763.03/191.63	v -21 -22 -23 -24 -25 -26 -27 -28 -29 30 
763.03/191.63	v -31 -32 -33 -34 -35 -36 -37 -38 -39 -40 
763.03/191.63	v -41 -42 -43 -44 -45 -46 -47 -48 -49 -50 
763.03/191.63	v -51 -52 -53 -54 -55 -56 -57 -58 -59 -60 
763.03/191.63	v -61 62 -63 -64 -65 -66 -67 -68 -69 -70 
763.03/191.63	v -71 -72 -73 -74 -75 -76 -77 -78 -79 -80 
763.03/191.63	v -81 -82 -83 -84 -85 -86 -87 -88 -89 90 
763.03/191.63	v -91 -92 -93 -94 -95 -96 -97 -98 -99 -100 
763.03/191.63	v -101 -102 -103 -104 -105 -106 -107 -108 -109 -110 
763.03/191.63	v -111 -112 113 -114 -115 -116 -117 -118 -119 -120 
763.03/191.63	v -121 -122 -123 -124 -125 -126 -127 -128 -129 -130 
763.03/191.63	v -131 -132 -133 -134 -135 -136 137 -138 -139 -140 
763.03/191.63	v -141 -142 -143 -144 -145 -146 -147 -148 -149 -150 
763.03/191.63	v -151 -152 -153 -154 -155 -156 -157 -158 -159 -160 
763.03/191.63	v -161 -162 -163 -164 -165 -166 -167 -168 169 -170 
763.03/191.63	v -171 -172 -173 -174 -175 -176 -177 -178 -179 -180 
763.03/191.63	v -181 -182 -183 -184 -185 -186 -187 -188 -189 -190 
763.03/191.63	v -191 -192 -193 -194 -195 196 -197 -198 -199 -200 
763.03/191.63	v -201 -202 -203 -204 -205 -206 -207 -208 -209 -210 
763.03/191.63	v -211 -212 -213 -214 -215 -216 -217 -218 -219 -220 
763.03/191.63	v 221 -222 -223 -224 -225 -226 -227 -228 -229 -230 
763.03/191.63	v -231 -232 -233 -234 -235 -236 -237 -238 -239 -240 
763.03/191.63	v -241 -242 -243 -244 -245 -246 247 -248 -249 -250 
763.03/191.63	v -251 -252 -253 -254 -255 -256 -257 -258 -259 -260 
763.03/191.63	v -261 -262 -263 -264 -265 -266 -267 -268 -269 -270 
763.03/191.63	v -271 272 -273 -274 -275 -276 -277 -278 -279 -280 
763.03/191.63	v -281 -282 -283 -284 -285 -286 -287 -288 -289 -290 
763.03/191.63	v -291 -292 -293 -294 -295 -296 -297 -298 -299 -300 
763.03/191.63	v 301 -302 -303 -304 -305 -306 -307 -308 -309 -310 
763.03/191.63	v -311 -312 -313 -314 -315 -316 -317 -318 -319 -320 
763.03/191.63	v -321 -322 -323 -324 -325 -326 327 -328 -329 -330 
763.03/191.63	v -331 -332 -333 -334 -335 -336 -337 -338 -339 -340 
763.03/191.63	v -341 -342 -343 -344 -345 -346 -347 -348 -349 -350 
763.03/191.63	v -351 -352 353 -354 -355 -356 -357 -358 -359 -360 
763.03/191.63	v -361 -362 -363 -364 -365 -366 -367 -368 -369 -370 
763.03/191.63	v -371 -372 -373 -374 -375 -376 -377 -378 -379 -380 
763.03/191.63	v -381 -382 383 -384 -385 -386 -387 -388 -389 -390 
763.03/191.63	v -391 -392 -393 -394 -395 -396 -397 -398 -399 -400 
763.03/191.63	v -401 -402 -403 -404 -405 -406 -407 -408 -409 -410 
763.03/191.63	v -411 -412 413 -414 -415 -416 -417 -418 -419 -420 
763.03/191.63	v -421 -422 -423 -424 -425 -426 -427 -428 -429 -430 
763.03/191.63	v -431 -432 -433 -434 -435 -436 -437 -438 -439 -440 
763.03/191.63	v 441 -442 -443 -444 -445 -446 -447 -448 -449 -450 
763.03/191.63	v -451 -452 -453 -454 -455 -456 -457 -458 -459 -460 
763.03/191.63	v -461 -462 -463 -464 465 -466 -467 -468 -469 -470 
763.03/191.63	v -471 -472 -473 -474 -475 -476 -477 -478 -479 -480 
763.03/191.63	v -481 -482 -483 -484 -485 -486 -487 -488 -489 -490 
763.03/191.63	v -491 -492 493 -494 -495 -496 -497 -498 -499 -500 
763.03/191.63	v -501 -502 -503 -504 -505 -506 -507 -508 -509 -510 
763.03/191.63	v -511 -512 -513 -514 -515 -516 -517 -518 -519 -520 
763.03/191.63	v -521 -522 -523 524 -525 -526 -527 -528 -529 -530 
763.03/191.63	v -531 -532 -533 -534 -535 -536 -537 -538 -539 -540 
763.03/191.63	v -541 -542 -543 -544 -545 -546 -547 -548 -549 -550 
763.03/191.63	v -551 -552 553 -554 -555 -556 -557 -558 -559 -560 
763.03/191.63	v -561 -562 -563 -564 -565 -566 -567 -568 -569 -570 
763.03/191.63	v -571 -572 -573 -574 -575 -576 -577 -578 -579 -580 
763.03/191.63	v -581 -582 583 -584 -585 -586 -587 -588 -589 -590 
763.03/191.63	v -591 -592 -593 -594 -595 -596 -597 -598 -599 -600 
763.03/191.63	v -601 -602 -603 -604 -605 -606 -607 -608 -609 -610 
763.03/191.63	v -611 -612 -613 614 -615 -616 -617 -618 -619 -620 
763.03/191.63	v -621 -622 -623 -624 -625 -626 -627 -628 -629 -630 
763.03/191.63	v -631 -632 -633 -634 635 -636 -637 -638 -639 -640 
763.03/191.63	v -641 -642 -643 -644 -645 -646 -647 -648 -649 -650 
763.03/191.63	v -651 -652 -653 -654 -655 -656 -657 -658 -659 -660 
763.03/191.63	v 661 -662 -663 -664 -665 -666 -667 -668 -669 -670 
763.03/191.63	v -671 -672 -673 -674 -675 -676 -677 -678 -679 -680 
763.03/191.63	v -681 -682 -683 -684 -685 -686 -687 -688 -689 -690 
763.03/191.63	v -691 -692 693 -694 -695 -696 -697 -698 -699 -700 
763.03/191.63	v -701 -702 -703 -704 -705 -706 -707 -708 -709 -710 
763.03/191.63	v -711 -712 -713 -714 -715 716 -717 -718 -719 -720 
763.03/191.63	v -721 -722 -723 -724 -725 -726 -727 -728 -729 -730 
763.03/191.63	v -731 -732 -733 -734 -735 -736 -737 -738 739 -740 
763.03/191.63	v -741 -742 -743 -744 -745 -746 -747 -748 -749 -750 
763.03/191.63	v -751 -752 -753 -754 -755 -756 -757 -758 -759 -760 
763.03/191.63	v -761 -762 -763 764 -765 -766 -767 -768 -769 -770 
763.03/191.63	v -771 -772 -773 -774 -775 -776 -777 -778 -779 -780 
763.03/191.63	v -781 -782 -783 -784 -785 -786 -787 -788 -789 -790 
763.03/191.63	v -791 792 0
763.03/191.63	c CPU time = 763.15 seconds
763.03/191.63	c Elapsed time = 191 seconds

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266974-1304108445/watcher-3266974-1304108445 -o /tmp/evaluation-result-3266974-1304108445/solver-3266974-1304108445 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266974-1304108445.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.08 8.03 4/173 26734
/proc/meminfo: memFree=30853388/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=9760 CPUtime=0 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) R 26730 26733 26305 0 -1 4202496 504 0 0 0 0 0 0 0 18 0 1 0 522444189 9994240 447 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664808192 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/26733/statm: 2440 448 147 36 0 345 0

[startup+0.043117 s]
/proc/loadavg: 8.04 8.08 8.03 4/173 26734
/proc/meminfo: memFree=30853388/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=16820 CPUtime=0.04 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) R 26730 26733 26305 0 -1 4202496 2216 0 0 0 4 0 0 0 18 0 1 0 522444189 17223680 2159 33554432000 4194304 4338100 140736386950000 18446744073709551615 4221392 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/26733/statm: 4205 2159 150 36 0 2110 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 16820

[startup+0.101074 s]
/proc/loadavg: 8.04 8.08 8.03 4/173 26734
/proc/meminfo: memFree=30853388/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=20356 CPUtime=0.09 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) R 26730 26733 26305 0 -1 4202496 4446 0 0 0 9 0 0 0 18 0 1 0 522444189 20844544 2998 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664469189 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/26733/statm: 5089 3001 155 36 0 2994 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20356

[startup+0.301034 s]
/proc/loadavg: 8.04 8.08 8.03 4/173 26734
/proc/meminfo: memFree=30853388/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=46824 CPUtime=0.29 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) R 26730 26733 26305 0 -1 4202496 11316 0 0 0 28 1 0 0 18 0 1 0 522444189 47947776 9736 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664469189 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/26733/statm: 11706 9736 164 36 0 9611 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 46824

[startup+0.700929 s]
/proc/loadavg: 8.04 8.08 8.03 4/173 26734
/proc/meminfo: memFree=30853388/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=248344 CPUtime=1.86 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 16632 0 0 0 183 3 0 0 18 0 5 0 522444189 254304256 15052 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 62086 15052 176 36 0 59991 0
Current children cumulated CPU time (s) 1.86
Current children cumulated vsize (KiB) 248344

[startup+1.50079 s]
/proc/loadavg: 8.04 8.08 8.03 6/180 26754
/proc/meminfo: memFree=30719452/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=283016 CPUtime=5.05 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 25877 0 0 0 498 7 0 0 18 0 5 0 522444189 289808384 24297 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 70754 24297 176 36 0 68659 0
[pid=26733/tid=26751] ppid=26730 vsize=283016 CPUtime=1.19 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 5019 0 0 0 118 1 0 0 19 0 5 0 522444220 289808384 24297 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203290 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=283016 CPUtime=1.17 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 3053 0 0 0 115 2 0 0 22 0 5 0 522444220 289808384 24297 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203373 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=283016 CPUtime=1.18 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 4957 0 0 0 118 0 0 0 19 0 5 0 522444220 289808384 24297 33554432000 4194304 4338100 140736386950000 18446744073709551615 4284173 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=283016 CPUtime=1.18 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 1419 0 0 0 117 1 0 0 19 0 5 0 522444220 289808384 24297 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203689 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.05
Current children cumulated vsize (KiB) 283016

[startup+3.10051 s]
/proc/loadavg: 7.80 8.02 8.01 9/184 26758
/proc/meminfo: memFree=30573660/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=352836 CPUtime=11.45 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 42964 0 0 0 1128 17 0 0 18 0 5 0 522444189 361304064 41384 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 88209 41384 176 36 0 86114 0
[pid=26733/tid=26751] ppid=26730 vsize=352836 CPUtime=2.78 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 10776 0 0 0 276 2 0 0 23 0 5 0 522444220 361304064 41384 33554432000 4194304 4338100 140736386950000 18446744073709551615 4240540 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=352836 CPUtime=2.77 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 6718 0 0 0 271 6 0 0 25 0 5 0 522444220 361304064 41384 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203347 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=352836 CPUtime=2.78 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 11263 0 0 0 277 1 0 0 23 0 5 0 522444220 361304064 41384 33554432000 4194304 4338100 140736386950000 18446744073709551615 4256749 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=352836 CPUtime=2.78 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 2778 0 0 0 273 5 0 0 23 0 5 0 522444220 361304064 41384 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664504817 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.45
Current children cumulated vsize (KiB) 352836

[startup+6.30096 s]
/proc/loadavg: 7.80 8.02 8.01 9/184 26758
/proc/meminfo: memFree=30311616/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=485344 CPUtime=23.94 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 76262 0 0 0 2348 46 0 0 18 0 5 0 522444189 496992256 74682 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 121336 74682 176 36 0 119241 0
[pid=26733/tid=26751] ppid=26730 vsize=485344 CPUtime=5.94 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 22459 0 0 0 587 7 0 0 25 0 5 0 522444220 496992256 74682 33554432000 4194304 4338100 140736386950000 18446744073709551615 4256013 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=485344 CPUtime=5.89 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 13137 0 0 0 573 16 0 0 25 0 5 0 522444220 496992256 74682 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676634293 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=485344 CPUtime=5.98 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 23308 0 0 0 595 3 0 0 25 0 5 0 522444220 496992256 74683 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=485344 CPUtime=5.79 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 5931 0 0 0 562 17 0 0 25 0 5 0 522444220 496992256 74684 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 23.94
Current children cumulated vsize (KiB) 485344

[startup+12.7009 s]
/proc/loadavg: 7.83 8.02 8.01 9/184 26758
/proc/meminfo: memFree=29884384/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=719136 CPUtime=49.5 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 134820 0 0 0 4851 99 0 0 18 0 5 0 522444189 736395264 133240 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 179784 133240 176 36 0 177689 0
[pid=26733/tid=26751] ppid=26730 vsize=719136 CPUtime=12.31 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 44391 0 0 0 1218 13 0 0 25 0 5 0 522444220 736395264 133240 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203689 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=719136 CPUtime=12.28 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 23818 0 0 0 1192 36 0 0 25 0 5 0 522444220 736395264 133240 33554432000 4194304 4338100 140736386950000 18446744073709551615 4286331 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=719136 CPUtime=12.38 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 43106 0 0 0 1231 7 0 0 25 0 5 0 522444220 736395264 133240 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=719136 CPUtime=12.19 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 12076 0 0 0 1179 40 0 0 25 0 5 0 522444220 736395264 133240 33554432000 4194304 4338100 140736386950000 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.5
Current children cumulated vsize (KiB) 719136

[startup+25.5006 s]
/proc/loadavg: 7.86 8.02 8.01 9/184 26758
/proc/meminfo: memFree=29090544/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=1119100 CPUtime=100.61 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 234216 0 0 0 9860 201 0 0 18 0 5 0 522444189 1145958400 232636 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 279775 232636 176 36 0 277680 0
[pid=26733/tid=26751] ppid=26730 vsize=1119100 CPUtime=25.03 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 85818 0 0 0 2480 23 0 0 25 0 5 0 522444220 1145958400 232636 33554432000 4194304 4338100 140736386950000 18446744073709551615 4285738 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=1119100 CPUtime=25.08 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 39665 0 0 0 2428 80 0 0 25 0 5 0 522444220 1145958400 232637 33554432000 4194304 4338100 140736386950000 18446744073709551615 4253935 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=1119100 CPUtime=25.18 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 78318 0 0 0 2506 12 0 0 25 0 5 0 522444220 1145958400 232637 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=1119100 CPUtime=24.99 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 18988 0 0 0 2415 84 0 0 25 0 5 0 522444220 1145958400 232639 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 100.61
Current children cumulated vsize (KiB) 1119100

[startup+51.1012 s]
/proc/loadavg: 7.96 8.03 8.01 7/184 26759
/proc/meminfo: memFree=27791176/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=1846800 CPUtime=202.72 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 413909 0 0 0 19867 405 0 0 18 0 5 0 522444189 1891123200 412329 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 461700 412329 176 36 0 459605 0
[pid=26733/tid=26751] ppid=26730 vsize=1846800 CPUtime=50.53 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 159139 0 0 0 5007 46 0 0 25 0 5 0 522444220 1891123200 412329 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203494 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=1846800 CPUtime=50.65 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 71539 0 0 0 4900 165 0 0 25 0 5 0 522444220 1891123200 412329 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=1846800 CPUtime=50.75 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 134761 0 0 0 5052 23 0 0 25 0 5 0 522444220 1891123200 412329 33554432000 4194304 4338100 140736386950000 18446744073709551615 4253962 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=1846800 CPUtime=50.45 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 37041 0 0 0 4877 168 0 0 25 0 5 0 522444220 1891123200 412329 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254304 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.72
Current children cumulated vsize (KiB) 1846800

[startup+102.306 s]
/proc/loadavg: 8.04 8.04 8.01 9/184 26760
/proc/meminfo: memFree=26330428/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=2666912 CPUtime=407.02 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 616035 0 0 0 39879 823 0 0 18 0 5 0 522444189 2730917888 614455 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 666728 614456 176 36 0 664633 0
[pid=26733/tid=26751] ppid=26730 vsize=2666912 CPUtime=101.41 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 256304 0 0 0 10068 73 0 0 25 0 5 0 522444220 2730917888 614456 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=2666912 CPUtime=101.81 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 85865 0 0 0 9836 345 0 0 25 0 5 0 522444220 2730917888 614457 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676634293 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=2666912 CPUtime=101.9 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 223642 0 0 0 10149 41 0 0 25 0 5 0 522444220 2730917888 614457 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=2666912 CPUtime=101.56 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 38797 0 0 0 9795 361 0 0 25 0 5 0 522444220 2730917888 614457 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676634293 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.02
Current children cumulated vsize (KiB) 2666912

[startup+162.301 s]
/proc/loadavg: 8.09 8.05 8.01 9/184 26762
/proc/meminfo: memFree=24411492/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=3748048 CPUtime=646.24 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 882570 0 0 0 63277 1347 0 0 18 0 5 0 522444189 3838001152 880990 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 937012 880990 176 36 0 934917 0
[pid=26733/tid=26751] ppid=26730 vsize=3748048 CPUtime=161.15 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 387669 0 0 0 16001 114 0 0 25 0 5 0 522444220 3838001152 880990 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203303 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=3748048 CPUtime=161.5 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 118039 0 0 0 15576 574 0 0 25 0 5 0 522444220 3838001152 880990 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=3748048 CPUtime=161.81 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 325680 0 0 0 16122 59 0 0 25 0 5 0 522444220 3838001152 880991 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=3748048 CPUtime=161.45 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 39754 0 0 0 15547 598 0 0 25 0 5 0 522444220 3838001152 880991 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676622491 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 646.24
Current children cumulated vsize (KiB) 3748048

Solver just ended. Dumping a history of the last processes samples

[startup+179.101 s]
/proc/loadavg: 8.07 8.04 8.01 9/184 26762
/proc/meminfo: memFree=24000544/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=3860788 CPUtime=713.22 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 913878 0 0 0 69842 1480 0 0 18 0 5 0 522444189 3953446912 912298 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 965197 912298 176 36 0 963102 0
[pid=26733/tid=26751] ppid=26730 vsize=3860788 CPUtime=177.9 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 403273 0 0 0 17670 120 0 0 25 0 5 0 522444220 3953446912 912298 33554432000 4194304 4338100 140736386950000 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=3860788 CPUtime=178.17 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119293 0 0 0 17184 633 0 0 25 0 5 0 522444220 3953446912 912298 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=3860788 CPUtime=178.6 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 339152 0 0 0 17799 61 0 0 25 0 5 0 522444220 3953446912 912298 33554432000 4194304 4338100 140736386950000 18446744073709551615 4240519 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=3860788 CPUtime=178.22 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 40731 0 0 0 17158 664 0 0 25 0 5 0 522444220 3953446912 912298 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 713.22
Current children cumulated vsize (KiB) 3860788

[startup+185.501 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23790860/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=3920352 CPUtime=738.7 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 929487 0 0 0 72342 1528 0 0 18 0 5 0 522444189 4014440448 927907 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 980088 927907 176 36 0 977993 0
[pid=26733/tid=26751] ppid=26730 vsize=3920352 CPUtime=184.27 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 411445 0 0 0 18305 122 0 0 25 0 5 0 522444220 4014440448 927907 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676622491 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=3920352 CPUtime=184.53 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119353 0 0 0 17799 654 0 0 25 0 5 0 522444220 4014440448 927907 33554432000 4194304 4338100 140736386950000 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=3920352 CPUtime=184.97 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 345824 0 0 0 18435 62 0 0 25 0 5 0 522444220 4014440448 927907 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=3920352 CPUtime=184.6 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 41436 0 0 0 17773 687 0 0 25 0 5 0 522444220 4014440448 927907 33554432000 4194304 4338100 140736386950000 18446744073709551615 4241603 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 738.7
Current children cumulated vsize (KiB) 3920352

[startup+188.7 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23654956/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=3986172 CPUtime=751.48 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 945722 0 0 0 73591 1557 0 0 18 0 5 0 522444189 4081840128 944142 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 996543 944142 176 36 0 994448 0
[pid=26733/tid=26751] ppid=26730 vsize=3986172 CPUtime=187.46 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 420103 0 0 0 18622 124 0 0 25 0 5 0 522444220 4081840128 944142 33554432000 4194304 4338100 140736386950000 18446744073709551615 4284214 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=3986172 CPUtime=187.71 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119355 0 0 0 18103 668 0 0 25 0 5 0 522444220 4081840128 944142 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=3986172 CPUtime=188.17 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 353391 0 0 0 18754 63 0 0 25 0 5 0 522444220 4081840128 944142 33554432000 4194304 4338100 140736386950000 18446744073709551615 274664203507 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=3986172 CPUtime=187.79 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 41444 0 0 0 18081 698 0 0 25 0 5 0 522444220 4081840128 944142 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676622491 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 751.48
Current children cumulated vsize (KiB) 3986172

[startup+190.306 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23586880/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=4017452 CPUtime=757.87 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 953514 0 0 0 74216 1571 0 0 18 0 5 0 522444189 4113870848 951934 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 1004363 951934 176 36 0 1002268 0
[pid=26733/tid=26751] ppid=26730 vsize=4017452 CPUtime=189.06 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 424612 0 0 0 18780 126 0 0 25 0 5 0 522444220 4113870848 951934 33554432000 4194304 4338100 140736386950000 18446744073709551615 4242669 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=4017452 CPUtime=189.3 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119357 0 0 0 18256 674 0 0 25 0 5 0 522444220 4113870848 951934 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254141 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=4017452 CPUtime=189.78 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 356669 0 0 0 18914 64 0 0 25 0 5 0 522444220 4113870848 951934 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=4017452 CPUtime=189.39 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 41447 0 0 0 18235 704 0 0 25 0 5 0 522444220 4113870848 951934 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254045 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 757.87
Current children cumulated vsize (KiB) 4017452

[startup+191.101 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23586880/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=4029964 CPUtime=761.04 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 956885 0 0 0 74527 1577 0 0 18 0 5 0 522444189 4126683136 955305 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 1007491 955305 176 36 0 1005396 0
[pid=26733/tid=26751] ppid=26730 vsize=4029964 CPUtime=189.85 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 426690 0 0 0 18858 127 0 0 25 0 5 0 522444220 4126683136 955305 33554432000 4194304 4338100 140736386950000 18446744073709551615 4240519 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=4029964 CPUtime=190.09 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119358 0 0 0 18333 676 0 0 25 0 5 0 522444220 4126683136 955305 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=4029964 CPUtime=190.57 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 357958 0 0 0 18993 64 0 0 25 0 5 0 522444220 4126683136 955305 33554432000 4194304 4338100 140736386950000 18446744073709551615 4256661 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=4029964 CPUtime=190.19 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 41450 0 0 0 18312 707 0 0 25 0 5 0 522444220 4126683136 955305 33554432000 4194304 4338100 140736386950000 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 761.04
Current children cumulated vsize (KiB) 4029964

[startup+191.501 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23567040/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=4039348 CPUtime=762.62 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) S 26730 26733 26305 0 -1 4202496 959017 0 0 0 74680 1582 0 0 18 0 5 0 522444189 4136292352 957437 33554432000 4194304 4338100 140736386950000 18446744073709551615 274676611045 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 1009837 957437 176 36 0 1007742 0
[pid=26733/tid=26751] ppid=26730 vsize=4039348 CPUtime=190.24 cores=1,3,5,7
/proc/26733/task/26751/stat : 26751 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 427737 0 0 0 18897 127 0 0 25 0 5 0 522444220 4136292352 957437 33554432000 4194304 4338100 140736386950000 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=26733/tid=26752] ppid=26730 vsize=4039348 CPUtime=190.48 cores=1,3,5,7
/proc/26733/task/26752/stat : 26752 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 119358 0 0 0 18370 678 0 0 25 0 5 0 522444220 4136292352 957437 33554432000 4194304 4338100 140736386950000 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=26733/tid=26753] ppid=26730 vsize=4039348 CPUtime=190.96 cores=1,3,5,7
/proc/26733/task/26753/stat : 26753 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 359043 0 0 0 19032 64 0 0 25 0 5 0 522444220 4136292352 957437 33554432000 4194304 4338100 140736386950000 18446744073709551615 4240519 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=26733/tid=26754] ppid=26730 vsize=4039348 CPUtime=190.59 cores=1,3,5,7
/proc/26733/task/26754/stat : 26754 (ttsth-5-4) R 26730 26733 26305 0 -1 4202560 41450 0 0 0 18350 709 0 0 25 0 5 0 522444220 4136292352 957437 33554432000 4194304 4338100 140736386950000 18446744073709551615 4239444 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 762.62
Current children cumulated vsize (KiB) 4039348

[startup+191.701 s]
/proc/loadavg: 8.06 8.04 8.01 9/184 26763
/proc/meminfo: memFree=23567040/32951132 swapFree=67111356/67111528
[pid=26733] ppid=26730 vsize=0 CPUtime=763.22 cores=1,3,5,7
/proc/26733/stat : 26733 (ttsth-5-4) R 26730 26733 26305 0 -1 4202500 959791 0 0 0 74731 1591 0 0 18 0 1 0 522444189 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/26733/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 763.22
Current children cumulated vsize (KiB) 0

Child status: 10
Real time (s): 191.78
CPU time (s): 763.303
CPU user time (s): 747.311
CPU system time (s): 15.9916
CPU usage (%): 398.01
Max. virtual memory (cumulated for all children) (KiB): 4042476

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 747.311
system time used= 15.9916
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 959791
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4449
involuntary context switches= 5161

runsolver used 0.297954 second user time and 0.729889 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-29 22:20:46
IDJOB=3266974
IDBENCH=88224
IDSOLVER=1654
FILE ID=node131/3266974-1304108445
RUNJOBID= node131-1304107233-26622
PBS_JOBID= 13170641
Free space on /tmp= 71380 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m32-q326.25-n30-p15-s44266159.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266974-1304108445/watcher-3266974-1304108445 -o /tmp/evaluation-result-3266974-1304108445/solver-3266974-1304108445 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266974-1304108445.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0906ad3a7678a4284d484fb4b8c72f61
RANDOM SEED=1368944089

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30853676 kB
Buffers:        205488 kB
Cached:        1519096 kB
SwapCached:        168 kB
Active:         152432 kB
Inactive:      1638604 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30853676 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:             804 kB
Writeback:           0 kB
AnonPages:       66396 kB
Mapped:          14520 kB
Slab:           242740 kB
PageTables:       4292 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   196132 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71380 MiB
End job on node131 at 2011-04-29 22:23:57