Trace number 3310378

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parSAT 164.628 20.6491

General information on the benchmark

NameSAT05/industrial/grieu05/vmpc/
vmpc_29.renamed-as.sat05-1916.cnf
MD5SUMf874c09c5787bb3c6a16f7a5f9ea0ad4
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark15.1187
Satisfiable
(Un)Satisfiability was proved
Number of variables841
Number of clauses120147
Sum of the clauses size314766
Maximum clause length29
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 247183
Number of clauses of size 372906
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 558

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
164.25/20.63	v -1 -2 -3 -4 -5 -6 -7 -8 -9 -10
164.25/20.63	v -11 -12 -13 -14 -15 -16 -17 -18 -19 -20
164.25/20.63	v -21 -22 -23 -24 -25 -26 -27 -28 29 -30
164.25/20.63	v -31 -32 -33 -34 -35 -36 -37 -38 -39 40
164.25/20.63	v -41 -42 -43 -44 -45 -46 -47 -48 -49 -50
164.25/20.63	v -51 -52 -53 -54 -55 -56 -57 -58 -59 -60
164.25/20.63	v -61 -62 -63 -64 -65 -66 -67 -68 -69 -70
164.25/20.63	v -71 -72 -73 -74 -75 -76 -77 78 -79 -80
164.25/20.63	v -81 -82 -83 -84 -85 -86 -87 -88 -89 -90
164.25/20.63	v -91 -92 -93 -94 -95 96 -97 -98 -99 -100
164.25/20.63	v -101 -102 -103 -104 -105 -106 -107 -108 -109 -110
164.25/20.63	v -111 -112 -113 -114 -115 -116 -117 -118 -119 -120
164.25/20.63	v -121 -122 -123 -124 -125 -126 -127 -128 -129 130
164.25/20.63	v -131 -132 -133 -134 -135 -136 -137 -138 -139 -140
164.25/20.63	v -141 -142 -143 -144 -145 -146 -147 -148 -149 -150
164.25/20.63	v -151 -152 -153 -154 -155 -156 157 -158 -159 -160
164.25/20.63	v -161 -162 -163 -164 -165 -166 -167 -168 -169 -170
164.25/20.63	v -171 -172 -173 -174 -175 176 -177 -178 -179 -180
164.25/20.63	v -181 -182 -183 -184 -185 -186 -187 -188 -189 -190
164.25/20.63	v -191 -192 -193 -194 -195 -196 -197 -198 -199 -200
164.25/20.63	v -201 -202 -203 -204 -205 206 -207 -208 -209 -210
164.25/20.63	v -211 -212 -213 -214 -215 -216 -217 -218 -219 -220
164.25/20.63	v -221 -222 -223 -224 -225 -226 -227 -228 -229 -230
164.25/20.63	v -231 -232 -233 -234 -235 -236 -237 -238 -239 -240
164.25/20.63	v -241 -242 -243 -244 245 -246 -247 -248 -249 -250
164.25/20.63	v -251 -252 -253 -254 -255 -256 -257 -258 -259 -260
164.25/20.63	v -261 -262 -263 -264 -265 -266 -267 -268 -269 -270
164.25/20.63	v -271 -272 -273 -274 -275 -276 277 -278 -279 -280
164.25/20.63	v -281 -282 -283 -284 -285 -286 -287 -288 -289 -290
164.25/20.63	v -291 -292 -293 -294 -295 -296 -297 -298 -299 -300
164.25/20.63	v -301 -302 -303 -304 -305 -306 307 -308 -309 -310
164.25/20.63	v -311 -312 -313 -314 -315 -316 -317 -318 -319 -320
164.25/20.63	v -321 -322 -323 -324 -325 -326 -327 -328 -329 -330
164.25/20.63	v -331 -332 -333 -334 -335 -336 -337 338 -339 -340
164.25/20.63	v -341 -342 -343 -344 -345 -346 -347 -348 -349 -350
164.25/20.63	v -351 -352 -353 -354 -355 -356 -357 -358 -359 -360
164.25/20.63	v -361 -362 -363 -364 -365 -366 -367 -368 -369 -370
164.25/20.63	v -371 -372 -373 374 -375 -376 -377 -378 -379 -380
164.25/20.63	v -381 -382 -383 -384 -385 -386 387 -388 -389 -390
164.25/20.63	v -391 -392 -393 -394 -395 -396 -397 -398 -399 -400
164.25/20.63	v -401 -402 -403 -404 -405 -406 -407 -408 -409 -410
164.25/20.63	v 411 -412 -413 -414 -415 -416 -417 -418 -419 -420
164.25/20.63	v -421 -422 -423 -424 -425 -426 -427 -428 -429 -430
164.25/20.63	v -431 -432 -433 -434 -435 -436 -437 -438 -439 -440
164.25/20.63	v -441 -442 -443 -444 -445 -446 -447 -448 -449 -450
164.25/20.63	v -451 -452 -453 -454 -455 -456 -457 -458 -459 460
164.25/20.63	v -461 -462 -463 -464 -465 -466 -467 -468 -469 -470
164.25/20.63	v -471 -472 -473 -474 -475 -476 -477 -478 -479 -480
164.25/20.63	v -481 -482 -483 -484 -485 -486 -487 -488 -489 -490
164.25/20.63	v -491 492 -493 -494 -495 -496 -497 -498 -499 -500
164.25/20.63	v 501 -502 -503 -504 -505 -506 -507 -508 -509 -510
164.25/20.63	v -511 -512 -513 -514 -515 -516 -517 -518 -519 -520
164.25/20.63	v -521 -522 -523 -524 -525 -526 -527 -528 529 -530
164.25/20.63	v -531 -532 -533 -534 -535 -536 -537 -538 -539 -540
164.25/20.63	v -541 -542 -543 -544 -545 -546 -547 -548 -549 -550
164.25/20.63	v -551 -552 -553 -554 -555 -556 -557 -558 -559 -560
164.25/20.63	v -561 -562 -563 -564 -565 -566 -567 -568 -569 -570
164.25/20.63	v -571 -572 573 -574 -575 -576 -577 -578 -579 -580
164.25/20.63	v -581 -582 -583 -584 -585 -586 -587 -588 -589 -590
164.25/20.63	v -591 -592 -593 -594 -595 -596 -597 -598 -599 -600
164.25/20.63	v -601 -602 -603 604 -605 -606 -607 -608 -609 -610
164.25/20.63	v -611 -612 -613 -614 -615 -616 -617 -618 -619 -620
164.25/20.63	v -621 -622 -623 -624 -625 -626 -627 -628 -629 -630
164.25/20.63	v -631 632 -633 -634 -635 -636 -637 -638 -639 -640
164.25/20.63	v -641 -642 -643 -644 -645 -646 -647 -648 -649 -650
164.25/20.63	v -651 -652 -653 -654 -655 -656 -657 -658 -659 -660
164.25/20.63	v -661 -662 -663 -664 665 -666 -667 -668 -669 -670
164.25/20.63	v -671 -672 673 -674 -675 -676 -677 -678 -679 -680
164.25/20.63	v -681 -682 -683 -684 -685 -686 -687 -688 -689 -690
164.25/20.63	v -691 -692 -693 -694 -695 -696 -697 -698 -699 -700
164.25/20.63	v -701 -702 -703 -704 -705 -706 -707 -708 -709 -710
164.25/20.63	v 711 -712 -713 -714 -715 -716 -717 -718 -719 -720
164.25/20.63	v -721 -722 -723 -724 -725 -726 -727 -728 729 -730
164.25/20.63	v -731 -732 -733 -734 -735 -736 -737 -738 -739 -740
164.25/20.63	v -741 -742 -743 -744 -745 -746 -747 -748 -749 -750
164.25/20.63	v -751 -752 -753 -754 755 -756 -757 -758 -759 -760
164.25/20.63	v -761 -762 -763 -764 -765 -766 -767 -768 -769 -770
164.25/20.63	v -771 -772 -773 -774 -775 -776 -777 -778 -779 -780
164.25/20.63	v -781 -782 -783 -784 -785 -786 -787 -788 -789 -790
164.25/20.63	v -791 -792 -793 -794 -795 -796 -797 -798 -799 -800
164.25/20.63	v 801 -802 -803 -804 -805 -806 -807 -808 -809 -810
164.25/20.63	v -811 -812 -813 -814 -815 -816 -817 -818 -819 -820
164.25/20.63	v -821 -822 -823 -824 -825 -826 -827 -828 -829 -830
164.25/20.63	v -831 -832 833 -834 -835 -836 -837 -838 -839 -840
164.25/20.63	v -841 0
164.25/20.64	s SATISFIABLE
164.25/20.64	solver [2] clasp 1.3.6 answered
164.25/20.64	Done

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310378-1304019070/watcher-3310378-1304019070 -o /tmp/evaluation-result-3310378-1304019070/solver-3310378-1304019070 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310378-1304019070.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 13355
/proc/meminfo: memFree=18503048/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0

[startup+0.0402069 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 13355
/proc/meminfo: memFree=18503048/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100197 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 13355
/proc/meminfo: memFree=18503048/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300133 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 13355
/proc/meminfo: memFree=18503048/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701062 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 13355
/proc/meminfo: memFree=18503048/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) R 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 20 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50093 s]
/proc/loadavg: 0.00 0.00 0.00 9/180 13370
/proc/meminfo: memFree=18416284/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=40604 CPUtime=1.49 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 6216 0 0 0 148 1 0 0 20 0 1 0 592137725 41578496 5030 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 10151 5031 327 96 0 6713 0
[pid=13357] ppid=13355 vsize=20204 CPUtime=1.49 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 3200 0 0 0 149 0 0 0 20 0 1 0 592137725 20688896 2376 33554432000 4194304 4785740 140736665619328 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 5051 2376 340 145 0 2096 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=1.48 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 148 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=41204 CPUtime=1.49 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 13331 0 0 0 147 2 0 0 25 0 1 0 592137725 42192896 7601 33554432000 4194304 4331988 140733826673504 18446744073709551615 4271172 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 10301 7601 151 34 0 8743 0
[pid=13360] ppid=13355 vsize=73924 CPUtime=5.62 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 10785 1250 0 0 561 1 0 0 18 0 5 0 592137725 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 18481 6905 162 40 0 17025 0
[pid=13360/tid=13367] ppid=13355 vsize=73924 CPUtime=1.38 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 1937 1250 0 0 138 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=73924 CPUtime=1.35 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 922 1250 0 0 135 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=73924 CPUtime=1.38 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 1434 1250 0 0 138 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=73924 CPUtime=1.38 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 1919 1250 0 0 138 0 0 0 23 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 657748

[startup+3.10066 s]
/proc/loadavg: 0.00 0.00 0.00 9/180 13370
/proc/meminfo: memFree=18394832/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=40604 CPUtime=3.09 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 6506 0 0 0 308 1 0 0 25 0 1 0 592137725 41578496 5316 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238224 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 10151 5316 327 96 0 6713 0
[pid=13357] ppid=13355 vsize=20600 CPUtime=3.09 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 3320 0 0 0 309 0 0 0 25 0 1 0 592137725 21094400 2496 33554432000 4194304 4785740 140736665619328 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 5150 2496 340 145 0 2195 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=3.08 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 308 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=78512 CPUtime=3.08 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 19793 0 0 0 305 3 0 0 25 0 1 0 592137725 80396288 14063 33554432000 4194304 4331988 140733826673504 18446744073709551615 224284586693 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 19628 14063 151 34 0 18070 0
[pid=13360] ppid=13355 vsize=73924 CPUtime=12.01 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 10785 1250 0 0 1200 1 0 0 18 0 5 0 592137725 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 18481 6905 162 40 0 17025 0
[pid=13360/tid=13367] ppid=13355 vsize=73924 CPUtime=2.98 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 1937 1250 0 0 298 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=73924 CPUtime=2.95 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 922 1250 0 0 295 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=73924 CPUtime=2.98 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 1434 1250 0 0 298 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244405 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=73924 CPUtime=2.98 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 1919 1250 0 0 298 0 0 0 25 0 5 0 592137736 75698176 6905 33554432000 4194304 4356188 140733458234016 18446744073709551615 4279701 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.35
Current children cumulated vsize (KiB) 695452

[startup+6.30113 s]
/proc/loadavg: 0.64 0.13 0.04 9/180 13370
/proc/meminfo: memFree=18337432/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=59684 CPUtime=6.29 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 11126 0 0 0 628 1 0 0 25 0 1 0 592137725 61116416 8817 33554432000 4194304 4587354 140736370193952 18446744073709551615 4365361 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 14921 8817 337 96 0 11483 0
[pid=13357] ppid=13355 vsize=24056 CPUtime=6.28 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 4155 0 0 0 628 0 0 0 25 0 1 0 592137725 24633344 3331 33554432000 4194304 4785740 140736665619328 18446744073709551615 4553010 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 6014 3331 340 145 0 3059 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=6.29 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 629 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=140048 CPUtime=6.29 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 32444 0 0 0 624 5 0 0 25 0 1 0 592137725 143409152 26714 33554432000 4194304 4331988 140733826673504 18446744073709551615 4271211 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 35012 26714 151 34 0 33454 0
[pid=13360] ppid=13355 vsize=75628 CPUtime=24.8 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 13401 1250 0 0 2478 2 0 0 18 0 5 0 592137725 77443072 7331 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 18907 7331 162 40 0 17451 0
[pid=13360/tid=13367] ppid=13355 vsize=75628 CPUtime=6.18 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 2503 1250 0 0 618 0 0 0 25 0 5 0 592137736 77443072 7331 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331360 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=75628 CPUtime=6.13 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 1663 1250 0 0 613 0 0 0 25 0 5 0 592137736 77443072 7331 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=75628 CPUtime=6.17 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 1434 1250 0 0 617 0 0 0 25 0 5 0 592137736 77443072 7331 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=75628 CPUtime=6.18 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 3228 1250 0 0 618 0 0 0 25 0 5 0 592137736 77443072 7331 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.95
Current children cumulated vsize (KiB) 781228

[startup+12.7011 s]
/proc/loadavg: 1.23 0.26 0.09 9/180 13370
/proc/meminfo: memFree=18148824/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=530336 CPUtime=12.69 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 12731 0 0 0 1267 2 0 0 25 0 1 0 592137725 543064064 9147 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238307 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 132584 9147 337 96 0 129146 0
[pid=13357] ppid=13355 vsize=27304 CPUtime=12.69 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 4950 0 0 0 1268 1 0 0 25 0 1 0 592137725 27959296 4126 33554432000 4194304 4785740 140736665619328 18446744073709551615 4550456 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 6826 4126 340 145 0 3871 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=12.69 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 1269 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=12.69 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 1251 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=82284 CPUtime=50.35 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 16969 1250 0 0 5033 2 0 0 18 0 5 0 592137725 84258816 8804 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 20571 8804 162 40 0 19115 0
[pid=13360/tid=13367] ppid=13355 vsize=82284 CPUtime=12.58 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3303 1250 0 0 1258 0 0 0 25 0 5 0 592137736 84258816 8804 33554432000 4194304 4356188 140733458234016 18446744073709551615 4332320 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=82284 CPUtime=12.49 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 1663 1250 0 0 1249 0 0 0 25 0 5 0 592137736 84258816 8804 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=82284 CPUtime=12.57 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2044 1250 0 0 1257 0 0 0 25 0 5 0 592137736 84258816 8804 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=82284 CPUtime=12.58 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 5386 1250 0 0 1258 0 0 0 25 0 5 0 592137736 84258816 8804 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.11
Current children cumulated vsize (KiB) 1415108

Solver just ended. Dumping a history of the last processes samples

[startup+15.9005 s]
/proc/loadavg: 1.77 0.39 0.13 9/180 13370
/proc/meminfo: memFree=18149444/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0

################
# More data... #
################

[pid=13360/tid=13367] ppid=13355 vsize=81260 CPUtime=15.78 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3303 1250 0 0 1578 0 0 0 25 0 5 0 592137736 83210240 8739 33554432000 4194304 4356188 140733458234016 18446744073709551615 4270898 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=81260 CPUtime=15.67 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 1567 0 0 0 25 0 5 0 592137736 83210240 8739 33554432000 4194304 4356188 140733458234016 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=81260 CPUtime=15.77 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 1577 0 0 0 25 0 5 0 592137736 83210240 8739 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=81260 CPUtime=15.78 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 5968 1250 0 0 1578 0 0 0 25 0 5 0 592137736 83210240 8739 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 126.69
Current children cumulated vsize (KiB) 1419444

[startup+19.101 s]
/proc/loadavg: 2.27 0.52 0.17 9/180 13370
/proc/meminfo: memFree=18142996/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=533928 CPUtime=19.09 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 14269 0 0 0 1907 2 0 0 25 0 1 0 592137725 546742272 9357 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 133482 9357 337 96 0 130044 0
[pid=13357] ppid=13355 vsize=29656 CPUtime=19.09 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 5496 0 0 0 1908 1 0 0 25 0 1 0 592137725 30367744 4672 33554432000 4194304 4785740 140736665619328 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 7414 4672 340 145 0 4459 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=19.09 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 1909 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=19.09 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 1891 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4210516 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=85356 CPUtime=75.92 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 19958 1250 0 0 7589 3 0 0 18 0 5 0 592137725 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 21339 9763 162 40 0 19883 0
[pid=13360/tid=13367] ppid=13355 vsize=85356 CPUtime=18.98 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3399 1250 0 0 1898 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=85356 CPUtime=18.86 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 1886 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4279481 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=85356 CPUtime=18.97 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 1897 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=85356 CPUtime=18.98 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 6896 1250 0 0 1898 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 152.28
Current children cumulated vsize (KiB) 1424124

[startup+19.9009 s]
/proc/loadavg: 2.27 0.52 0.17 9/180 13370
/proc/meminfo: memFree=18142348/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=533928 CPUtime=19.89 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 14395 0 0 0 1987 2 0 0 25 0 1 0 592137725 546742272 9480 33554432000 4194304 4587354 140736370193952 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 133482 9480 337 96 0 130044 0
[pid=13357] ppid=13355 vsize=29656 CPUtime=19.89 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 5502 0 0 0 1988 1 0 0 25 0 1 0 592137725 30367744 4678 33554432000 4194304 4785740 140736665619328 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 7414 4678 340 145 0 4459 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=19.88 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 1988 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=19.89 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 1971 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4210430 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=85356 CPUtime=79.11 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 19958 1250 0 0 7908 3 0 0 18 0 5 0 592137725 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 21339 9763 162 40 0 19883 0
[pid=13360/tid=13367] ppid=13355 vsize=85356 CPUtime=19.78 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3399 1250 0 0 1978 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=85356 CPUtime=19.65 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 1965 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=85356 CPUtime=19.77 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 1977 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=85356 CPUtime=19.78 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 6896 1250 0 0 1978 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 158.66
Current children cumulated vsize (KiB) 1424124

[startup+20.3008 s]
/proc/loadavg: 2.27 0.52 0.17 9/180 13370
/proc/meminfo: memFree=18142348/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=533628 CPUtime=20.29 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 15180 0 0 0 2027 2 0 0 25 0 1 0 592137725 546435072 8912 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238692 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 133407 8912 337 96 0 129969 0
[pid=13357] ppid=13355 vsize=29656 CPUtime=20.29 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 5502 0 0 0 2028 1 0 0 25 0 1 0 592137725 30367744 4678 33554432000 4194304 4785740 140736665619328 18446744073709551615 4546132 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 7414 4678 340 145 0 4459 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=20.28 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 2028 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=20.29 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 2011 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=85356 CPUtime=80.71 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 19958 1250 0 0 8068 3 0 0 18 0 5 0 592137725 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 21339 9763 162 40 0 19883 0
[pid=13360/tid=13367] ppid=13355 vsize=85356 CPUtime=20.18 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3399 1250 0 0 2018 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244500 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=85356 CPUtime=20.05 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 2005 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=85356 CPUtime=20.17 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 2017 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=85356 CPUtime=20.18 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 6896 1250 0 0 2018 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 161.86
Current children cumulated vsize (KiB) 1423824

[startup+20.5008 s]
/proc/loadavg: 2.27 0.52 0.17 9/180 13370
/proc/meminfo: memFree=18142348/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=533628 CPUtime=20.49 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 15214 0 0 0 2047 2 0 0 25 0 1 0 592137725 546435072 8945 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238252 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 133407 8945 337 96 0 129969 0
[pid=13357] ppid=13355 vsize=29656 CPUtime=20.49 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 5502 0 0 0 2048 1 0 0 25 0 1 0 592137725 30367744 4678 33554432000 4194304 4785740 140736665619328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 7414 4678 340 145 0 4459 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=20.48 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 2048 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=20.49 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 2031 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=85356 CPUtime=81.51 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 19958 1250 0 0 8148 3 0 0 18 0 5 0 592137725 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 21339 9763 162 40 0 19883 0
[pid=13360/tid=13367] ppid=13355 vsize=85356 CPUtime=20.38 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3399 1250 0 0 2038 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244384 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=85356 CPUtime=20.25 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 2025 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244483 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=85356 CPUtime=20.37 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 2037 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244409 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=85356 CPUtime=20.38 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 6896 1250 0 0 2038 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 163.46
Current children cumulated vsize (KiB) 1423824

[startup+20.6007 s]
/proc/loadavg: 2.27 0.52 0.17 9/180 13370
/proc/meminfo: memFree=18142348/32951124 swapFree=67110396/67111528
[pid=13355] ppid=13353 vsize=18324 CPUtime=0 cores=0-7
/proc/13355/stat : 13355 (ppfolio) S 13353 13355 13329 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 592137725 18763776 390 33554432000 4194304 4287625 140733599007984 18446744073709551615 224284945935 0 0 4096 65536 4445782499913629695 0 0 17 6 0 0 0
/proc/13355/statm: 4581 390 341 23 0 91 0
[pid=13356] ppid=13355 vsize=533628 CPUtime=20.58 cores=0
/proc/13356/stat : 13356 (cryptominisat) R 13355 13355 13329 0 -1 4202496 15230 0 0 0 2056 2 0 0 25 0 1 0 592137725 546435072 8960 33554432000 4194304 4587354 140736370193952 18446744073709551615 4238314 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13356/statm: 133407 8960 337 96 0 129969 0
[pid=13357] ppid=13355 vsize=29656 CPUtime=20.59 cores=1
/proc/13357/stat : 13357 (clasp) R 13355 13355 13329 0 -1 4202496 5520 0 0 0 2058 1 0 0 25 0 1 0 592137725 30367744 4696 33554432000 4194304 4785740 140736665619328 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13357/statm: 7414 4696 340 145 0 4459 0
[pid=13358] ppid=13355 vsize=463488 CPUtime=20.58 cores=2
/proc/13358/stat : 13358 (TNM) R 13355 13355 13329 0 -1 4202496 3155 0 0 0 2058 0 0 0 25 0 1 0 592137725 474611712 3051 33554432000 134512640 134534564 4293209424 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13358/statm: 115872 3051 95 6 0 114538 0
[pid=13359] ppid=13355 vsize=293372 CPUtime=20.59 cores=3
/proc/13359/stat : 13359 (march_hi) R 13355 13355 13329 0 -1 4202496 125817 0 0 0 2041 18 0 0 25 0 1 0 592137725 300412928 64346 33554432000 4194304 4331988 140733826673504 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13359/statm: 73343 64346 171 34 0 71785 0
[pid=13360] ppid=13355 vsize=85356 CPUtime=81.91 cores=4-7
/proc/13360/stat : 13360 (plingeling) S 13355 13355 13329 0 -1 4202496 19958 1250 0 0 8188 3 0 0 18 0 5 0 592137725 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13360/statm: 21339 9763 162 40 0 19883 0
[pid=13360/tid=13367] ppid=13355 vsize=85356 CPUtime=20.48 cores=4-7
/proc/13360/task/13367/stat : 13367 (plingeling) R 13355 13355 13329 0 -1 4202560 3399 1250 0 0 2048 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13360/tid=13368] ppid=13355 vsize=85356 CPUtime=20.35 cores=4-7
/proc/13360/task/13368/stat : 13368 (plingeling) R 13355 13355 13329 0 -1 4202560 2295 1250 0 0 2035 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13360/tid=13369] ppid=13355 vsize=85356 CPUtime=20.47 cores=4-7
/proc/13360/task/13369/stat : 13369 (plingeling) R 13355 13355 13329 0 -1 4202560 2795 1250 0 0 2047 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4244405 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13360/tid=13370] ppid=13355 vsize=85356 CPUtime=20.48 cores=4-7
/proc/13360/task/13370/stat : 13370 (plingeling) R 13355 13355 13329 0 -1 4202560 6896 1250 0 0 2048 0 0 0 25 0 5 0 592137736 87404544 9763 33554432000 4194304 4356188 140733458234016 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 164.25
Current children cumulated vsize (KiB) 1423824

Child status: 0
Real time (s): 20.6491
CPU time (s): 164.628
CPU user time (s): 164.341
CPU system time (s): 0.286956
CPU usage (%): 797.263
Max. virtual memory (cumulated for all children) (KiB): 1452332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 164.341
system time used= 0.286956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 171508
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 182
involuntary context switches= 846

runsolver used 0.036994 second user time and 0.078987 second system time

The end

Launcher Data 

Begin job on node118 at 2011-04-28 21:31:11
IDJOB=3310378
IDBENCH=85973
IDSOLVER=1638
FILE ID=node118/3310378-1304019070
RUNJOBID= node118-1304019070-13343
PBS_JOBID= 13170292
Free space on /tmp= 71616 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT05/industrial/grieu05/vmpc/vmpc_29.renamed-as.sat05-1916.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310378-1304019070/watcher-3310378-1304019070 -o /tmp/evaluation-result-3310378-1304019070/solver-3310378-1304019070 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310378-1304019070.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f874c09c5787bb3c6a16f7a5f9ea0ad4
RANDOM SEED=335588923

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18503708 kB
Buffers:       1895308 kB
Cached:       11951872 kB
SwapCached:        600 kB
Active:        9372436 kB
Inactive:      4539012 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18503708 kB
SwapTotal:    67111528 kB
SwapFree:     67110396 kB
Dirty:           11672 kB
Writeback:           0 kB
AnonPages:       63640 kB
Mapped:          14416 kB
Slab:           470956 kB
PageTables:       5032 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   184196 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71608 MiB
End job on node118 at 2011-04-28 21:31:31