Trace number 2695242

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB/CT 0.1MSAT (TO) 1800.04 1800.01

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/
normalized-pigeon-cardinality-25-20--soft-33-100-0.wbo
MD5SUM48f3bbbf57f9425639eae287513fe205
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark7
Best CPU time to get the best result obtained on this benchmark0.062989
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables500
Total number of constraints45
Number of soft constraints35
Number of constraints which are clauses25
Number of constraints which are cardinality constraints (but not clauses)20
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint20
Maximum length of a constraint25
Top cost 1410
Min constraint cost 1
Max constraint cost 83
Sum of constraints costs 1409
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 26
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c PB/CT 0.1.1 http://www.residual.se/pbct
0.00/0.00	c Based on OpenSMT/CT 20091015
0.00/0.00	c constraints 6/14 clauses 4/21 units 0
0.00/0.00	c vars 500
19.29/19.36	c 18.8431 6.75391 2819 109045
19.29/19.36	o 384
20.89/20.90	c 20.3769 6.75391 2910 116438
20.89/20.90	o 226
25.69/25.74	c 25.1472 6.75391 3080 131735
25.69/25.74	o 209
25.79/25.81	c 25.2152 6.75391 3081 131905
25.79/25.81	o 182
25.79/25.84	c 25.2442 6.75391 3081 131962
25.79/25.84	o 178
25.90/25.92	c 25.3202 6.75391 3083 132138
25.90/25.92	o 100
34.49/34.51	c 33.8309 6.75391 3378 155197
34.49/34.51	o 59
35.49/35.59	c 34.8967 6.75391 3411 157681
35.49/35.59	o 55
36.19/36.24	c 35.5506 6.75391 3442 159369
36.19/36.24	o 43
36.30/36.33	c 35.6386 6.88281 3444 159584
36.30/36.33	o 39
65.80/65.87	c 64.8691 6.88281 3714 210207
65.80/65.87	o 36
1800.03/1800.00	s SATISFIABLE
1800.03/1800.00	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 -x457 x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 -x495 x496 -x497 -x498 -x499 -x500

Verifier Data 

OK	36

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2695242-1277893553/watcher-2695242-1277893553 -o /tmp/evaluation-result-2695242-1277893553/solver-2695242-1277893553 -C 1800 -W 2000 -M 3800 HOME/pbct --model HOME/instance-2695242-1277893553.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.00 1.99 3/196 9623
/proc/meminfo: memFree=31421308/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=3972 CPUtime=0
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 694 0 0 0 0 0 0 0 22 0 1 0 130653312 4067328 613 4089446400 134512640 136421960 4294766656 18446744073709551615 135811817 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 993 614 193 467 0 524 0

[startup+0.0735741 s]
/proc/loadavg: 1.93 2.00 1.99 3/196 9623
/proc/meminfo: memFree=31421308/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=0.06
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1411 0 0 0 2 4 0 0 23 0 1 0 130653312 6946816 1330 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1330 214 467 0 1227 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 6784

[startup+0.100569 s]
/proc/loadavg: 1.93 2.00 1.99 3/196 9623
/proc/meminfo: memFree=31421308/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=0.09
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1412 0 0 0 3 6 0 0 23 0 1 0 130653312 6946816 1331 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1331 214 467 0 1227 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 6784

[startup+0.30053 s]
/proc/loadavg: 1.93 2.00 1.99 3/196 9623
/proc/meminfo: memFree=31421308/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=0.29
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1416 0 0 0 17 12 0 0 23 0 1 0 130653312 6946816 1335 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1335 214 467 0 1227 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 6784

[startup+0.700459 s]
/proc/loadavg: 1.93 2.00 1.99 3/196 9623
/proc/meminfo: memFree=31421308/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=0.69
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1420 0 0 0 54 15 0 0 25 0 1 0 130653312 6946816 1339 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1339 214 467 0 1227 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 6784

[startup+1.50032 s]
/proc/loadavg: 1.94 2.00 1.99 3/197 9624
/proc/meminfo: memFree=31416596/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=1.49
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1421 0 0 0 130 19 0 0 25 0 1 0 130653312 6946816 1340 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1340 214 467 0 1227 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 6784

[startup+3.10104 s]
/proc/loadavg: 1.94 2.00 1.99 3/197 9624
/proc/meminfo: memFree=31416472/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=3.09
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1426 0 0 0 285 24 0 0 25 0 1 0 130653312 6946816 1345 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1345 214 467 0 1227 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 6784

[startup+6.30048 s]
/proc/loadavg: 1.94 2.00 1.99 3/197 9624
/proc/meminfo: memFree=31417092/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6784 CPUtime=6.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1428 0 0 0 599 31 0 0 25 0 1 0 130653312 6946816 1347 4089446400 134512640 136421960 4294766656 18446744073709551615 134902548 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1696 1347 214 467 0 1227 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 6784

[startup+12.7003 s]
/proc/loadavg: 1.95 2.00 1.99 3/197 9624
/proc/meminfo: memFree=31418096/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6912 CPUtime=12.69
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1432 0 0 0 1228 41 0 0 25 0 1 0 130653312 7077888 1351 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1728 1351 214 467 0 1259 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 6912

[startup+25.5011 s]
/proc/loadavg: 1.96 2.00 1.99 3/197 9624
/proc/meminfo: memFree=31419468/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=6912 CPUtime=25.49
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1472 0 0 0 2490 59 0 0 25 0 1 0 130653312 7077888 1389 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1728 1389 237 467 0 1259 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 6912

[startup+51.1006 s]
/proc/loadavg: 1.97 2.00 1.99 3/197 9626
/proc/meminfo: memFree=31410980/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=51.09
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1499 0 0 0 5024 85 0 0 25 0 1 0 130653312 7213056 1408 4089446400 134512640 136421960 4294766656 18446744073709551615 134902134 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1408 237 467 0 1292 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 7044

[startup+102.307 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9626
/proc/meminfo: memFree=31410436/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=102.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1502 0 0 0 10089 141 0 0 25 0 1 0 130653312 7213056 1410 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1410 237 467 0 1292 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 7044

[startup+162.301 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9628
/proc/meminfo: memFree=31410244/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=162.29
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1505 0 0 0 16027 202 0 0 25 0 1 0 130653312 7213056 1413 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1413 237 467 0 1292 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 7044

[startup+222.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9630
/proc/meminfo: memFree=31410196/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=222.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1507 0 0 0 21962 268 0 0 25 0 1 0 130653312 7213056 1415 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1415 237 467 0 1292 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 7044

[startup+282.301 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9632
/proc/meminfo: memFree=31409876/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=282.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1508 0 0 0 27896 334 0 0 25 0 1 0 130653312 7213056 1416 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1416 237 467 0 1292 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 7044

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9637
/proc/meminfo: memFree=31408932/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=342.29
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1509 0 0 0 33826 403 0 0 25 0 1 0 130653312 7213056 1417 4089446400 134512640 136421960 4294766656 18446744073709551615 134902384 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1417 237 467 0 1292 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 7044

[startup+402.301 s]
/proc/loadavg: 1.99 2.00 1.99 3/197 9637
/proc/meminfo: memFree=31408896/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=402.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1509 0 0 0 39760 470 0 0 25 0 1 0 130653312 7213056 1417 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1417 237 467 0 1292 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 7044

[startup+462.301 s]
/proc/loadavg: 2.04 2.01 2.00 3/197 9639
/proc/meminfo: memFree=31408608/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=462.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1509 0 0 0 45697 533 0 0 25 0 1 0 130653312 7213056 1417 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1417 237 467 0 1292 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 7044

[startup+522.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/197 9641
/proc/meminfo: memFree=31392832/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=522.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1509 0 0 0 51633 597 0 0 25 0 1 0 130653312 7213056 1417 4089446400 134512640 136421960 4294766656 18446744073709551615 134902536 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/9623/statm: 1761 1417 237 467 0 1292 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 7044

[startup+582.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/197 9643
/proc/meminfo: memFree=31392864/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=582.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1509 0 0 0 57575 655 0 0 25 0 1 0 130653312 7213056 1417 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1417 237 467 0 1292 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 7044

[startup+642.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/197 9645
/proc/meminfo: memFree=31392428/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=642.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1510 0 0 0 63525 706 0 0 25 0 1 0 130653312 7213056 1418 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1418 237 467 0 1292 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 7044

[startup+702.301 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/197 9649
/proc/meminfo: memFree=31391512/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=822.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 81390 840 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 7044

[startup+882.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/197 9651
/proc/meminfo: memFree=31391088/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=882.3
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 87343 887 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 7044

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/197 9652
/proc/meminfo: memFree=31390764/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=942.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 93299 932 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 7044

[startup+1002.3 s]
/proc/loadavg: 2.07 2.03 2.01 3/179 9736
/proc/meminfo: memFree=31609532/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1002.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 99232 999 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902384 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 7044

[startup+1062.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/179 9738
/proc/meminfo: memFree=31609264/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1062.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 105168 1063 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902512 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 7044

[startup+1122.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/179 9740
/proc/meminfo: memFree=31609108/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1122.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 111104 1127 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 7044

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 9742
/proc/meminfo: memFree=31608940/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1182.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 117038 1193 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 7044

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9743
/proc/meminfo: memFree=31608408/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1242.31
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 122973 1258 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902581 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 7044

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9744
/proc/meminfo: memFree=31608476/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1302.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 128910 1322 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1302.32
Current children cumulated vsize (KiB) 7044

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9746
/proc/meminfo: memFree=31608436/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1362.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 134852 1380 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1362.32
Current children cumulated vsize (KiB) 7044

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9748
/proc/meminfo: memFree=31608656/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1422.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1511 0 0 0 140788 1444 0 0 25 0 1 0 130653312 7213056 1419 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1419 237 467 0 1292 0
Current children cumulated CPU time (s) 1422.32
Current children cumulated vsize (KiB) 7044

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9750
/proc/meminfo: memFree=31608500/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1482.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1512 0 0 0 146722 1510 0 0 25 0 1 0 130653312 7213056 1420 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1420 237 467 0 1292 0
Current children cumulated CPU time (s) 1482.32
Current children cumulated vsize (KiB) 7044

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9752
/proc/meminfo: memFree=31608572/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1542.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1512 0 0 0 152656 1576 0 0 25 0 1 0 130653312 7213056 1420 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1420 237 467 0 1292 0
Current children cumulated CPU time (s) 1542.32
Current children cumulated vsize (KiB) 7044

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9752
/proc/meminfo: memFree=31608668/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1602.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1514 0 0 0 158592 1640 0 0 25 0 1 0 130653312 7213056 1422 4089446400 134512640 136421960 4294766656 18446744073709551615 134902275 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1422 237 467 0 1292 0
Current children cumulated CPU time (s) 1602.32
Current children cumulated vsize (KiB) 7044

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9754
/proc/meminfo: memFree=31608260/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1662.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1514 0 0 0 164530 1702 0 0 25 0 1 0 130653312 7213056 1422 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1422 237 467 0 1292 0
Current children cumulated CPU time (s) 1662.32
Current children cumulated vsize (KiB) 7044

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9756
/proc/meminfo: memFree=31608340/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1722.33
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1514 0 0 0 170462 1771 0 0 25 0 1 0 130653312 7213056 1422 4089446400 134512640 136421960 4294766656 18446744073709551615 134902408 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1422 237 467 0 1292 0
Current children cumulated CPU time (s) 1722.33
Current children cumulated vsize (KiB) 7044

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9758
/proc/meminfo: memFree=31608312/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1782.32
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1514 0 0 0 176395 1837 0 0 25 0 1 0 130653312 7213056 1422 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1422 237 467 0 1292 0
Current children cumulated CPU time (s) 1782.32
Current children cumulated vsize (KiB) 7044



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 9758
/proc/meminfo: memFree=31608528/32951124 swapFree=67111528/67111528
[pid=9623] ppid=9621 vsize=7044 CPUtime=1800.03
/proc/9623/stat : 9623 (pbct) R 9621 9623 8514 0 -1 4202496 1514 0 0 0 178148 1855 0 0 25 0 1 0 130653312 7213056 1422 4089446400 134512640 136421960 4294766656 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/9623/statm: 1761 1422 237 467 0 1292 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 7044

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.01
CPU time (s): 1800.04
CPU user time (s): 1781.49
CPU system time (s): 18.5552
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 7044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1781.49
system time used= 18.5552
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1515
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1
involuntary context switches= 3563

runsolver used 2.55561 second user time and 5.65614 second system time

The end

Launcher Data 

Begin job on node103 at 2010-06-30 12:25:53
IDJOB=2695242
IDBENCH=78728
IDSOLVER=1208
FILE ID=node103/2695242-1277893553
PBS_JOBID= 11197148
Free space on /tmp= 74212 MiB

SOLVER NAME= PB/CT 0.1
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/normalized-pigeon-cardinality-25-20--soft-33-100-0.wbo
COMMAND LINE= HOME/pbct --model BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2695242-1277893553/watcher-2695242-1277893553 -o /tmp/evaluation-result-2695242-1277893553/solver-2695242-1277893553 -C 1800 -W 2000 -M 3800  HOME/pbct --model HOME/instance-2695242-1277893553.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 48f3bbbf57f9425639eae287513fe205
RANDOM SEED=1319888978

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31421960 kB
Buffers:        175708 kB
Cached:         892228 kB
SwapCached:          0 kB
Active:         755300 kB
Inactive:       631904 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31421960 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1956 kB
Writeback:           0 kB
AnonPages:      319996 kB
Mapped:          20328 kB
Slab:            76612 kB
PageTables:       5484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1644768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74208 MiB
End job on node103 at 2010-06-30 12:55:55