Trace number 2699451

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB/CT 0.1 fixedMSAT (TO) 1800.07 1800.01

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900548667--soft-66-100-0.wbo
MD5SUMb93cc320d1c40ed770cd566486d12ca9
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark548.835
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints930
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 46532
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 46531
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 625
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c PB/CT 0.1.2 http://www.residual.se/pbct
0.00/0.00	c Based on OpenSMT/CT 20091015
0.00/0.01	c constraints 15/8 clauses 1762/922 units 0
0.00/0.01	c vars 231
0.00/0.05	c 0.053991 13.3203 11 2107
0.00/0.05	o 474
0.00/0.06	c 0.054991 13.457 11 2963
0.00/0.06	o 395
0.00/0.06	c 0.056991 13.457 17 3356
0.00/0.06	o 373
0.00/0.06	c 0.057991 13.457 19 3689
0.00/0.06	o 363
0.06/0.07	c 0.06099 13.457 42 3796
0.06/0.07	o 361
0.06/0.07	c 0.06499 13.457 47 3976
0.06/0.07	o 351
0.06/0.08	c 0.069989 13.457 108 4144
0.06/0.08	o 350
0.06/0.09	c 0.078987 13.457 233 4868
0.06/0.09	o 343
0.09/0.10	c 0.080987 13.457 256 5030
0.09/0.10	o 335
0.09/0.12	c 0.098984 13.457 509 5540
0.09/0.12	o 334
0.09/0.13	c 0.106983 13.457 600 5866
0.09/0.13	o 317
0.09/0.15	c 0.120981 13.457 719 6591
0.09/0.15	o 277
0.19/0.24	c 0.184971 13.582 772 8156
0.19/0.24	o 273
0.19/0.28	c 0.210967 13.582 1117 9371
0.19/0.28	o 225
0.19/0.29	c 0.217966 13.582 1190 9688
0.19/0.29	o 208
0.29/0.30	c 0.222966 13.582 617 9784
0.29/0.30	o 205
0.29/0.38	c 0.285956 13.582 1082 10712
0.29/0.38	o 192
0.39/0.44	c 0.32495 13.7031 1446 11495
0.39/0.44	o 171
0.59/0.60	c 0.445932 13.7031 1070 13183
0.59/0.60	o 162
0.59/0.67	c 0.496924 13.7031 952 14158
0.59/0.67	o 159
0.69/0.73	c 0.543917 13.7031 742 15108
0.69/0.73	o 133
0.69/0.74	c 0.552915 13.7031 823 15425
0.69/0.74	o 118
0.89/0.93	c 0.693894 13.7031 1133 17197
0.89/0.93	o 117
0.89/0.95	c 0.709892 13.7031 1228 17420
0.89/0.95	o 111
0.89/0.96	c 0.71789 13.7031 664 17556
0.89/0.96	o 110
0.99/1.02	c 0.750885 13.7031 958 18298
0.99/1.02	o 87
1.09/1.17	c 0.85287 13.7031 1078 19802
1.09/1.17	o 77
1.09/1.18	c 0.861868 13.7031 1154 20083
1.09/1.18	o 62
1.19/1.28	c 0.938857 13.7031 1152 21408
1.19/1.28	o 49
1.29/1.34	c 0.990849 13.832 1629 22141
1.29/1.34	o 48
1.29/1.37	c 1.01885 13.832 1082 22793
1.29/1.37	o 24
1.39/1.45	c 1.09083 13.832 1898 23998
1.39/1.45	o 19
2.69/2.76	c 2.24566 13.957 1069 42269
2.69/2.76	o 17
2.99/3.01	c 2.46462 14.0859 1422 46107
2.99/3.01	o 13
3.09/3.18	c 2.6136 14.0859 1472 49545
3.09/3.18	o 10
3.09/3.20	c 2.6326 14.0859 1684 49931
3.09/3.20	o 9
3.30/3.37	c 2.78758 14.0859 1237 52492
3.30/3.37	o 8
3.49/3.54	c 2.94455 14.0859 1895 54660
3.49/3.54	o 6
29.29/29.32	c 26.038 14.4648 1462 429129
29.29/29.32	o 4
30.49/30.53	c 27.1379 14.4648 1295 448493
30.49/30.53	o 1
1800.06/1800.00	s SATISFIABLE
1800.06/1800.00	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 x8 x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 x42 -x43 -x44 x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 x74 -x75 -x76 -x77 -x78 x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 -x182 x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 x210 -x211 -x212 -x213 -x214 x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2699451-1278461058/watcher-2699451-1278461058 -o /tmp/evaluation-result-2699451-1278461058/solver-2699451-1278461058 -C 1800 -W 2000 -M 3800 HOME/pbct --model HOME/instance-2699451-1278461058.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.90 4/178 14200
/proc/meminfo: memFree=29522204/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=2136 CPUtime=0
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 251 0 0 0 0 0 0 0 25 0 1 0 14319996 2187264 170 4089446400 134512640 136422188 4287128368 18446744073709551615 135818334 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/14200/statm: 534 170 144 467 0 65 0

[startup+0.0698499 s]
/proc/loadavg: 1.92 1.98 1.90 4/178 14200
/proc/meminfo: memFree=29522204/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=13776 CPUtime=0.06
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3107 0 0 0 6 0 0 0 25 0 1 0 14319996 14106624 3022 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3444 3022 236 467 0 2975 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 13776

[startup+0.100842 s]
/proc/loadavg: 1.92 1.98 1.90 4/178 14200
/proc/meminfo: memFree=29522204/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=13776 CPUtime=0.09
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3111 0 0 0 7 2 0 0 25 0 1 0 14319996 14106624 3022 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3444 3022 236 467 0 2975 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13776

[startup+0.300803 s]
/proc/loadavg: 1.92 1.98 1.90 4/178 14200
/proc/meminfo: memFree=29522204/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=13904 CPUtime=0.29
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3175 0 0 0 22 7 0 0 25 0 1 0 14319996 14237696 3079 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3476 3079 236 467 0 3007 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 13904

[startup+0.70073 s]
/proc/loadavg: 1.92 1.98 1.90 4/178 14200
/proc/meminfo: memFree=29522204/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14028 CPUtime=0.69
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3192 0 0 0 51 18 0 0 25 0 1 0 14319996 14364672 3091 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3507 3091 236 467 0 3038 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 14028

[startup+1.50058 s]
/proc/loadavg: 1.92 1.98 1.90 3/179 14202
/proc/meminfo: memFree=29510540/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14160 CPUtime=1.49
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3253 0 0 0 112 37 0 0 18 0 1 0 14319996 14499840 3140 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3540 3140 236 467 0 3071 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 14160

[startup+3.10028 s]
/proc/loadavg: 1.92 1.98 1.90 3/179 14202
/proc/meminfo: memFree=29510292/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14420 CPUtime=3.09
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3294 0 0 0 254 55 0 0 20 0 1 0 14319996 14766080 3179 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3605 3179 236 467 0 3136 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 14420

[startup+6.30069 s]
/proc/loadavg: 1.93 1.98 1.90 3/179 14202
/proc/meminfo: memFree=29510024/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14420 CPUtime=6.29
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3309 0 0 0 542 87 0 0 25 0 1 0 14319996 14766080 3190 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3605 3190 236 467 0 3136 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 14420

[startup+12.7005 s]
/proc/loadavg: 1.93 1.98 1.90 3/179 14202
/proc/meminfo: memFree=29510016/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14548 CPUtime=12.69
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3353 0 0 0 1113 156 0 0 25 0 1 0 14319996 14897152 3234 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3637 3234 236 467 0 3168 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 14548

[startup+25.5001 s]
/proc/loadavg: 1.95 1.98 1.91 3/179 14202
/proc/meminfo: memFree=29509992/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14808 CPUtime=25.49
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3409 0 0 0 2260 289 0 0 25 0 1 0 14319996 15163392 3290 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3702 3290 236 467 0 3233 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 14808

[startup+51.1003 s]
/proc/loadavg: 1.96 1.98 1.91 3/179 14203
/proc/meminfo: memFree=29509548/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=14936 CPUtime=51.09
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3443 0 0 0 4568 541 0 0 25 0 1 0 14319996 15294464 3322 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3734 3322 236 467 0 3265 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 14936

[startup+102.306 s]
/proc/loadavg: 1.98 1.98 1.91 3/179 14204
/proc/meminfo: memFree=29509260/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15200 CPUtime=102.3
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3519 0 0 0 9212 1018 0 0 25 0 1 0 14319996 15564800 3398 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3800 3398 236 467 0 3331 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 15200

[startup+162.301 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14206
/proc/meminfo: memFree=29508852/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15464 CPUtime=162.3
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3570 0 0 0 14658 1572 0 0 25 0 1 0 14319996 15835136 3449 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3866 3449 236 467 0 3397 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 15464

[startup+222.3 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14207
/proc/meminfo: memFree=29508828/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15544 CPUtime=222.3
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3609 0 0 0 20090 2140 0 0 25 0 1 0 14319996 15917056 3488 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3886 3488 236 467 0 3417 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 15544

[startup+282.3 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14209
/proc/meminfo: memFree=29508776/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15760 CPUtime=282.3
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3650 0 0 0 25543 2687 0 0 25 0 1 0 14319996 16138240 3529 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3940 3529 236 467 0 3471 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 15760

[startup+342.301 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14210
/proc/meminfo: memFree=29508600/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15760 CPUtime=342.3
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3665 0 0 0 31006 3224 0 0 25 0 1 0 14319996 16138240 3544 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3940 3544 236 467 0 3471 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 15760

[startup+402.301 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14212
/proc/meminfo: memFree=29508452/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=15892 CPUtime=402.31
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3687 0 0 0 36449 3782 0 0 25 0 1 0 14319996 16273408 3566 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 3973 3566 236 467 0 3504 0
Current children cumulated CPU time (s) 402.31
Current children cumulated vsize (KiB) 15892

[startup+462.301 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14242
/proc/meminfo: memFree=29508516/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16004 CPUtime=462.31
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3717 0 0 0 41908 4323 0 0 25 0 1 0 14319996 16388096 3596 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4001 3596 236 467 0 3532 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 16004

[startup+522.301 s]
/proc/loadavg: 1.99 1.98 1.91 3/179 14243
/proc/meminfo: memFree=29509820/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16256 CPUtime=522.31
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3763 0 0 0 47371 4860 0 0 25 0 1 0 14319996 16646144 3642 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4064 3642 236 467 0 3595 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 16256

[startup+582.3 s]
/proc/loadavg: 2.04 2.00 1.91 3/179 14245
/proc/meminfo: memFree=29509412/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16256 CPUtime=582.31
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3782 0 0 0 52827 5404 0 0 25 0 1 0 14319996 16646144 3661 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4064 3661 236 467 0 3595 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 16256

[startup+642.3 s]
/proc/loadavg: 2.01 2.00 1.91 3/179 14246
/proc/meminfo: memFree=29509108/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16392 CPUtime=642.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3810 0 0 0 58308 5924 0 0 25 0 1 0 14319996 16785408 3689 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4098 3689 236 467 0 3629 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 16392

[startup+702.301 s]

################
# More data... #
################

[startup+822.301 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14251
/proc/meminfo: memFree=29508740/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16532 CPUtime=822.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3846 0 0 0 74713 7519 0 0 25 0 1 0 14319996 16928768 3725 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4133 3725 236 467 0 3664 0
Current children cumulated CPU time (s) 822.32
Current children cumulated vsize (KiB) 16532

[startup+882.301 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14256
/proc/meminfo: memFree=29508060/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16532 CPUtime=882.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3854 0 0 0 80191 8041 0 0 25 0 1 0 14319996 16928768 3733 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4133 3733 236 467 0 3664 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 16532

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14257
/proc/meminfo: memFree=29507828/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16532 CPUtime=942.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3855 0 0 0 85643 8589 0 0 25 0 1 0 14319996 16928768 3734 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4133 3734 236 467 0 3664 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 16532

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14259
/proc/meminfo: memFree=29507788/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16664 CPUtime=1002.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3877 0 0 0 91135 9097 0 0 25 0 1 0 14319996 17063936 3756 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4166 3756 236 467 0 3697 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 16664

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14261
/proc/meminfo: memFree=29507764/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16800 CPUtime=1062.32
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3909 0 0 0 96636 9596 0 0 25 0 1 0 14319996 17203200 3788 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4200 3788 236 467 0 3731 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 16800

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14262
/proc/meminfo: memFree=29507584/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16800 CPUtime=1122.33
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3911 0 0 0 102118 10115 0 0 25 0 1 0 14319996 17203200 3790 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4200 3790 236 467 0 3731 0
Current children cumulated CPU time (s) 1122.33
Current children cumulated vsize (KiB) 16800

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14264
/proc/meminfo: memFree=29507416/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16932 CPUtime=1182.33
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3934 0 0 0 107601 10632 0 0 25 0 1 0 14319996 17338368 3813 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4233 3813 236 467 0 3764 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 16932

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14265
/proc/meminfo: memFree=29507384/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16932 CPUtime=1242.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3935 0 0 0 113078 11156 0 0 25 0 1 0 14319996 17338368 3814 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4233 3814 236 467 0 3764 0
Current children cumulated CPU time (s) 1242.34
Current children cumulated vsize (KiB) 16932

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14267
/proc/meminfo: memFree=29507212/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=16932 CPUtime=1302.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3936 0 0 0 118556 11678 0 0 25 0 1 0 14319996 17338368 3815 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4233 3815 236 467 0 3764 0
Current children cumulated CPU time (s) 1302.34
Current children cumulated vsize (KiB) 16932

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14269
/proc/meminfo: memFree=29507288/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17044 CPUtime=1362.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3958 0 0 0 124055 12179 0 0 25 0 1 0 14319996 17453056 3837 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4261 3837 236 467 0 3792 0
Current children cumulated CPU time (s) 1362.34
Current children cumulated vsize (KiB) 17044

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14270
/proc/meminfo: memFree=29506988/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17044 CPUtime=1422.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3958 0 0 0 129537 12697 0 0 25 0 1 0 14319996 17453056 3837 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4261 3837 236 467 0 3792 0
Current children cumulated CPU time (s) 1422.34
Current children cumulated vsize (KiB) 17044

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14272
/proc/meminfo: memFree=29506836/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17044 CPUtime=1482.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3965 0 0 0 135002 13232 0 0 25 0 1 0 14319996 17453056 3844 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4261 3844 236 467 0 3792 0
Current children cumulated CPU time (s) 1482.34
Current children cumulated vsize (KiB) 17044

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14273
/proc/meminfo: memFree=29506788/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17044 CPUtime=1542.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3967 0 0 0 140491 13743 0 0 25 0 1 0 14319996 17453056 3846 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4261 3846 236 467 0 3792 0
Current children cumulated CPU time (s) 1542.34
Current children cumulated vsize (KiB) 17044

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/179 14275
/proc/meminfo: memFree=29506620/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17044 CPUtime=1602.35
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3979 0 0 0 145976 14259 0 0 25 0 1 0 14319996 17453056 3858 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4261 3858 236 467 0 3792 0
Current children cumulated CPU time (s) 1602.35
Current children cumulated vsize (KiB) 17044

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 1.93 3/179 14277
/proc/meminfo: memFree=29506704/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17160 CPUtime=1662.34
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3987 0 0 0 151452 14782 0 0 25 0 1 0 14319996 17571840 3866 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4290 3866 236 467 0 3821 0
Current children cumulated CPU time (s) 1662.34
Current children cumulated vsize (KiB) 17160

[startup+1722.3 s]
/proc/loadavg: 2.09 2.02 1.93 3/179 14278
/proc/meminfo: memFree=29506548/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17160 CPUtime=1722.35
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 3993 0 0 0 156922 15313 0 0 25 0 1 0 14319996 17571840 3872 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4290 3872 236 467 0 3821 0
Current children cumulated CPU time (s) 1722.35
Current children cumulated vsize (KiB) 17160

[startup+1782.3 s]
/proc/loadavg: 2.03 2.02 1.93 3/179 14280
/proc/meminfo: memFree=29505884/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17244 CPUtime=1782.35
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 4018 0 0 0 162400 15835 0 0 25 0 1 0 14319996 17657856 3897 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4311 3897 236 467 0 3842 0
Current children cumulated CPU time (s) 1782.35
Current children cumulated vsize (KiB) 17244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.02 2.01 1.93 3/179 14280
/proc/meminfo: memFree=29506368/32951124 swapFree=67111528/67111528
[pid=14200] ppid=14198 vsize=17244 CPUtime=1800.06
/proc/14200/stat : 14200 (pbct) R 14198 14200 13847 0 -1 4202496 4019 0 0 0 164017 15989 0 0 25 0 1 0 14319996 17657856 3898 4089446400 134512640 136422188 4287128368 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/14200/statm: 4311 3898 236 467 0 3842 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 17244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.01
CPU time (s): 1800.07
CPU user time (s): 1640.18
CPU system time (s): 159.892
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 17288

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1640.18
system time used= 159.892
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4020
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2767

runsolver used 2.5956 second user time and 5.59715 second system time

The end

Launcher Data 

Begin job on node111 at 2010-07-07 02:04:18
IDJOB=2699451
IDBENCH=78972
IDSOLVER=1212
FILE ID=node111/2699451-1278461058
PBS_JOBID= 11233770
Free space on /tmp= 73820 MiB

SOLVER NAME= PB/CT 0.1 fixed
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900548667--soft-66-100-0.wbo
COMMAND LINE= HOME/pbct --model BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2699451-1278461058/watcher-2699451-1278461058 -o /tmp/evaluation-result-2699451-1278461058/solver-2699451-1278461058 -C 1800 -W 2000 -M 3800  HOME/pbct --model HOME/instance-2699451-1278461058.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= b93cc320d1c40ed770cd566486d12ca9
RANDOM SEED=520391334

node111.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5233.30
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29522856 kB
Buffers:        108620 kB
Cached:        3104984 kB
SwapCached:          0 kB
Active:        1743000 kB
Inactive:      1548016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29522856 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1944 kB
Writeback:           0 kB
AnonPages:       76952 kB
Mapped:          15444 kB
Slab:            74972 kB
PageTables:       4668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   218104 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73816 MiB
End job on node111 at 2010-07-07 02:34:20