Trace number 2699425

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB/CT 0.1 fixedMSAT (TO) 1800.06 1800.01

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900581320--soft-33-100-0.wbo
MD5SUM8591b35e74198f55af565a685d4a35ec
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark331.278
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1837
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 93832
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 93831
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 641
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c PB/CT 0.1.2 http://www.residual.se/pbct
0.00/0.00	c Based on OpenSMT/CT 20091015
0.00/0.01	c constraints 5/18 clauses 865/1819 units 0
0.00/0.01	c vars 231
0.00/0.08	c 0.075988 16.8438 11 9301
0.00/0.08	o 723
0.09/0.10	c 0.080987 17.2422 30 9815
0.09/0.10	o 718
0.09/0.10	c 0.082987 17.2422 31 12316
0.09/0.10	o 521
0.09/0.11	c 0.083987 17.2422 37 12684
0.09/0.11	o 508
0.09/0.14	c 0.090986 17.2422 159 13946
0.09/0.14	o 461
0.09/0.14	c 0.093985 17.2422 167 14363
0.09/0.14	o 450
0.09/0.18	c 0.102984 17.2422 282 15864
0.09/0.18	o 406
0.09/0.19	c 0.104984 17.2422 283 16084
0.09/0.19	o 400
0.09/0.19	c 0.108983 17.2422 294 16428
0.09/0.19	o 388
0.19/0.21	c 0.110983 17.2422 362 17184
0.19/0.21	o 359
0.29/0.34	c 0.145977 17.2422 706 18818
0.29/0.34	o 346
0.49/0.55	c 0.207968 17.3594 658 20886
0.49/0.55	o 314
0.59/0.60	c 0.222966 17.3594 808 21774
0.59/0.60	o 290
0.69/0.78	c 0.279957 17.3594 1151 22797
0.69/0.78	o 285
1.39/1.40	c 0.429934 17.3594 1323 26240
1.39/1.40	o 271
1.39/1.48	c 0.444932 17.3594 885 27692
1.39/1.48	o 225
1.59/1.62	c 0.461929 17.3594 611 28981
1.59/1.62	o 210
1.59/1.63	c 0.461929 17.3594 615 29208
1.59/1.63	o 205
1.59/1.63	c 0.463929 17.3594 621 29377
1.59/1.63	o 204
1.59/1.66	c 0.467928 17.3594 659 30255
1.59/1.66	o 164
1.59/1.68	c 0.474927 17.3594 687 30505
1.59/1.68	o 158
2.29/2.35	c 0.593909 17.4805 1456 33738
2.29/2.35	o 152
2.39/2.43	c 0.605907 17.4805 869 34412
2.39/2.43	o 142
2.59/2.65	c 0.657899 17.4805 821 35739
2.59/2.65	o 141
2.59/2.66	c 0.660899 17.4805 830 35948
2.59/2.66	o 137
2.79/2.81	c 0.697893 17.4805 1147 36945
2.79/2.81	o 133
2.79/2.82	c 0.702893 17.4805 1187 37239
2.79/2.82	o 124
3.29/3.37	c 0.827874 17.4805 1176 39956
3.29/3.37	o 117
4.49/4.58	c 1.05684 17.4805 1324 45272
4.49/4.58	o 81
5.09/5.14	c 1.22481 17.4805 823 48288
5.09/5.14	o 70
6.69/6.77	c 1.77073 17.6016 1011 59467
6.69/6.77	o 56
7.80/7.87	c 2.29265 18.1016 1697 67123
7.80/7.87	o 55
8.99/9.08	c 2.79257 18.1016 1744 75819
8.99/9.08	o 43
11.89/11.97	c 4.24036 18.6172 2395 99023
11.89/11.97	o 21
15.89/15.91	c 6.94894 19.7812 2661 148312
15.89/15.91	o 19
16.29/16.34	c 7.2329 19.7812 2361 155050
16.29/16.34	o 17
16.50/16.55	c 7.38288 19.7812 1605 158576
16.50/16.55	o 15
30.70/30.71	c 17.4703 19.7812 2851 372531
30.70/30.71	o 6
37.39/37.43	c 22.6066 19.7812 2336 472651
37.39/37.43	o 5
41.39/41.48	c 25.7251 19.7812 1811 534941
41.39/41.48	o 2
44.79/44.88	c 28.3607 19.7812 2845 583785
44.79/44.88	o 1
1800.05/1800.00	s SATISFIABLE
1800.05/1800.00	v x1 -x2 -x3 -x4 -x5 -x6 -x7 x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 x62 -x63 -x64 -x65 -x66 -x67 x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 x109 -x110 -x111 -x112 -x113 -x114 -x115 x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 x189 -x190 -x191 -x192 x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 x211 -x212 -x213 -x214 -x215 x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2699425-1278461053/watcher-2699425-1278461053 -o /tmp/evaluation-result-2699425-1278461053/solver-2699425-1278461053 -C 1800 -W 2000 -M 3800 HOME/pbct --model HOME/instance-2699425-1278461053.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.99 1.92 4/182 13515
/proc/meminfo: memFree=29291100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=2136 CPUtime=0
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 256 0 0 0 0 0 0 0 21 0 1 0 14318074 2187264 175 4089446400 134512640 136422188 4293031824 18446744073709551615 135642118 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/13515/statm: 534 175 144 467 0 65 0

[startup+0.0936161 s]
/proc/loadavg: 1.92 1.99 1.92 4/182 13515
/proc/meminfo: memFree=29291100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17652 CPUtime=0.08
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4078 0 0 0 7 1 0 0 21 0 1 0 14318074 18075648 3996 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4413 3996 236 467 0 3944 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 17652

[startup+0.100615 s]
/proc/loadavg: 1.92 1.99 1.92 4/182 13515
/proc/meminfo: memFree=29291100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17652 CPUtime=0.09
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4078 0 0 0 8 1 0 0 21 0 1 0 14318074 18075648 3996 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4413 3996 236 467 0 3944 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17652

[startup+0.300577 s]
/proc/loadavg: 1.92 1.99 1.92 4/182 13515
/proc/meminfo: memFree=29291100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17652 CPUtime=0.29
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4093 0 0 0 13 16 0 0 21 0 1 0 14318074 18075648 4002 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4413 4002 236 467 0 3944 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17652

[startup+0.700514 s]
/proc/loadavg: 1.92 1.99 1.92 4/182 13515
/proc/meminfo: memFree=29291100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17772 CPUtime=0.69
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4104 0 0 0 25 44 0 0 22 0 1 0 14318074 18198528 4010 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4443 4010 236 467 0 3974 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17772

[startup+1.50038 s]
/proc/loadavg: 1.92 1.99 1.92 3/183 13516
/proc/meminfo: memFree=29276088/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17772 CPUtime=1.49
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4127 0 0 0 44 105 0 0 25 0 1 0 14318074 18198528 4030 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4443 4030 236 467 0 3974 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 17772

[startup+3.10107 s]
/proc/loadavg: 1.92 1.99 1.92 3/183 13516
/proc/meminfo: memFree=29276088/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=17896 CPUtime=3.09
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4155 0 0 0 75 234 0 0 25 0 1 0 14318074 18325504 4047 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4474 4047 236 467 0 4005 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 17896

[startup+6.30051 s]
/proc/loadavg: 1.93 1.99 1.92 3/183 13516
/proc/meminfo: memFree=29276472/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=18020 CPUtime=6.29
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4207 0 0 0 160 469 0 0 25 0 1 0 14318074 18452480 4096 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4505 4096 236 467 0 4036 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 18020

[startup+12.7003 s]
/proc/loadavg: 1.93 1.99 1.92 3/183 13516
/proc/meminfo: memFree=29275944/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=19060 CPUtime=12.69
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4469 0 0 0 471 798 0 0 25 0 1 0 14318074 19517440 4354 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 4765 4354 236 467 0 4296 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 19060

[startup+25.501 s]
/proc/loadavg: 1.95 1.99 1.92 3/183 13517
/proc/meminfo: memFree=29275376/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=25.49
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4773 0 0 0 1372 1177 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 20252

[startup+51.1003 s]
/proc/loadavg: 1.96 1.99 1.92 3/183 13517
/proc/meminfo: memFree=29275076/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=51.09
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 3301 1808 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 20252

[startup+102.306 s]
/proc/loadavg: 2.02 2.00 1.93 3/183 13519
/proc/meminfo: memFree=29274676/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=102.3
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 7252 2978 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 20252

[startup+162.301 s]
/proc/loadavg: 2.01 2.00 1.93 3/183 13520
/proc/meminfo: memFree=29274652/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=162.29
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 11847 4382 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 20252

[startup+222.301 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13522
/proc/meminfo: memFree=29274496/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=222.29
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 16450 5779 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 20252

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13523
/proc/meminfo: memFree=29274588/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=282.29
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 21076 7153 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 20252

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13525
/proc/meminfo: memFree=29274552/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20252 CPUtime=342.3
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4777 0 0 0 25714 8516 0 0 25 0 1 0 14318074 20738048 4655 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5063 4655 236 467 0 4594 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 20252

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13527
/proc/meminfo: memFree=29274272/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20380 CPUtime=402.3
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4787 0 0 0 30380 9850 0 0 25 0 1 0 14318074 20869120 4665 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5095 4665 236 467 0 4626 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 20380

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13528
/proc/meminfo: memFree=29273872/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20380 CPUtime=462.3
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4812 0 0 0 34993 11237 0 0 25 0 1 0 14318074 20869120 4690 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5095 4690 236 467 0 4626 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 20380

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13558
/proc/meminfo: memFree=29136056/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20644 CPUtime=522.31
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4861 0 0 0 39628 12603 0 0 25 0 1 0 14318074 21139456 4739 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5161 4739 236 467 0 4692 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 20644

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13559
/proc/meminfo: memFree=29134268/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20776 CPUtime=582.3
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4880 0 0 0 44283 13947 0 0 25 0 1 0 14318074 21274624 4758 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5194 4758 236 467 0 4725 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 20776

[startup+642.301 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13561
/proc/meminfo: memFree=29133100/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20776 CPUtime=642.31
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4900 0 0 0 48954 15277 0 0 25 0 1 0 14318074 21274624 4778 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5194 4778 236 467 0 4725 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 20776

[startup+702.301 s]

################
# More data... #
################

[startup+822.301 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13566
/proc/meminfo: memFree=29133024/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20980 CPUtime=822.31
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4944 0 0 0 62936 19295 0 0 25 0 1 0 14318074 21483520 4822 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5245 4822 236 467 0 4776 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 20980

[startup+882.301 s]
/proc/loadavg: 2.00 2.00 1.93 4/184 13570
/proc/meminfo: memFree=29130596/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=20980 CPUtime=882.31
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4960 0 0 0 67628 20603 0 0 25 0 1 0 14318074 21483520 4838 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5245 4838 236 467 0 4776 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 20980

[startup+942.301 s]
/proc/loadavg: 2.00 2.00 1.93 3/183 13572
/proc/meminfo: memFree=29132176/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21112 CPUtime=942.32
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4967 0 0 0 72260 21972 0 0 25 0 1 0 14318074 21618688 4845 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5278 4845 236 467 0 4809 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 21112

[startup+1002.3 s]
/proc/loadavg: 2.03 2.01 1.93 3/183 13574
/proc/meminfo: memFree=29131756/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21112 CPUtime=1002.32
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 4974 0 0 0 76882 23350 0 0 25 0 1 0 14318074 21618688 4852 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5278 4852 236 467 0 4809 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 21112

[startup+1062.3 s]
/proc/loadavg: 2.05 2.02 1.94 3/183 13575
/proc/meminfo: memFree=29131680/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21244 CPUtime=1062.32
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5010 0 0 0 81571 24661 0 0 25 0 1 0 14318074 21753856 4888 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5311 4888 236 467 0 4842 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 21244

[startup+1122.3 s]
/proc/loadavg: 2.07 2.03 1.94 3/183 13577
/proc/meminfo: memFree=29131360/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21376 CPUtime=1122.32
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5035 0 0 0 86289 25943 0 0 25 0 1 0 14318074 21889024 4913 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5344 4913 236 467 0 4875 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 21376

[startup+1182.3 s]
/proc/loadavg: 2.10 2.04 1.95 3/183 13578
/proc/meminfo: memFree=29131028/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21508 CPUtime=1182.33
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5051 0 0 0 90977 27256 0 0 25 0 1 0 14318074 22024192 4929 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5377 4929 236 467 0 4908 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 21508

[startup+1242.3 s]
/proc/loadavg: 2.04 2.03 1.95 3/183 13580
/proc/meminfo: memFree=29130576/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21508 CPUtime=1242.32
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5072 0 0 0 95686 28546 0 0 25 0 1 0 14318074 22024192 4950 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5377 4950 236 467 0 4908 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 21508

[startup+1302.3 s]
/proc/loadavg: 2.01 2.02 1.95 3/183 13609
/proc/meminfo: memFree=29104328/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21652 CPUtime=1302.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5087 0 0 0 100376 29858 0 0 25 0 1 0 14318074 22171648 4965 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5413 4965 236 467 0 4944 0
Current children cumulated CPU time (s) 1302.34
Current children cumulated vsize (KiB) 21652

[startup+1362.3 s]
/proc/loadavg: 2.00 2.02 1.95 3/183 13610
/proc/meminfo: memFree=29101460/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21652 CPUtime=1362.33
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5095 0 0 0 105071 31162 0 0 25 0 1 0 14318074 22171648 4973 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5413 4973 236 467 0 4944 0
Current children cumulated CPU time (s) 1362.33
Current children cumulated vsize (KiB) 21652

[startup+1422.31 s]
/proc/loadavg: 2.00 2.01 1.95 3/183 13612
/proc/meminfo: memFree=29099908/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21652 CPUtime=1422.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5107 0 0 0 109789 32445 0 0 25 0 1 0 14318074 22171648 4985 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5413 4985 236 467 0 4944 0
Current children cumulated CPU time (s) 1422.34
Current children cumulated vsize (KiB) 21652

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/183 13613
/proc/meminfo: memFree=29099736/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1482.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5127 0 0 0 114467 33767 0 0 25 0 1 0 14318074 22306816 5005 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5005 236 467 0 4977 0
Current children cumulated CPU time (s) 1482.34
Current children cumulated vsize (KiB) 21784

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/183 13615
/proc/meminfo: memFree=29099412/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1542.33
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5128 0 0 0 119104 35129 0 0 25 0 1 0 14318074 22306816 5006 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5006 236 467 0 4977 0
Current children cumulated CPU time (s) 1542.33
Current children cumulated vsize (KiB) 21784

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/183 13617
/proc/meminfo: memFree=29099504/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1602.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5133 0 0 0 123787 36447 0 0 25 0 1 0 14318074 22306816 5011 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5011 236 467 0 4977 0
Current children cumulated CPU time (s) 1602.34
Current children cumulated vsize (KiB) 21784

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/183 13618
/proc/meminfo: memFree=29098456/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1662.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5137 0 0 0 128486 37748 0 0 25 0 1 0 14318074 22306816 5015 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5015 236 467 0 4977 0
Current children cumulated CPU time (s) 1662.34
Current children cumulated vsize (KiB) 21784

[startup+1722.3 s]
/proc/loadavg: 2.04 2.01 1.95 3/183 13620
/proc/meminfo: memFree=29098660/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1722.34
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5145 0 0 0 133183 39051 0 0 25 0 1 0 14318074 22306816 5023 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5023 236 467 0 4977 0
Current children cumulated CPU time (s) 1722.34
Current children cumulated vsize (KiB) 21784

[startup+1782.3 s]
/proc/loadavg: 2.07 2.02 1.96 3/183 13621
/proc/meminfo: memFree=29098336/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21784 CPUtime=1782.35
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5153 0 0 0 137874 40361 0 0 25 0 1 0 14318074 22306816 5031 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5446 5031 236 467 0 4977 0
Current children cumulated CPU time (s) 1782.35
Current children cumulated vsize (KiB) 21784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.05 2.02 1.96 3/183 13622
/proc/meminfo: memFree=29098196/32951124 swapFree=67111528/67111528
[pid=13515] ppid=13513 vsize=21924 CPUtime=1800.05
/proc/13515/stat : 13515 (pbct) R 13513 13515 13125 0 -1 4202496 5160 0 0 0 139284 40721 0 0 25 0 1 0 14318074 22450176 5038 4089446400 134512640 136422188 4293031824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13515/statm: 5481 5038 236 467 0 5012 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 21924

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.01
CPU time (s): 1800.06
CPU user time (s): 1392.84
CPU system time (s): 407.216
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 21924

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1392.84
system time used= 407.216
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5161
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1
involuntary context switches= 19865

runsolver used 3.20251 second user time and 6.20406 second system time

The end

Launcher Data 

Begin job on node133 at 2010-07-07 02:04:13
IDJOB=2699425
IDBENCH=78959
IDSOLVER=1212
FILE ID=node133/2699425-1278461053
PBS_JOBID= 11233727
Free space on /tmp= 73800 MiB

SOLVER NAME= PB/CT 0.1 fixed
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900581320--soft-33-100-0.wbo
COMMAND LINE= HOME/pbct --model BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2699425-1278461053/watcher-2699425-1278461053 -o /tmp/evaluation-result-2699425-1278461053/solver-2699425-1278461053 -C 1800 -W 2000 -M 3800  HOME/pbct --model HOME/instance-2699425-1278461053.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 8591b35e74198f55af565a685d4a35ec
RANDOM SEED=72121912

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29291256 kB
Buffers:        108628 kB
Cached:        3332632 kB
SwapCached:          0 kB
Active:         649880 kB
Inactive:      2869536 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29291256 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2036 kB
Writeback:           0 kB
AnonPages:       78252 kB
Mapped:          15460 kB
Slab:            76324 kB
PageTables:       5220 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   220056 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73796 MiB
End job on node133 at 2010-07-07 02:34:15