Trace number 2695122

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB/CT 0.1MSAT (TO) 1800.02 1800.01

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900577940--soft-0-100-0.wbo
MD5SUM2d690d91fe5f00c81c2e61f07f4a896b
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark510.174
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 136180
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 136179
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 661
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c PB/CT 0.1.1 http://www.residual.se/pbct
0.00/0.00	c Based on OpenSMT/CT 20091015
0.00/0.01	c constraints 0/23 clauses 0/2684 units 0
0.00/0.01	c vars 231
0.09/0.13	c 0.102984 19.9805 48 24089
0.09/0.13	o 491
0.09/0.17	c 0.108983 20.2148 73 26755
0.09/0.17	o 449
0.19/0.27	c 0.12698 20.4492 187 32368
0.19/0.27	o 423
0.19/0.27	c 0.12698 20.4492 187 33063
0.19/0.27	o 409
0.19/0.28	c 0.12798 20.4492 187 34300
0.19/0.28	o 372
0.19/0.28	c 0.12898 20.4492 188 35335
0.19/0.28	o 343
0.58/0.65	c 0.182972 20.4492 711 40516
0.58/0.65	o 334
0.58/0.66	c 0.185971 20.4492 717 43684
0.58/0.66	o 265
3.08/3.10	c 0.604908 20.4492 1061 73804
3.08/3.10	o 262
3.08/3.10	c 0.605907 20.4492 1064 74044
3.08/3.10	o 259
3.29/3.39	c 0.668898 20.4492 706 78509
3.29/3.39	o 249
8.28/8.30	c 1.2858 20.4492 1060 308049
8.28/8.30	o 243
8.88/8.91	c 1.38879 20.4492 1191 310858
8.88/8.91	o 235
8.98/9.05	c 1.42078 20.4492 768 311982
8.98/9.05	o 224
9.78/9.83	c 1.63475 20.4492 1074 316343
9.78/9.83	o 205
10.38/10.47	c 1.80773 20.5781 937 318712
10.38/10.47	o 201
11.68/11.79	c 2.22366 20.5781 625 360765
11.68/11.79	o 195
11.78/11.88	c 2.25466 20.5781 699 361601
11.78/11.88	o 185
12.58/12.66	c 2.44163 20.5781 911 386699
12.58/12.66	o 183
15.77/15.81	c 2.97255 20.5781 677 442540
15.77/15.81	o 167
15.88/15.92	c 2.99954 20.5781 848 443755
15.88/15.92	o 153
16.67/16.75	c 3.18552 20.5781 841 458263
16.67/16.75	o 131
17.58/17.61	c 3.34749 20.5781 1007 471208
17.58/17.61	o 129
28.28/28.31	c 6.18206 20.5781 1015 1020184
28.28/28.31	o 117
29.68/29.74	c 6.64299 20.5781 956 1024363
29.68/29.74	o 106
29.79/29.89	c 6.70998 20.707 1339 1025569
29.79/29.89	o 100
30.88/30.92	c 7.04993 20.707 937 1029068
30.88/30.92	o 85
31.58/31.66	c 7.32289 20.707 1008 1030982
31.58/31.66	o 80
32.08/32.10	c 7.47086 20.707 898 1032889
32.08/32.10	o 73
32.08/32.11	c 7.47486 20.707 915 1033246
32.08/32.11	o 64
33.18/33.28	c 7.99978 20.8359 1696 1042020
33.18/33.28	o 62
33.18/33.29	c 8.00378 20.8359 1714 1042411
33.18/33.29	o 51
33.58/33.61	c 8.13076 20.8359 1250 1043879
33.58/33.61	o 45
33.58/33.69	c 8.16276 20.8359 1380 1044447
33.58/33.69	o 34
33.88/33.97	c 8.30874 20.8359 2397 1046336
33.88/33.97	o 31
35.28/35.36	c 9.06862 21.0938 2822 1054677
35.28/35.36	o 28
35.38/35.47	c 9.13161 21.2227 1758 1055981
35.38/35.47	o 22
35.48/35.59	c 9.2016 21.2227 2504 1057395
35.48/35.59	o 21
35.58/35.68	c 9.25859 21.2227 3023 1058531
35.58/35.68	o 11
36.78/36.84	c 10.1395 21.7383 2379 1074825
36.78/36.84	o 3
51.48/51.50	c 22.7155 23.1562 2615 1266919
51.48/51.50	o 2
52.68/52.72	c 23.8044 23.1562 2763 1283625
52.68/52.72	o 1
1800.01/1800.00	s SATISFIABLE
1800.01/1800.00	v -x1 x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 x32 -x33 -x34 -x35 -x36 -x37 x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 x55 -x56 -x57 x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 x84 -x85 -x86 -x87 -x88 -x89 x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 x151 -x152 -x153 -x154 -x155 x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 x170 -x171 -x172 x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 x189 -x190 -x191 -x192 -x193 -x194 x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 x226 -x227 -x228 -x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2695122-1277930236/watcher-2695122-1277930236 -o /tmp/evaluation-result-2695122-1277930236/solver-2695122-1277930236 -C 1800 -W 2000 -M 3800 HOME/pbct --model HOME/instance-2695122-1277930236.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.20 2.09 2.03 4/196 27251
/proc/meminfo: memFree=30724064/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=2136 CPUtime=0
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 254 0 0 0 0 0 0 0 20 0 1 0 166663162 2187264 174 4089446400 134512640 136421960 4292720784 18446744073709551615 135717562 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/27251/statm: 534 174 144 467 0 65 0

[startup+0.104035 s]
/proc/loadavg: 2.20 2.09 2.03 4/196 27251
/proc/meminfo: memFree=30724064/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20456 CPUtime=0.09
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4751 0 0 0 9 0 0 0 20 0 1 0 166663162 20946944 4638 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/27251/statm: 5114 4638 213 467 0 4645 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20456

[startup+0.202022 s]
/proc/loadavg: 2.20 2.09 2.03 4/196 27251
/proc/meminfo: memFree=30724064/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=0.19
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4844 0 0 0 11 8 0 0 20 0 1 0 166663162 21438464 4729 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/27251/statm: 5234 4729 236 467 0 4765 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 20936

[startup+0.300951 s]
/proc/loadavg: 2.20 2.09 2.03 4/196 27251
/proc/meminfo: memFree=30724064/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=0.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4849 0 0 0 12 16 0 0 20 0 1 0 166663162 21438464 4730 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/27251/statm: 5234 4730 237 467 0 4765 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 20936

[startup+0.700883 s]
/proc/loadavg: 2.20 2.09 2.03 4/196 27251
/proc/meminfo: memFree=30724064/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=0.68
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4851 0 0 0 18 50 0 0 21 0 1 0 166663162 21438464 4730 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/27251/statm: 5234 4730 237 467 0 4765 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 20936

[startup+1.50078 s]
/proc/loadavg: 2.20 2.09 2.03 3/197 27252
/proc/meminfo: memFree=30705952/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=1.48
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4859 0 0 0 30 118 0 0 23 0 1 0 166663162 21438464 4738 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5234 4738 237 467 0 4765 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 20936

[startup+3.10048 s]
/proc/loadavg: 2.20 2.09 2.03 3/197 27252
/proc/meminfo: memFree=30705332/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=3.08
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4870 0 0 0 60 248 0 0 25 0 1 0 166663162 21438464 4749 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/27251/statm: 5234 4749 237 467 0 4765 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 20936

[startup+6.30098 s]
/proc/loadavg: 2.19 2.09 2.03 3/197 27252
/proc/meminfo: memFree=30704748/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=20936 CPUtime=6.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4873 0 0 0 103 525 0 0 25 0 1 0 166663162 21438464 4749 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5234 4749 237 467 0 4765 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 20936

[startup+12.7009 s]
/proc/loadavg: 2.17 2.09 2.03 3/197 27252
/proc/meminfo: memFree=30703896/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=21068 CPUtime=12.67
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4892 0 0 0 244 1023 0 0 25 0 1 0 166663162 21573632 4760 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5267 4760 237 467 0 4798 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 21068

[startup+25.5008 s]
/proc/loadavg: 2.13 2.08 2.03 3/197 27252
/proc/meminfo: memFree=30704940/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=21068 CPUtime=25.48
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 4919 0 0 0 536 2012 0 0 25 0 1 0 166663162 21573632 4783 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5267 4783 237 467 0 4798 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 21068

[startup+51.1005 s]
/proc/loadavg: 2.14 2.09 2.03 3/197 27254
/proc/meminfo: memFree=30702528/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=51.08
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5567 0 0 0 2236 2872 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 23708

[startup+102.301 s]
/proc/loadavg: 2.06 2.08 2.03 3/197 27254
/proc/meminfo: memFree=30702260/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=102.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5569 0 0 0 6616 3612 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 23708

[startup+162.301 s]
/proc/loadavg: 2.02 2.06 2.02 3/197 27256
/proc/meminfo: memFree=30701716/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=162.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5569 0 0 0 11511 4717 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 23708

[startup+222.307 s]
/proc/loadavg: 2.01 2.05 2.02 3/198 27261
/proc/meminfo: memFree=30700160/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=222.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5569 0 0 0 16349 5880 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 23708

[startup+282.301 s]
/proc/loadavg: 2.00 2.03 2.01 3/197 27263
/proc/meminfo: memFree=30658120/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=282.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5569 0 0 0 21273 6955 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 23708

[startup+342.301 s]
/proc/loadavg: 2.06 2.04 2.01 3/197 27263
/proc/meminfo: memFree=30613940/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=342.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5569 0 0 0 26333 7895 0 0 25 0 1 0 166663162 24276992 5414 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5414 237 467 0 5458 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 23708

[startup+402.301 s]
/proc/loadavg: 2.02 2.03 2.00 3/197 27265
/proc/meminfo: memFree=30586864/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23708 CPUtime=402.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5572 0 0 0 31252 8976 0 0 25 0 1 0 166663162 24276992 5417 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5927 5417 237 467 0 5458 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 23708

[startup+462.301 s]
/proc/loadavg: 2.29 2.12 2.04 3/197 27267
/proc/meminfo: memFree=30575276/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23840 CPUtime=462.28
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5611 0 0 0 36032 10196 0 0 25 0 1 0 166663162 24412160 5456 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5960 5456 237 467 0 5491 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 23840

[startup+522.3 s]
/proc/loadavg: 2.24 2.15 2.05 3/197 27269
/proc/meminfo: memFree=30529216/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=23840 CPUtime=522.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5627 0 0 0 40956 11273 0 0 25 0 1 0 166663162 24412160 5472 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 5960 5472 237 467 0 5491 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 23840

[startup+582.3 s]
/proc/loadavg: 2.09 2.12 2.04 3/197 27271
/proc/meminfo: memFree=30482296/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24144 CPUtime=582.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5673 0 0 0 45967 12262 0 0 25 0 1 0 166663162 24723456 5518 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6036 5518 237 467 0 5567 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 24144

[startup+642.3 s]
/proc/loadavg: 2.59 2.22 2.08 3/197 27271
/proc/meminfo: memFree=30441928/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24144 CPUtime=642.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5686 0 0 0 51087 13142 0 0 25 0 1 0 166663162 24723456 5531 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6036 5531 237 467 0 5567 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 24144

[startup+702.3 s]

################
# More data... #
################

[startup+882.306 s]
/proc/loadavg: 2.09 2.12 2.07 10/197 27279
/proc/meminfo: memFree=30254524/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24276 CPUtime=882.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5738 0 0 0 71073 17157 0 0 25 0 1 0 166663162 24858624 5583 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6069 5583 237 467 0 5600 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 24276

[startup+942.301 s]
/proc/loadavg: 2.03 2.10 2.06 3/197 27279
/proc/meminfo: memFree=30209604/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24408 CPUtime=942.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5756 0 0 0 76096 18133 0 0 25 0 1 0 166663162 24993792 5601 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6102 5601 237 467 0 5633 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 24408

[startup+1002.3 s]
/proc/loadavg: 2.01 2.08 2.06 3/197 27281
/proc/meminfo: memFree=30164528/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24408 CPUtime=1002.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5763 0 0 0 81069 19161 0 0 25 0 1 0 166663162 24993792 5608 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6102 5608 237 467 0 5633 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 24408

[startup+1062.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/179 27313
/proc/meminfo: memFree=31186976/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24408 CPUtime=1062.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5766 0 0 0 85870 20360 0 0 25 0 1 0 166663162 24993792 5611 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6102 5611 237 467 0 5633 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 24408

[startup+1122.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/179 27315
/proc/meminfo: memFree=31184684/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24692 CPUtime=1122.29
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5800 0 0 0 90732 21497 0 0 25 0 1 0 166663162 25284608 5645 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6173 5645 237 467 0 5704 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 24692

[startup+1182.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/179 27317
/proc/meminfo: memFree=31184164/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24692 CPUtime=1182.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5831 0 0 0 95625 22605 0 0 25 0 1 0 166663162 25284608 5676 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6173 5676 237 467 0 5704 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 24692

[startup+1242.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/179 27317
/proc/meminfo: memFree=31183876/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24824 CPUtime=1242.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5842 0 0 0 100496 23734 0 0 25 0 1 0 166663162 25419776 5687 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6206 5687 237 467 0 5737 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 24824

[startup+1302.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/179 27319
/proc/meminfo: memFree=31183712/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24824 CPUtime=1302.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5857 0 0 0 105366 24864 0 0 25 0 1 0 166663162 25419776 5702 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6206 5702 237 467 0 5737 0
Current children cumulated CPU time (s) 1302.3
Current children cumulated vsize (KiB) 24824

[startup+1362.3 s]
/proc/loadavg: 2.00 2.02 2.02 3/179 27321
/proc/meminfo: memFree=31183816/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24956 CPUtime=1362.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5874 0 0 0 110239 25991 0 0 25 0 1 0 166663162 25554944 5719 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6239 5719 237 467 0 5770 0
Current children cumulated CPU time (s) 1362.3
Current children cumulated vsize (KiB) 24956

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/179 27323
/proc/meminfo: memFree=31183284/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=24956 CPUtime=1422.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5897 0 0 0 115109 27121 0 0 25 0 1 0 166663162 25554944 5742 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6239 5742 237 467 0 5770 0
Current children cumulated CPU time (s) 1422.3
Current children cumulated vsize (KiB) 24956

[startup+1482.3 s]
/proc/loadavg: 2.04 2.02 2.02 3/179 27334
/proc/meminfo: memFree=31182360/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25092 CPUtime=1482.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5909 0 0 0 120029 28201 0 0 25 0 1 0 166663162 25694208 5754 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6273 5754 237 467 0 5804 0
Current children cumulated CPU time (s) 1482.3
Current children cumulated vsize (KiB) 25092

[startup+1542.31 s]
/proc/loadavg: 2.01 2.01 2.01 3/179 27334
/proc/meminfo: memFree=31182200/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25092 CPUtime=1542.31
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5929 0 0 0 124872 29359 0 0 25 0 1 0 166663162 25694208 5774 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6273 5774 237 467 0 5804 0
Current children cumulated CPU time (s) 1542.31
Current children cumulated vsize (KiB) 25092

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 27336
/proc/meminfo: memFree=31182292/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25092 CPUtime=1602.31
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5929 0 0 0 129675 30556 0 0 25 0 1 0 166663162 25694208 5774 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6273 5774 237 467 0 5804 0
Current children cumulated CPU time (s) 1602.31
Current children cumulated vsize (KiB) 25092

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 27338
/proc/meminfo: memFree=31182392/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25092 CPUtime=1662.3
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5939 0 0 0 134531 31699 0 0 25 0 1 0 166663162 25694208 5784 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6273 5784 237 467 0 5804 0
Current children cumulated CPU time (s) 1662.3
Current children cumulated vsize (KiB) 25092

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 27340
/proc/meminfo: memFree=31181988/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25224 CPUtime=1722.31
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5941 0 0 0 139427 32804 0 0 25 0 1 0 166663162 25829376 5786 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6306 5786 237 467 0 5837 0
Current children cumulated CPU time (s) 1722.31
Current children cumulated vsize (KiB) 25224

[startup+1782.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/179 27342
/proc/meminfo: memFree=31181704/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25224 CPUtime=1782.31
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5967 0 0 0 144315 33916 0 0 25 0 1 0 166663162 25829376 5812 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6306 5812 237 467 0 5837 0
Current children cumulated CPU time (s) 1782.31
Current children cumulated vsize (KiB) 25224



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.06 2.01 2.00 3/179 27342
/proc/meminfo: memFree=31181696/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25224 CPUtime=1800.01
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5967 0 0 0 145745 34256 0 0 25 0 1 0 166663162 25829376 5812 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6306 5812 237 467 0 5837 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 25224

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800 s]
/proc/loadavg: 2.06 2.01 2.00 3/179 27342
/proc/meminfo: memFree=31181696/32951124 swapFree=67111528/67111528
[pid=27251] ppid=27249 vsize=25224 CPUtime=1800.01
/proc/27251/stat : 27251 (pbct) R 27249 27251 27003 0 -1 4202496 5967 0 0 0 145745 34256 0 0 25 0 1 0 166663162 25829376 5812 4089446400 134512640 136421960 4292720784 18446744073709551615 135874657 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/27251/statm: 6306 5812 237 467 0 5837 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 25224

Child status: 0
Real time (s): 1800.01
CPU time (s): 1800.02
CPU user time (s): 1457.45
CPU system time (s): 342.568
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 25224

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1457.45
system time used= 342.568
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5968
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1
involuntary context switches= 2692

runsolver used 2.49462 second user time and 5.76312 second system time

The end

Launcher Data 

Begin job on node118 at 2010-06-30 22:37:16
IDJOB=2695122
IDBENCH=79304
IDSOLVER=1208
FILE ID=node118/2695122-1277930236
PBS_JOBID= 11197414
Free space on /tmp= 74212 MiB

SOLVER NAME= PB/CT 0.1
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900577940--soft-0-100-0.wbo
COMMAND LINE= HOME/pbct --model BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2695122-1277930236/watcher-2695122-1277930236 -o /tmp/evaluation-result-2695122-1277930236/solver-2695122-1277930236 -C 1800 -W 2000 -M 3800  HOME/pbct --model HOME/instance-2695122-1277930236.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 2d690d91fe5f00c81c2e61f07f4a896b
RANDOM SEED=2051638936

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5448.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30724096 kB
Buffers:        213808 kB
Cached:        1300300 kB
SwapCached:          0 kB
Active:        1039056 kB
Inactive:      1042264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30724096 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2000 kB
Writeback:           0 kB
AnonPages:      566760 kB
Mapped:          20704 kB
Slab:            80092 kB
PageTables:       6496 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1656484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74208 MiB
End job on node118 at 2010-06-30 23:07:18