Trace number 2699300

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB/CT 0.1 fixedMSAT (TO) 1800.04 1800.01

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900548667--soft-33-100-0.wbo
MD5SUMb80542b6ea011406c368e0a53be4d6f1
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark487.411
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1804
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 90822
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 90821
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 625
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c PB/CT 0.1.2 http://www.residual.se/pbct
0.00/0.00	c Based on OpenSMT/CT 20091015
0.00/0.01	c constraints 6/17 clauses 897/1787 units 0
0.00/0.01	c vars 231
0.00/0.08	c 0.072988 16.7188 5 6925
0.00/0.08	o 546
0.09/0.10	c 0.077988 17.1094 32 8330
0.09/0.10	o 543
0.09/0.10	c 0.079987 17.1094 35 9644
0.09/0.10	o 475
0.09/0.13	c 0.087986 17.1094 100 10102
0.09/0.13	o 464
0.39/0.41	c 0.158975 17.1094 904 12297
0.39/0.41	o 460
0.39/0.41	c 0.160975 17.1094 949 12788
0.39/0.41	o 442
0.39/0.44	c 0.168974 17.1094 1004 13562
0.39/0.44	o 427
0.89/0.90	c 0.286956 17.2305 1459 16729
0.89/0.90	o 370
0.89/0.90	c 0.288956 17.2305 742 17203
0.89/0.90	o 356
0.89/0.94	c 0.299954 17.2305 892 18140
0.89/0.94	o 338
0.89/0.97	c 0.308953 17.2305 940 18388
0.89/0.97	o 337
1.00/1.06	c 0.32795 17.2305 1136 19183
1.00/1.06	o 327
1.00/1.08	c 0.336948 17.2305 620 19736
1.00/1.08	o 318
1.00/1.09	c 0.337948 17.2305 628 20209
1.00/1.09	o 310
1.00/1.10	c 0.339948 17.2305 631 20587
1.00/1.10	o 296
1.00/1.10	c 0.341948 17.2305 646 21037
1.00/1.10	o 286
1.59/1.62	c 0.488925 17.2305 1337 24049
1.59/1.62	o 271
2.10/2.12	c 0.646901 17.2305 906 29172
2.10/2.12	o 203
2.79/2.81	c 0.836872 17.2305 681 33040
2.79/2.81	o 186
2.79/2.89	c 0.861868 17.2305 890 33785
2.79/2.89	o 178
2.89/2.95	c 0.882865 17.2305 1037 34490
2.89/2.95	o 165
3.39/3.49	c 1.02384 17.3516 978 37798
3.39/3.49	o 149
3.59/3.62	c 1.07384 17.3516 1315 38501
3.59/3.62	o 148
4.09/4.12	c 1.22481 17.3516 1254 41466
4.09/4.12	o 128
4.69/4.70	c 1.41478 17.3516 874 44628
4.69/4.70	o 119
5.59/5.66	c 1.70074 17.3516 686 50674
5.59/5.66	o 78
7.19/7.20	c 2.25766 17.6055 1153 58567
7.19/7.20	o 74
9.29/9.38	c 3.09053 17.6055 1844 69086
9.29/9.38	o 73
11.09/11.17	c 3.80442 17.6055 2192 77425
11.09/11.17	o 68
12.09/12.12	c 4.23436 17.6055 1622 82914
12.09/12.12	o 49
13.30/13.38	c 4.90625 18.25 1415 92180
13.30/13.38	o 47
13.99/14.09	c 5.31219 18.25 2006 98517
13.99/14.09	o 44
14.09/14.10	c 5.31519 18.25 2052 98696
14.09/14.10	o 41
15.20/15.22	c 5.9151 18.25 1636 109358
15.20/15.22	o 37
17.19/17.28	c 7.15691 18.25 2424 129443
17.19/17.28	o 27
17.29/17.37	c 7.2089 18.25 1787 130398
17.29/17.37	o 23
17.39/17.41	c 7.2299 18.25 2092 131225
17.39/17.41	o 10
17.50/17.60	c 7.37488 18.25 2569 134373
17.50/17.60	o 9
17.60/17.68	c 7.44187 18.25 2116 135776
17.60/17.68	o 6
17.60/17.69	c 7.44687 18.25 2175 135922
17.60/17.69	o 3
17.99/18.05	c 7.72783 18.25 2628 140823
17.99/18.05	o 2
32.59/32.63	c 19.52 18.375 3218 356505
32.59/32.63	o 1
1800.04/1800.00	s SATISFIABLE
1800.04/1800.00	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 x11 -x12 -x13 -x14 -x15 x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 -x47 -x48 x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 x86 -x87 -x88 x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 x129 -x130 -x131 x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 x171 -x172 -x173 x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 x210 -x211 -x212 -x213 -x214 x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 x228 -x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2699300-1278459655/watcher-2699300-1278459655 -o /tmp/evaluation-result-2699300-1278459655/solver-2699300-1278459655 -C 1800 -W 2000 -M 3800 HOME/pbct --model HOME/instance-2699300-1278459655.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.97 1.94 1.75 3/178 13059
/proc/meminfo: memFree=30085792/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=2136 CPUtime=0
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 255 0 0 0 0 0 0 0 23 0 1 0 14179452 2187264 175 4089446400 134512640 136422188 4292321824 18446744073709551615 134537029 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/13059/statm: 534 175 144 467 0 65 0

[startup+0.00623906 s]
/proc/loadavg: 1.97 1.94 1.75 3/178 13059
/proc/meminfo: memFree=30085792/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=2136 CPUtime=0
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 255 0 0 0 0 0 0 0 23 0 1 0 14179452 2187264 175 4089446400 134512640 136422188 4292321824 18446744073709551615 135153616 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/13059/statm: 534 175 144 467 0 65 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.100224 s]
/proc/loadavg: 1.97 1.94 1.75 3/178 13059
/proc/meminfo: memFree=30085792/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17516 CPUtime=0.09
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4043 0 0 0 7 2 0 0 24 0 1 0 14179452 17936384 3962 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4379 3962 236 467 0 3910 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17516

[startup+0.300187 s]
/proc/loadavg: 1.97 1.94 1.75 3/178 13059
/proc/meminfo: memFree=30085792/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17516 CPUtime=0.29
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4052 0 0 0 12 17 0 0 25 0 1 0 14179452 17936384 3968 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4379 3968 236 467 0 3910 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17516

[startup+0.700115 s]
/proc/loadavg: 1.97 1.94 1.75 3/178 13059
/proc/meminfo: memFree=30085792/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17640 CPUtime=0.69
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4070 0 0 0 23 46 0 0 25 0 1 0 14179452 18063360 3983 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4410 3983 237 467 0 3941 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17640

[startup+1.50097 s]
/proc/loadavg: 1.97 1.94 1.75 3/179 13060
/proc/meminfo: memFree=30070656/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17640 CPUtime=1.49
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4103 0 0 0 45 104 0 0 25 0 1 0 14179452 18063360 4007 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4410 4007 237 467 0 3941 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 17640

[startup+3.10069 s]
/proc/loadavg: 1.97 1.94 1.75 3/179 13060
/proc/meminfo: memFree=30070656/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17640 CPUtime=3.09
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4108 0 0 0 92 217 0 0 25 0 1 0 14179452 18063360 4007 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4410 4007 237 467 0 3941 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 17640

[startup+6.30012 s]
/proc/loadavg: 1.97 1.95 1.75 3/179 13060
/proc/meminfo: memFree=30070936/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=17764 CPUtime=6.29
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4142 0 0 0 191 438 0 0 25 0 1 0 14179452 18190336 4036 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4441 4036 237 467 0 3972 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 17764

[startup+12.701 s]
/proc/loadavg: 1.97 1.95 1.75 3/179 13060
/proc/meminfo: memFree=30071020/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=18420 CPUtime=12.69
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4296 0 0 0 451 818 0 0 25 0 1 0 14179452 18862080 4186 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 4605 4186 237 467 0 4136 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 18420

[startup+25.5007 s]
/proc/loadavg: 1.98 1.95 1.75 3/179 13060
/proc/meminfo: memFree=30071224/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=18684 CPUtime=25.49
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4363 0 0 0 1375 1174 0 0 25 0 1 0 14179452 19132416 4242 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 4671 4242 237 467 0 4202 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 18684

[startup+51.1002 s]
/proc/loadavg: 1.98 1.95 1.76 3/179 13061
/proc/meminfo: memFree=30071048/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=18944 CPUtime=51.09
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4438 0 0 0 3446 1663 0 0 25 0 1 0 14179452 19398656 4316 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 4736 4316 237 467 0 4267 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 18944

[startup+102.306 s]
/proc/loadavg: 1.99 1.95 1.77 3/179 13089
/proc/meminfo: memFree=30063320/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=19336 CPUtime=102.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4542 0 0 0 7579 2651 0 0 25 0 1 0 14179452 19800064 4420 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 4834 4420 237 467 0 4365 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 19336

[startup+162.3 s]
/proc/loadavg: 1.99 1.96 1.78 3/179 13091
/proc/meminfo: memFree=30063152/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=19712 CPUtime=162.29
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4625 0 0 0 12424 3805 0 0 25 0 1 0 14179452 20185088 4503 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 4928 4503 237 467 0 4459 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 19712

[startup+222.301 s]
/proc/loadavg: 1.99 1.97 1.79 3/179 13093
/proc/meminfo: memFree=30062484/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=19840 CPUtime=222.29
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4679 0 0 0 17268 4961 0 0 25 0 1 0 14179452 20316160 4557 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 4960 4557 237 467 0 4491 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 19840

[startup+282.3 s]
/proc/loadavg: 1.99 1.97 1.81 3/179 13094
/proc/meminfo: memFree=30062564/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20096 CPUtime=282.29
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4727 0 0 0 22173 6056 0 0 25 0 1 0 14179452 20578304 4605 4089446400 134512640 136422188 4292321824 18446744073709551615 134862222 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5024 4605 237 467 0 4555 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 20096

[startup+342.3 s]
/proc/loadavg: 1.99 1.97 1.82 3/179 13096
/proc/meminfo: memFree=30062156/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20228 CPUtime=342.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4772 0 0 0 27043 7187 0 0 25 0 1 0 14179452 20713472 4650 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5057 4650 237 467 0 4588 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 20228

[startup+402.301 s]
/proc/loadavg: 1.99 1.97 1.82 3/179 13097
/proc/meminfo: memFree=30062232/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20364 CPUtime=402.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4788 0 0 0 31918 8312 0 0 25 0 1 0 14179452 20852736 4666 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5091 4666 237 467 0 4622 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 20364

[startup+462.3 s]
/proc/loadavg: 1.99 1.97 1.83 3/179 13099
/proc/meminfo: memFree=30062064/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20364 CPUtime=462.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4796 0 0 0 36810 9420 0 0 25 0 1 0 14179452 20852736 4674 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5091 4674 237 467 0 4622 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 20364

[startup+522.3 s]
/proc/loadavg: 1.99 1.97 1.84 3/179 13101
/proc/meminfo: memFree=30061764/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20516 CPUtime=522.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4842 0 0 0 41708 10522 0 0 25 0 1 0 14179452 21008384 4720 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5129 4720 237 467 0 4660 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 20516

[startup+582.301 s]
/proc/loadavg: 1.99 1.97 1.84 3/179 13102
/proc/meminfo: memFree=30061840/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20644 CPUtime=582.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4859 0 0 0 46614 11616 0 0 25 0 1 0 14179452 21139456 4737 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5161 4737 237 467 0 4692 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 20644

[startup+642.3 s]
/proc/loadavg: 1.99 1.97 1.85 3/179 13104
/proc/meminfo: memFree=30061304/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20776 CPUtime=642.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4885 0 0 0 51538 12693 0 0 25 0 1 0 14179452 21274624 4763 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5194 4763 237 467 0 4725 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 20776

[startup+702.301 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 1.99 1.97 1.86 3/179 13109
/proc/meminfo: memFree=30061308/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20908 CPUtime=822.3
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4923 0 0 0 66224 16006 0 0 25 0 1 0 14179452 21409792 4801 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5227 4801 237 467 0 4758 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 20908

[startup+882.301 s]
/proc/loadavg: 2.04 1.99 1.88 3/179 13110
/proc/meminfo: memFree=30060904/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=20908 CPUtime=882.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4944 0 0 0 71116 17115 0 0 25 0 1 0 14179452 21409792 4822 4089446400 134512640 136422188 4292321824 18446744073709551615 134862270 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5227 4822 237 467 0 4758 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 20908

[startup+942.301 s]
/proc/loadavg: 2.01 1.99 1.88 3/179 13112
/proc/meminfo: memFree=30060980/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21040 CPUtime=942.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4950 0 0 0 76030 18201 0 0 25 0 1 0 14179452 21544960 4828 4089446400 134512640 136422188 4292321824 18446744073709551615 135022324 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5260 4828 237 467 0 4791 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 21040

[startup+1002.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/179 13113
/proc/meminfo: memFree=30061072/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21040 CPUtime=1002.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4950 0 0 0 80901 19330 0 0 25 0 1 0 14179452 21544960 4828 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5260 4828 237 467 0 4791 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 21040

[startup+1062.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/179 13115
/proc/meminfo: memFree=30060912/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21040 CPUtime=1062.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4959 0 0 0 85763 20469 0 0 25 0 1 0 14179452 21544960 4837 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5260 4837 237 467 0 4791 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 21040

[startup+1122.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/179 13144
/proc/meminfo: memFree=30057856/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21172 CPUtime=1122.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 4995 0 0 0 90686 21546 0 0 25 0 1 0 14179452 21680128 4873 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5293 4873 237 467 0 4824 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 21172

[startup+1182.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13145
/proc/meminfo: memFree=30056612/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21292 CPUtime=1182.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5015 0 0 0 95407 22824 0 0 25 0 1 0 14179452 21803008 4893 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5323 4893 237 467 0 4854 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 21292

[startup+1242.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13156
/proc/meminfo: memFree=30056308/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21424 CPUtime=1242.31
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5041 0 0 0 100137 24094 0 0 25 0 1 0 14179452 21938176 4919 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5356 4919 237 467 0 4887 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 21424

[startup+1302.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13157
/proc/meminfo: memFree=30055644/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21424 CPUtime=1302.33
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5051 0 0 0 104823 25410 0 0 25 0 1 0 14179452 21938176 4929 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5356 4929 237 467 0 4887 0
Current children cumulated CPU time (s) 1302.33
Current children cumulated vsize (KiB) 21424

[startup+1362.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13159
/proc/meminfo: memFree=30055752/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21560 CPUtime=1362.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5073 0 0 0 109574 26658 0 0 25 0 1 0 14179452 22077440 4951 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5390 4951 237 467 0 4921 0
Current children cumulated CPU time (s) 1362.32
Current children cumulated vsize (KiB) 21560

[startup+1422.31 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13161
/proc/meminfo: memFree=30055472/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21560 CPUtime=1422.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5088 0 0 0 114331 27901 0 0 25 0 1 0 14179452 22077440 4966 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5390 4966 237 467 0 4921 0
Current children cumulated CPU time (s) 1422.32
Current children cumulated vsize (KiB) 21560

[startup+1482.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13162
/proc/meminfo: memFree=30055456/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21560 CPUtime=1482.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5097 0 0 0 119059 29173 0 0 25 0 1 0 14179452 22077440 4975 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5390 4975 237 467 0 4921 0
Current children cumulated CPU time (s) 1482.32
Current children cumulated vsize (KiB) 21560

[startup+1542.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13164
/proc/meminfo: memFree=30055176/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21696 CPUtime=1542.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5107 0 0 0 123779 30453 0 0 25 0 1 0 14179452 22216704 4985 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5424 4985 237 467 0 4955 0
Current children cumulated CPU time (s) 1542.32
Current children cumulated vsize (KiB) 21696

[startup+1602.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13165
/proc/meminfo: memFree=30055028/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21696 CPUtime=1602.33
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5119 0 0 0 128488 31745 0 0 25 0 1 0 14179452 22216704 4997 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5424 4997 237 467 0 4955 0
Current children cumulated CPU time (s) 1602.33
Current children cumulated vsize (KiB) 21696

[startup+1662.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13167
/proc/meminfo: memFree=30055000/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21696 CPUtime=1662.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5124 0 0 0 133254 32978 0 0 25 0 1 0 14179452 22216704 5002 4089446400 134512640 136422188 4292321824 18446744073709551615 134862264 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5424 5002 237 467 0 4955 0
Current children cumulated CPU time (s) 1662.32
Current children cumulated vsize (KiB) 21696

[startup+1722.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13169
/proc/meminfo: memFree=30054836/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21696 CPUtime=1722.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5137 0 0 0 137969 34263 0 0 25 0 1 0 14179452 22216704 5015 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/13059/statm: 5424 5015 237 467 0 4955 0
Current children cumulated CPU time (s) 1722.32
Current children cumulated vsize (KiB) 21696

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13170
/proc/meminfo: memFree=30054680/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21832 CPUtime=1782.32
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5145 0 0 0 142686 35546 0 0 25 0 1 0 14179452 22355968 5023 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 5458 5023 237 467 0 4989 0
Current children cumulated CPU time (s) 1782.32
Current children cumulated vsize (KiB) 21832



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.00 1.99 1.91 3/179 13171
/proc/meminfo: memFree=30054796/32950928 swapFree=67111528/67111528
[pid=13059] ppid=13057 vsize=21832 CPUtime=1800.04
/proc/13059/stat : 13059 (pbct) R 13057 13059 12689 0 -1 4202496 5145 0 0 0 144072 35932 0 0 25 0 1 0 14179452 22355968 5023 4089446400 134512640 136422188 4292321824 18446744073709551615 135874785 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/13059/statm: 5458 5023 237 467 0 4989 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 21832

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.01
CPU time (s): 1800.04
CPU user time (s): 1440.72
CPU system time (s): 359.321
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 21832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1440.72
system time used= 359.321
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5146
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1
involuntary context switches= 20402

runsolver used 2.51262 second user time and 5.68014 second system time

The end

Launcher Data 

Begin job on node123 at 2010-07-07 01:40:55
IDJOB=2699300
IDBENCH=78892
IDSOLVER=1212
FILE ID=node123/2699300-1278459655
PBS_JOBID= 11233747
Free space on /tmp= 73748 MiB

SOLVER NAME= PB/CT 0.1 fixed
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900548667--soft-33-100-0.wbo
COMMAND LINE= HOME/pbct --model BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2699300-1278459655/watcher-2699300-1278459655 -o /tmp/evaluation-result-2699300-1278459655/solver-2699300-1278459655 -C 1800 -W 2000 -M 3800  HOME/pbct --model HOME/instance-2699300-1278459655.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= b80542b6ea011406c368e0a53be4d6f1
RANDOM SEED=1636880744

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5354.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30086684 kB
Buffers:        105408 kB
Cached:        2551032 kB
SwapCached:          0 kB
Active:         697624 kB
Inactive:      2028176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30086684 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1984 kB
Writeback:           0 kB
AnonPages:       69092 kB
Mapped:          15620 kB
Slab:            73804 kB
PageTables:       4816 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   212308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73748 MiB
End job on node123 at 2010-07-07 02:10:58