Trace number 2696655

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.1 1006.32

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j30/
normalized-j3029_6-sat.opb
MD5SUM39b121eedec0f13027beba32f35754bd
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark0.280957
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables5766
Total number of constraints18893
Number of constraints which are clauses18525
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints368
Minimum length of a constraint1
Maximum length of a constraint30
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 17
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 197
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696655-1278432580.opb.
0.00/0.00	c Instance file HOME/instance-2696655-1278432580.opb
0.00/0.00	c File size is 581558 bytes.
0.00/0.25	c Highest Coefficient sum: 197
0.00/0.25	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.29	c ============================[ Problem Statistics ]=============================
0.00/0.29	c |                                                                             |
0.00/0.29	c |  Parsing time:          0.27         s                                      |
0.00/0.29	c |  Number Variables:      5766                                                |
0.00/0.29	c |  Number Constraints:    18893                                               |
0.00/0.29	c ===============================================================================
1800.07/1006.31	c Remaining time 1799.72 sec.
1800.07/1006.31	c 
1800.07/1006.31	c *** INTERRUPTED ***
1800.07/1006.31	s UNKNOWN
1800.07/1006.31	c Total CPU time              : 1798.84 s
1800.07/1006.31	c Memory used           : 84.98 MB
1800.07/1006.31	c CPU time              : 1798.84 s
1800.07/1006.31	c 
1800.07/1006.31	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696655-1278432580/watcher-2696655-1278432580 -o /tmp/evaluation-result-2696655-1278432580/solver-2696655-1278432580 -C 1800 -W 2000 -M 1800 run HOME/instance-2696655-1278432580.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.49 0.12 0.04 2/105 22333
/proc/meminfo: memFree=1385516/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) R 22331 22333 22003 0 -1 4202496 349 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447938965 0 65538 4100 65536 0 0 0 17 0 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0

[startup+0.0664971 s]
/proc/loadavg: 0.49 0.12 0.04 2/105 22333
/proc/meminfo: memFree=1385516/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100501 s]
/proc/loadavg: 0.49 0.12 0.04 2/105 22333
/proc/meminfo: memFree=1385516/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300538 s]
/proc/loadavg: 0.49 0.12 0.04 2/105 22333
/proc/meminfo: memFree=1385516/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701578 s]
/proc/loadavg: 0.49 0.12 0.04 2/105 22333
/proc/meminfo: memFree=1385516/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50065 s]
/proc/loadavg: 0.49 0.12 0.04 2/107 22335
/proc/meminfo: memFree=1365288/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=44832 CPUtime=1.48
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 7964 0 0 0 145 3 0 0 25 0 1 0 11466280 45907968 5925 1992294400 134512640 146736320 4293418640 18446744073709551615 136008058 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11208 5925 864 2985 0 7750 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 53532

[startup+3.10083 s]
/proc/loadavg: 0.53 0.14 0.04 2/107 22335
/proc/meminfo: memFree=1364792/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=45436 CPUtime=3.08
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 8168 0 0 0 305 3 0 0 25 0 1 0 11466280 46526464 6103 1992294400 134512640 146736320 4293418640 18446744073709551615 139046527 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11359 6103 840 2985 0 7901 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 54136

[startup+6.30118 s]
/proc/loadavg: 0.53 0.14 0.04 2/107 22335
/proc/meminfo: memFree=1363552/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=45528 CPUtime=6.29
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 8201 0 0 0 625 4 0 0 25 0 1 0 11466280 46620672 6131 1992294400 134512640 146736320 4293418640 18446744073709551615 136008069 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11382 6131 835 2985 0 7924 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 54228

[startup+12.7019 s]
/proc/loadavg: 0.61 0.16 0.05 2/107 22335
/proc/meminfo: memFree=1363304/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=45872 CPUtime=12.67
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 9561 0 0 0 1263 4 0 0 25 0 1 0 11466280 46972928 6369 1992294400 134512640 146736320 4293418640 18446744073709551615 136388075 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11468 6369 895 2985 0 8010 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 54572

[startup+25.5013 s]
/proc/loadavg: 0.67 0.19 0.06 2/107 22335
/proc/meminfo: memFree=1363436/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=45872 CPUtime=25.47
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 9562 0 0 0 2543 4 0 0 25 0 1 0 11466280 46972928 6370 1992294400 134512640 146736320 4293418640 18446744073709551615 136403116 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11468 6370 895 2985 0 8010 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 54572

[startup+51.1011 s]
/proc/loadavg: 0.78 0.26 0.09 2/107 22335
/proc/meminfo: memFree=1359716/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=48008 CPUtime=51.05
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 15895 0 0 0 5098 7 0 0 25 0 1 0 11466280 49160192 7259 1992294400 134512640 146736320 4293418640 18446744073709551615 136017763 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 12002 7259 948 2985 0 8544 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 56708

[startup+102.308 s]
/proc/loadavg: 0.91 0.38 0.14 2/107 22337
/proc/meminfo: memFree=1359964/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=47864 CPUtime=102.24
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 19027 0 0 0 10215 9 0 0 25 0 1 0 11466280 49012736 7245 1992294400 134512640 146736320 4293418640 18446744073709551615 136400477 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22334/statm: 11966 7245 962 2985 0 8508 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 56564

[startup+162.301 s]
/proc/loadavg: 1.23 0.55 0.21 3/108 22340
/proc/meminfo: memFree=1339744/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=82592 CPUtime=186.38
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 30928 0 0 0 18620 18 0 0 25 0 2 0 11466280 84574208 12379 1992294400 134512640 146736320 4293418640 18446744073709551615 136008266 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 20648 12379 1000 2985 0 17190 0
[pid=22334/tid=22338] ppid=22333 vsize=82592 CPUtime=35.5
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 4779 0 0 0 3547 3 0 0 25 0 2 0 11477353 84574208 12379 1992294400 134512640 146736320 4293418640 18446744073709551615 136008653 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 186.38
Current children cumulated vsize (KiB) 91292

[startup+222.301 s]
/proc/loadavg: 1.71 0.81 0.32 3/108 22342
/proc/meminfo: memFree=1339496/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=82628 CPUtime=304.4
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 48172 0 0 0 30412 28 0 0 25 0 2 0 11466280 84611072 12431 1992294400 134512640 146736320 4293418640 18446744073709551615 136387955 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 20657 12431 1000 2985 0 17199 0
[pid=22334/tid=22338] ppid=22333 vsize=82628 CPUtime=95.05
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 19840 0 0 0 9494 11 0 0 25 0 2 0 11477353 84611072 12431 1992294400 134512640 146736320 4293418640 18446744073709551615 136008443 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 304.4
Current children cumulated vsize (KiB) 91328

[startup+282.302 s]
/proc/loadavg: 1.79 1.00 0.41 3/108 22342
/proc/meminfo: memFree=1337388/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=83704 CPUtime=416.95
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 56722 0 0 0 41659 36 0 0 25 0 2 0 11466280 85712896 13003 1992294400 134512640 146736320 4293418640 18446744073709551615 136385183 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 20926 13003 1001 2985 0 17468 0
[pid=22334/tid=22338] ppid=22333 vsize=83704 CPUtime=154.65
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 25782 0 0 0 15449 16 0 0 25 0 2 0 11477353 85712896 13003 1992294400 134512640 146736320 4293418640 18446744073709551615 136008363 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 416.95
Current children cumulated vsize (KiB) 92404

[startup+342.301 s]
/proc/loadavg: 1.89 1.16 0.50 3/108 22344
/proc/meminfo: memFree=1337636/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=83864 CPUtime=529.16
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 69415 0 0 0 52871 45 0 0 25 0 2 0 11466280 85876736 12981 1992294400 134512640 146736320 4293418640 18446744073709551615 136008014 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 20966 12981 1000 2985 0 17508 0
[pid=22334/tid=22338] ppid=22333 vsize=83864 CPUtime=206.87
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 37168 0 0 0 20664 23 0 0 25 0 2 0 11477353 85876736 12981 1992294400 134512640 146736320 4293418640 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 529.16
Current children cumulated vsize (KiB) 92564

[startup+402.301 s]
/proc/loadavg: 1.90 1.29 0.58 3/108 22346
/proc/meminfo: memFree=1337636/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0

################
# More data... #
################

[pid=22334] ppid=22333 vsize=90732 CPUtime=751.81
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 91959 0 0 0 75120 61 0 0 25 0 2 0 11466280 92909568 14362 1992294400 134512640 146736320 4293418640 18446744073709551615 136388884 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 22683 14362 1002 2985 0 19225 0
[pid=22334/tid=22338] ppid=22333 vsize=90732 CPUtime=323.65
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 57848 0 0 0 32329 36 0 0 25 0 2 0 11477353 92909568 14362 1992294400 134512640 146736320 4293418640 18446744073709551615 136008042 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 751.81
Current children cumulated vsize (KiB) 99432

[startup+522.301 s]
/proc/loadavg: 2.00 1.52 0.75 3/108 22350
/proc/meminfo: memFree=1334536/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=86324 CPUtime=869.4
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 92511 0 0 0 86875 65 0 0 25 0 2 0 11466280 88395776 13718 1992294400 134512640 146736320 4293418640 18446744073709551615 136389777 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21581 13718 1000 2985 0 18123 0
[pid=22334/tid=22338] ppid=22333 vsize=86324 CPUtime=381.25
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 57865 0 0 0 38087 38 0 0 25 0 2 0 11477353 88395776 13718 1992294400 134512640 146736320 4293418640 18446744073709551615 136008450 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 869.4
Current children cumulated vsize (KiB) 95024

[startup+582.302 s]
/proc/loadavg: 1.94 1.60 0.82 3/108 22350
/proc/meminfo: memFree=1336272/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=84908 CPUtime=980.72
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 95292 0 0 0 98002 70 0 0 25 0 2 0 11466280 86945792 13363 1992294400 134512640 146736320 4293418640 18446744073709551615 139044550 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21227 13363 1008 2985 0 17769 0
[pid=22334/tid=22338] ppid=22333 vsize=84908 CPUtime=432.59
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 59416 0 0 0 43218 41 0 0 25 0 2 0 11477353 86945792 13363 1992294400 134512640 146736320 4293418640 18446744073709551615 136008176 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 980.72
Current children cumulated vsize (KiB) 93608

[startup+642.301 s]
/proc/loadavg: 2.05 1.68 0.90 6/109 22355
/proc/meminfo: memFree=1325848/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=86084 CPUtime=1096.55
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 96787 0 0 0 109582 73 0 0 25 0 2 0 11466280 88150016 13645 1992294400 134512640 146736320 4293418640 18446744073709551615 136000337 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21521 13645 1008 2985 0 18063 0
[pid=22334/tid=22338] ppid=22333 vsize=86084 CPUtime=491.94
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 59955 0 0 0 49152 42 0 0 25 0 2 0 11477353 88150016 13645 1992294400 134512640 146736320 4293418640 18446744073709551615 136000412 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1096.55
Current children cumulated vsize (KiB) 94784

[startup+702.301 s]
/proc/loadavg: 2.19 1.81 0.99 3/108 22357
/proc/meminfo: memFree=1336388/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=86000 CPUtime=1212.52
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 98939 0 0 0 121174 78 0 0 25 0 2 0 11466280 88064000 13255 1992294400 134512640 146736320 4293418640 18446744073709551615 136008615 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21500 13255 1003 2985 0 18042 0
[pid=22334/tid=22338] ppid=22333 vsize=86000 CPUtime=547.94
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 61372 0 0 0 54750 44 0 0 25 0 2 0 11477353 88064000 13255 1992294400 134512640 146736320 4293418640 18446744073709551615 136008454 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1212.52
Current children cumulated vsize (KiB) 94700

[startup+762.309 s]
/proc/loadavg: 2.03 1.83 1.05 3/108 22359
/proc/meminfo: memFree=1337132/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=83632 CPUtime=1328.14
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 115030 0 0 0 132725 89 0 0 25 0 2 0 11466280 85639168 13075 1992294400 134512640 146736320 4293418640 18446744073709551615 136007977 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 20908 13075 1003 2985 0 17450 0
[pid=22334/tid=22338] ppid=22333 vsize=83632 CPUtime=603.56
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 76400 0 0 0 60303 53 0 0 22 0 2 0 11477353 85639168 13075 1992294400 134512640 146736320 4293418640 18446744073709551615 136000483 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1328.14
Current children cumulated vsize (KiB) 92332

[startup+822.301 s]
/proc/loadavg: 2.07 1.87 1.11 3/108 22361
/proc/meminfo: memFree=1336140/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=85856 CPUtime=1447.27
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 130362 0 0 0 144628 99 0 0 25 0 2 0 11466280 87916544 13391 1992294400 134512640 146736320 4293418640 18446744073709551615 136008450 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21464 13391 1003 2985 0 18006 0
[pid=22334/tid=22338] ppid=22333 vsize=85856 CPUtime=662.73
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 90366 0 0 0 66213 60 0 0 25 0 2 0 11477353 87916544 13391 1992294400 134512640 146736320 4293418640 18446744073709551615 139042876 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1447.27
Current children cumulated vsize (KiB) 94556

[startup+882.302 s]
/proc/loadavg: 1.95 1.88 1.16 3/108 22361
/proc/meminfo: memFree=1336636/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=84140 CPUtime=1561.57
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 132666 0 0 0 156053 104 0 0 25 0 2 0 11466280 86159360 13200 1992294400 134512640 146736320 4293418640 18446744073709551615 135854189 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21035 13200 1004 2985 0 17577 0
[pid=22334/tid=22338] ppid=22333 vsize=84140 CPUtime=721.23
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 91738 0 0 0 72060 63 0 0 25 0 2 0 11477353 86159360 13200 1992294400 134512640 146736320 4293418640 18446744073709551615 136385183 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1561.57
Current children cumulated vsize (KiB) 92840

[startup+942.301 s]
/proc/loadavg: 2.02 1.91 1.21 3/108 22363
/proc/meminfo: memFree=1334900/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=85808 CPUtime=1677.93
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 133875 0 0 0 167685 108 0 0 25 0 2 0 11466280 87867392 13684 1992294400 134512640 146736320 4293418640 18446744073709551615 135468704 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21452 13684 1006 2985 0 17994 0
[pid=22334/tid=22338] ppid=22333 vsize=85808 CPUtime=780.8
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 92434 0 0 0 78015 65 0 0 25 0 2 0 11477353 87867392 13684 1992294400 134512640 146736320 4293418640 18446744073709551615 139042876 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1677.93
Current children cumulated vsize (KiB) 94508

[startup+1002.3 s]
/proc/loadavg: 2.01 1.94 1.26 3/108 22365
/proc/meminfo: memFree=1335032/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=86620 CPUtime=1792.09
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 159035 0 0 0 179084 125 0 0 25 0 2 0 11466280 88698880 13662 1992294400 134512640 146736320 4293418640 18446744073709551615 139042901 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21655 13662 1003 2985 0 18197 0
[pid=22334/tid=22338] ppid=22333 vsize=86620 CPUtime=838.31
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 116827 0 0 0 83753 78 0 0 25 0 2 0 11477353 88698880 13662 1992294400 134512640 146736320 4293418640 18446744073709551615 136008450 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1792.09
Current children cumulated vsize (KiB) 95320



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1006.3 s]
/proc/loadavg: 2.01 1.94 1.26 3/108 22365
/proc/meminfo: memFree=1334784/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=87016 CPUtime=1800.07
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 159059 0 0 0 179882 125 0 0 25 0 2 0 11466280 89104384 13686 1992294400 134512640 146736320 4293418640 18446744073709551615 136008050 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21754 13686 1003 2985 0 18296 0
[pid=22334/tid=22338] ppid=22333 vsize=87016 CPUtime=842.29
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 116827 0 0 0 84151 78 0 0 25 0 2 0 11477353 89104384 13686 1992294400 134512640 146736320 4293418640 18446744073709551615 135855165 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 95716

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1006.3 s]
/proc/loadavg: 2.01 1.94 1.26 3/108 22365
/proc/meminfo: memFree=1334784/2059040 swapFree=4192956/4192956
[pid=22333] ppid=22331 vsize=8700 CPUtime=0
/proc/22333/stat : 22333 (run) S 22331 22333 22003 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 11466280 8908800 249 1992294400 4194304 4922060 140733787671856 18446744073709551615 272447937669 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22333/statm: 2175 249 208 178 0 68 0
[pid=22334] ppid=22333 vsize=87016 CPUtime=1800.07
/proc/22334/stat : 22334 (pb_cplex) R 22333 22333 22003 0 -1 4202496 159059 0 0 0 179882 125 0 0 25 0 2 0 11466280 89104384 13686 1992294400 134512640 146736320 4293418640 18446744073709551615 136008050 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/22334/statm: 21754 13686 1003 2985 0 18296 0
[pid=22334/tid=22338] ppid=22333 vsize=87016 CPUtime=842.29
/proc/22334/task/22338/stat : 22338 (pb_cplex) R 22333 22333 22003 0 -1 4202560 116827 0 0 0 84151 78 0 0 25 0 2 0 11477353 89104384 13686 1992294400 134512640 146736320 4293418640 18446744073709551615 135855165 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 95716

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1006.32
CPU time (s): 1800.1
CPU user time (s): 1798.84
CPU system time (s): 1.26581
CPU usage (%): 178.879
Max. virtual memory (cumulated for all children) (KiB): 99780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.84
system time used= 1.26581
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 159428
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 774
involuntary context switches= 26872

runsolver used 2.03369 second user time and 5.03323 second system time

The end

Launcher Data 

Begin job on node087 at 2010-07-06 18:09:40
IDJOB=2696655
IDBENCH=73284
IDSOLVER=1209
FILE ID=node087/2696655-1278432580
PBS_JOBID= 11233438
Free space on /tmp= 62512 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j30/normalized-j3029_6-sat.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696655-1278432580/watcher-2696655-1278432580 -o /tmp/evaluation-result-2696655-1278432580/solver-2696655-1278432580 -C 1800 -W 2000 -M 1800  run HOME/instance-2696655-1278432580.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 39b121eedec0f13027beba32f35754bd
RANDOM SEED=653273845

node087.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.201
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.40
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.201
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5999.50
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1386300 kB
Buffers:        103616 kB
Cached:         429280 kB
SwapCached:          0 kB
Active:         220452 kB
Inactive:       372856 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1386300 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:           18204 kB
Writeback:           0 kB
AnonPages:       60368 kB
Mapped:          14800 kB
Slab:            57608 kB
PageTables:       4164 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-2696655-1278432580.opb

Free space on /tmp at the end= 62496 MiB
End job on node087 at 2010-07-06 18:26:29