Trace number 3720737

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: Pueblo 1.4? (TO) 1800.08 1800.52

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-120.opb
MD5SUM7b80ddfff13fd2a12f867bbe09bf6414
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables48411
Total number of constraints1121517
Number of constraints which are clauses1007723
Number of constraints which are cardinality constraints (but not clauses)3523
Number of constraints which are nor clauses,nor cardinality constraints110271
Minimum length of a constraint2
Maximum length of a constraint690
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 691
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c Pueblo version 1.4 (September 2005)
0.00/0.00	c Developed @ University of Michigan, Ann Arbor, MI
0.00/0.00	c  by Hossein Sheini
111.87/111.92	c starting to Solve
111.87/111.92	c #variables read: 48411 - #constraints read: 1123290

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3720737-1338513237/watcher-3720737-1338513237 -o /tmp/evaluation-result-3720737-1338513237/solver-3720737-1338513237 -C 1800 -W 1900 -M 15500 Pueblo HOME/instance-3720737-1338513237.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.99 3/175 23398
/proc/meminfo: memFree=26106892/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=3108 CPUtime=0 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 339 0 0 0 0 0 0 0 20 0 1 0 317449259 3182592 276 33554432000 134512640 134579096 4293475216 4293342612 3801841 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 777 276 219 17 0 83 0

[startup+0.041499 s]
/proc/loadavg: 2.00 2.00 1.99 3/175 23398
/proc/meminfo: memFree=26106892/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=3908 CPUtime=0.03 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 535 0 0 0 3 0 0 0 20 0 1 0 317449259 4001792 472 33554432000 134512640 134579096 4293475216 4293342492 15246384 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 977 474 219 17 0 283 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 3908

[startup+0.100263 s]
/proc/loadavg: 2.00 2.00 1.99 3/175 23398
/proc/meminfo: memFree=26106892/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=5240 CPUtime=0.09 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 860 0 0 0 9 0 0 0 20 0 1 0 317449259 5365760 797 33554432000 134512640 134579096 4293475216 4293342556 15246384 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 1310 797 219 17 0 616 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5240

[startup+0.300237 s]
/proc/loadavg: 2.00 2.00 1.99 3/175 23398
/proc/meminfo: memFree=26106892/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=9500 CPUtime=0.29 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 1920 0 0 0 29 0 0 0 20 0 1 0 317449259 9728000 1857 33554432000 134512640 134579096 4293475216 4293341116 2843924 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 2375 1857 219 17 0 1681 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9500

[startup+0.700228 s]
/proc/loadavg: 2.00 2.00 1.99 3/175 23398
/proc/meminfo: memFree=26106892/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=17760 CPUtime=0.69 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 3979 0 0 0 69 0 0 0 20 0 1 0 317449259 18186240 3916 33554432000 134512640 134579096 4293475216 4293342628 3801866 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 4440 3916 219 17 0 3746 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17760

[startup+1.50019 s]
/proc/loadavg: 2.00 2.00 1.99 3/176 23399
/proc/meminfo: memFree=26086292/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=34012 CPUtime=1.49 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 8036 0 0 0 148 1 0 0 20 0 1 0 317449259 34828288 7973 33554432000 134512640 134579096 4293475216 4293342628 3801871 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 8503 7973 219 17 0 7809 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 34012

[startup+3.10023 s]
/proc/loadavg: 2.00 2.00 1.99 3/176 23399
/proc/meminfo: memFree=26062856/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=64784 CPUtime=3.09 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 15754 0 0 0 306 3 0 0 20 0 1 0 317449259 66338816 15691 33554432000 134512640 134579096 4293475216 4293342616 2732010 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 16196 15693 219 17 0 15502 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 64784

[startup+6.30023 s]
/proc/loadavg: 2.08 2.02 2.00 3/176 23399
/proc/meminfo: memFree=26000980/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=125260 CPUtime=6.28 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 30860 0 0 0 622 6 0 0 20 0 1 0 317449259 128266240 30797 33554432000 134512640 134579096 4293475216 4293342620 134534244 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 31315 30797 219 17 0 30621 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 125260

[startup+12.7002 s]
/proc/loadavg: 2.07 2.02 2.00 3/176 23399
/proc/meminfo: memFree=25924100/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=178964 CPUtime=12.69 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 43945 0 0 0 1259 10 0 0 20 0 1 0 317449259 183259136 43882 33554432000 134512640 134579096 4293475216 4293474192 134532044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 44741 43882 226 17 0 44047 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 178964

[startup+25.5002 s]
/proc/loadavg: 2.06 2.01 2.00 3/176 23399
/proc/meminfo: memFree=25912064/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=179732 CPUtime=25.49 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 44081 0 0 0 2539 10 0 0 20 0 1 0 317449259 184045568 44018 33554432000 134512640 134579096 4293475216 4293474176 134532448 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 44933 44018 226 17 0 44239 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 179732

[startup+51.1002 s]
/proc/loadavg: 2.04 2.01 2.00 3/176 23399
/proc/meminfo: memFree=25888768/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=182380 CPUtime=51.08 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 44728 0 0 0 5098 10 0 0 20 0 1 0 317449259 186757120 44665 33554432000 134512640 134579096 4293475216 4293474176 134532448 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 45595 44665 226 17 0 44901 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 182380

[startup+102.306 s]
/proc/loadavg: 2.06 2.02 2.00 3/176 23399
/proc/meminfo: memFree=25819744/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=218576 CPUtime=102.27 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 53712 0 0 0 10215 12 0 0 20 0 1 0 317449259 223821824 53649 33554432000 134512640 134579096 4293475216 4293474176 134532448 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 54644 53649 226 17 0 53950 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 218576

[startup+162.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/176 23399
/proc/meminfo: memFree=25783564/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=233048 CPUtime=162.23 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 56213 0 0 0 16210 13 0 0 20 0 1 0 317449259 238641152 56172 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 58262 56172 228 17 0 57568 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 233048

[startup+222.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/176 23399
/proc/meminfo: memFree=25779508/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=235416 CPUtime=222.21 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 56689 0 0 0 22208 13 0 0 20 0 1 0 317449259 241065984 57141 33554432000 134512640 134579096 4293475216 4293474080 134520044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 58854 57141 228 17 0 58160 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 235416

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/176 23400
/proc/meminfo: memFree=25753268/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=237396 CPUtime=282.2 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 57090 0 0 0 28207 13 0 0 20 0 1 0 317449259 243093504 57542 33554432000 134512640 134579096 4293475216 4293474080 134519929 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 59349 57542 228 17 0 58655 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 237396

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/176 23400
/proc/meminfo: memFree=25707624/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=251148 CPUtime=342.2 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 60230 0 0 0 34204 16 0 0 20 0 1 0 317449259 257175552 60682 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 62787 60682 228 17 0 62093 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 251148

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 23403
/proc/meminfo: memFree=25663224/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=268388 CPUtime=402.18 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 64446 0 0 0 40199 19 0 0 20 0 1 0 317449259 274829312 64898 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 67097 64898 228 17 0 66403 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 268388

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23403
/proc/meminfo: memFree=25635040/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=286456 CPUtime=462.16 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 68889 0 0 0 46193 23 0 0 20 0 1 0 317449259 293330944 69820 33554432000 134512640 134579096 4293475216 4293474080 134520044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 71614 69820 228 17 0 70920 0
Current children cumulated CPU time (s) 462.16
Current children cumulated vsize (KiB) 286456

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23403
/proc/meminfo: memFree=25615572/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=307016 CPUtime=522.15 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 73864 0 0 0 52189 26 0 0 20 0 1 0 317449259 314384384 74795 33554432000 134512640 134579096 4293475216 4293474080 134520048 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 76754 74795 228 17 0 76060 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 307016

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23404
/proc/meminfo: memFree=25599976/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=322596 CPUtime=582.13 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 77664 0 0 0 58184 29 0 0 20 0 1 0 317449259 330338304 78595 33554432000 134512640 134579096 4293475216 4293474080 134520078 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 80649 78595 228 17 0 79955 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 322596

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23405
/proc/meminfo: memFree=25367548/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=449284 CPUtime=882.03 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 108443 0 0 0 88150 53 0 0 20 0 1 0 317449259 460066816 109956 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 112321 109956 228 17 0 111627 0
Current children cumulated CPU time (s) 882.03
Current children cumulated vsize (KiB) 449284

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23405
/proc/meminfo: memFree=25351428/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=465952 CPUtime=942.02 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 112558 0 0 0 94146 56 0 0 20 0 1 0 317449259 477134848 114071 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 116488 114071 228 17 0 115794 0
Current children cumulated CPU time (s) 942.02
Current children cumulated vsize (KiB) 465952

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23408
/proc/meminfo: memFree=25334680/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=482796 CPUtime=1002.01 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 116668 0 0 0 100142 59 0 0 20 0 1 0 317449259 494383104 118181 33554432000 134512640 134579096 4293475216 4293474116 134519888 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 120699 118181 228 17 0 120005 0
Current children cumulated CPU time (s) 1002.01
Current children cumulated vsize (KiB) 482796

[startup+1062.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/176 23408
/proc/meminfo: memFree=25320836/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=496392 CPUtime=1061.99 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 120061 0 0 0 106138 61 0 0 20 0 1 0 317449259 508305408 121574 33554432000 134512640 134579096 4293475216 4293474128 134559161 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 124098 121574 228 17 0 123404 0
Current children cumulated CPU time (s) 1061.99
Current children cumulated vsize (KiB) 496392

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/176 23408
/proc/meminfo: memFree=25306436/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=511512 CPUtime=1121.98 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 123628 0 0 0 112134 64 0 0 20 0 1 0 317449259 523788288 125141 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 127878 125141 228 17 0 127184 0
Current children cumulated CPU time (s) 1121.98
Current children cumulated vsize (KiB) 511512

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23409
/proc/meminfo: memFree=25299368/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=518108 CPUtime=1181.98 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 125306 0 0 0 118132 66 0 0 20 0 1 0 317449259 530542592 126819 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 129527 126819 228 17 0 128833 0
Current children cumulated CPU time (s) 1181.98
Current children cumulated vsize (KiB) 518108

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 23410
/proc/meminfo: memFree=25289192/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=528536 CPUtime=1241.97 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 127789 0 0 0 124129 68 0 0 20 0 1 0 317449259 541220864 129302 33554432000 134512640 134579096 4293475216 4293474080 134520196 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 132134 129302 228 17 0 131440 0
Current children cumulated CPU time (s) 1241.97
Current children cumulated vsize (KiB) 528536

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23410
/proc/meminfo: memFree=25264524/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=535920 CPUtime=1301.97 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 129508 0 0 0 130126 71 0 0 20 0 1 0 317449259 548782080 131021 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 133980 131021 228 17 0 133286 0
Current children cumulated CPU time (s) 1301.97
Current children cumulated vsize (KiB) 535920

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23410
/proc/meminfo: memFree=25229612/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=542760 CPUtime=1361.93 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 131176 0 0 0 136121 72 0 0 20 0 1 0 317449259 555786240 132848 33554432000 134512640 134579096 4293475216 4293474080 134520067 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 135690 132848 228 17 0 134996 0
Current children cumulated CPU time (s) 1361.93
Current children cumulated vsize (KiB) 542760

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23410
/proc/meminfo: memFree=25212344/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=549064 CPUtime=1421.92 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 132603 0 0 0 142118 74 0 0 20 0 1 0 317449259 562241536 134471 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 137266 134471 228 17 0 136572 0
Current children cumulated CPU time (s) 1421.92
Current children cumulated vsize (KiB) 549064

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23411
/proc/meminfo: memFree=25204408/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=557464 CPUtime=1481.9 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 134631 0 0 0 148114 76 0 0 20 0 1 0 317449259 570843136 136499 33554432000 134512640 134579096 4293475216 4293474080 134519955 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 139366 136499 228 17 0 138672 0
Current children cumulated CPU time (s) 1481.9
Current children cumulated vsize (KiB) 557464

[startup+1542.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/176 23411
/proc/meminfo: memFree=25197216/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=564844 CPUtime=1541.89 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 136457 0 0 0 154112 77 0 0 20 0 1 0 317449259 578400256 138325 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 141211 138325 228 17 0 140517 0
Current children cumulated CPU time (s) 1541.89
Current children cumulated vsize (KiB) 564844

[startup+1602.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 23414
/proc/meminfo: memFree=25185984/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=575428 CPUtime=1601.88 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 139138 0 0 0 160109 79 0 0 20 0 1 0 317449259 589238272 141006 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 143857 141006 228 17 0 143163 0
Current children cumulated CPU time (s) 1601.88
Current children cumulated vsize (KiB) 575428

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23414
/proc/meminfo: memFree=25171864/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=589400 CPUtime=1661.87 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 142639 0 0 0 166104 83 0 0 20 0 1 0 317449259 603545600 144507 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 147350 144507 228 17 0 146656 0
Current children cumulated CPU time (s) 1661.87
Current children cumulated vsize (KiB) 589400

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23414
/proc/meminfo: memFree=25159836/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=601252 CPUtime=1721.87 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 145607 0 0 0 172101 86 0 0 20 0 1 0 317449259 615682048 147475 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 150313 147475 228 17 0 149619 0
Current children cumulated CPU time (s) 1721.87
Current children cumulated vsize (KiB) 601252

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23463
/proc/meminfo: memFree=25540164/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=609108 CPUtime=1781.85 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 147547 0 0 0 178098 87 0 0 20 0 1 0 317449259 623726592 149415 33554432000 134512640 134579096 4293475216 4293474144 134559533 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 152277 149415 228 17 0 151583 0
Current children cumulated CPU time (s) 1781.85
Current children cumulated vsize (KiB) 609108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23463
/proc/meminfo: memFree=25525780/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=615108 CPUtime=1800.05 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 149101 0 0 0 179917 88 0 0 20 0 1 0 317449259 629870592 150969 33554432000 134512640 134579096 4293475216 4293474080 134520044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 153777 150969 228 17 0 153083 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 615108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 23463
/proc/meminfo: memFree=25525780/32873852 swapFree=6856/6856
[pid=23398] ppid=23396 vsize=615108 CPUtime=1800.05 cores=1,3,5,7
/proc/23398/stat : 23398 (Pueblo) R 23396 23398 22360 0 -1 4202496 149101 0 0 0 179917 88 0 0 20 0 1 0 317449259 629870592 150969 33554432000 134512640 134579096 4293475216 4293474080 134520044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/23398/statm: 153777 150969 228 17 0 153083 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 615108

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.52
CPU time (s): 1800.08
CPU user time (s): 1799.18
CPU system time (s): 0.897863
CPU usage (%): 99.9755
Max. virtual memory (cumulated for all children) (KiB): 615108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.18
system time used= 0.897863
maximum resident set size= 603876
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 149101
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 186
involuntary context switches= 1845

runsolver used 3.87041 second user time and 9.74552 second system time

The end

Launcher Data 

Begin job on node129 at 2012-06-01 03:13:58
IDJOB=3720737
IDBENCH=89735
IDSOLVER=2305
FILE ID=node129/3720737-1338513237
RUNJOBID= node129-1338505999-22377
PBS_JOBID= 14635762
Free space on /tmp= 70440 MiB

SOLVER NAME= Pueblo 1.4
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-120.opb
COMMAND LINE= Pueblo BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3720737-1338513237/watcher-3720737-1338513237 -o /tmp/evaluation-result-3720737-1338513237/solver-3720737-1338513237 -C 1800 -W 1900 -M 15500  Pueblo HOME/instance-3720737-1338513237.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7b80ddfff13fd2a12f867bbe09bf6414
RANDOM SEED=1694923918

node129.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        26107272 kB
Buffers:          436716 kB
Cached:          5397524 kB
SwapCached:            0 kB
Active:          2485256 kB
Inactive:        3406548 kB
Active(anon):      49784 kB
Inactive(anon):    10768 kB
Active(file):    2435472 kB
Inactive(file):  3395780 kB
Unevictable:        6856 kB
Mlocked:            6856 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             51824 kB
Writeback:             8 kB
AnonPages:         66840 kB
Mapped:            15264 kB
Shmem:               204 kB
Slab:             737628 kB
SReclaimable:     179700 kB
SUnreclaim:       557928 kB
KernelStack:        1440 kB
PageTables:         4168 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     172308 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3720737-1338513237.opb

Free space on /tmp at the end= 70444 MiB
End job on node129 at 2012-06-01 03:44:01