Trace number 3720721

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: Pueblo 1.4? (TO) 1800.12 1800.52

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-61.opb
MD5SUM242cdc00579036e1487a0255b4e1d84c
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables10086
Total number of constraints226240
Number of constraints which are clauses203302
Number of constraints which are cardinality constraints (but not clauses)720
Number of constraints which are nor clauses,nor cardinality constraints22218
Minimum length of a constraint2
Maximum length of a constraint231
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 232
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c Pueblo version 1.4 (September 2005)
0.00/0.00	c Developed @ University of Michigan, Ann Arbor, MI
0.00/0.00	c  by Hossein Sheini
5.98/6.09	c starting to Solve
5.98/6.09	c #variables read: 10086 - #constraints read: 226608

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3720721-1338513227/watcher-3720721-1338513227 -o /tmp/evaluation-result-3720721-1338513227/solver-3720721-1338513227 -C 1800 -W 1900 -M 15500 Pueblo HOME/instance-3720721-1338513227.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.05 2.07 2.02 3/177 32366
/proc/meminfo: memFree=25605664/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=3104 CPUtime=0 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 326 0 0 0 0 0 0 0 20 0 1 0 317448832 3178496 263 33554432000 134512640 134579096 4288074176 4287941572 6812406 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 776 263 219 17 0 82 0

[startup+0.0367169 s]
/proc/loadavg: 2.05 2.07 2.02 3/177 32366
/proc/meminfo: memFree=25605664/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=3768 CPUtime=0.03 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 499 0 0 0 3 0 0 0 20 0 1 0 317448832 3858432 436 33554432000 134512640 134579096 4288074176 4287941516 16540720 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 942 436 219 17 0 248 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 3768

[startup+0.100134 s]
/proc/loadavg: 2.05 2.07 2.02 3/177 32366
/proc/meminfo: memFree=25605664/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=5236 CPUtime=0.09 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 849 0 0 0 9 0 0 0 20 0 1 0 317448832 5361664 786 33554432000 134512640 134579096 4288074176 4287941572 6812421 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 1309 786 219 17 0 615 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5236

[startup+0.300125 s]
/proc/loadavg: 2.05 2.07 2.02 3/177 32366
/proc/meminfo: memFree=25605664/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=9496 CPUtime=0.29 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 1911 0 0 0 29 0 0 0 20 0 1 0 317448832 9723904 1848 33554432000 134512640 134579096 4288074176 4287941452 16540720 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 2374 1848 219 17 0 1680 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9496

[startup+0.700108 s]
/proc/loadavg: 2.05 2.07 2.02 3/177 32366
/proc/meminfo: memFree=25605664/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=17756 CPUtime=0.68 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 3974 0 0 0 68 0 0 0 20 0 1 0 317448832 18182144 3911 33554432000 134512640 134579096 4288074176 4287941572 6812401 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 4439 3911 219 17 0 3745 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 17756

[startup+1.50012 s]
/proc/loadavg: 2.05 2.07 2.02 3/178 32367
/proc/meminfo: memFree=25583716/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=34008 CPUtime=1.49 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 8037 0 0 0 148 1 0 0 20 0 1 0 317448832 34824192 7974 33554432000 134512640 134579096 4288074176 4287941452 16540720 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 8502 7974 219 17 0 7808 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 34008

[startup+3.10012 s]
/proc/loadavg: 2.12 2.09 2.02 3/178 32367
/proc/meminfo: memFree=25567960/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=39408 CPUtime=3.09 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 9280 0 0 0 308 1 0 0 20 0 1 0 317448832 40353792 9217 33554432000 134512640 134579096 4288074176 4288073152 134532044 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 9852 9217 226 17 0 9158 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 39408

[startup+6.30025 s]
/proc/loadavg: 2.12 2.09 2.02 3/178 32367
/proc/meminfo: memFree=25559344/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=48372 CPUtime=6.28 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 11531 0 0 0 627 1 0 0 20 0 1 0 317448832 49532928 11468 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 12093 11468 228 17 0 11399 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 48372

[startup+12.7002 s]
/proc/loadavg: 2.10 2.08 2.02 3/178 32367
/proc/meminfo: memFree=25551236/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=48700 CPUtime=12.68 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 11604 0 0 0 1267 1 0 0 20 0 1 0 317448832 49868800 11541 33554432000 134512640 134579096 4288074176 4288073040 134520196 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 12175 11541 228 17 0 11481 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 48700

[startup+25.5002 s]
/proc/loadavg: 2.09 2.08 2.02 3/178 32415
/proc/meminfo: memFree=27586004/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=54728 CPUtime=25.49 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 12978 0 0 0 2547 2 0 0 20 0 1 0 317448832 56041472 12915 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 13682 12915 228 17 0 12988 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 54728

[startup+51.1003 s]
/proc/loadavg: 2.06 2.07 2.02 3/178 32415
/proc/meminfo: memFree=27519332/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=81960 CPUtime=51.07 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 19543 0 0 0 5103 4 0 0 20 0 1 0 317448832 83927040 19464 33554432000 134512640 134579096 4288074176 4288073076 134519888 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 20490 19464 228 17 0 19796 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 81960

[startup+102.306 s]
/proc/loadavg: 2.02 2.06 2.01 3/178 32415
/proc/meminfo: memFree=27460684/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=117952 CPUtime=102.24 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 28110 0 0 0 10219 5 0 0 20 0 1 0 317448832 120782848 28396 33554432000 134512640 134579096 4288074176 4288073040 134520152 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 29488 28396 228 17 0 28794 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 117952

[startup+162.3 s]
/proc/loadavg: 2.01 2.05 2.01 3/178 32415
/proc/meminfo: memFree=27388792/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=153032 CPUtime=162.23 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 36830 0 0 0 16215 8 0 0 20 0 1 0 317448832 156704768 37116 33554432000 134512640 134579096 4288074176 4288073040 134520204 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 38258 37116 228 17 0 37564 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 153032

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/178 32415
/proc/meminfo: memFree=27316724/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=189924 CPUtime=222.22 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 46021 0 0 0 22210 12 0 0 20 0 1 0 317448832 194482176 46307 33554432000 134512640 134579096 4288074176 4288073040 134519946 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 47481 46307 228 17 0 46787 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 189924

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/178 32416
/proc/meminfo: memFree=27276720/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=196552 CPUtime=282.18 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 47703 0 0 0 28205 13 0 0 20 0 1 0 317448832 201269248 48201 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 49138 48201 228 17 0 48444 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 196552

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/178 32416
/proc/meminfo: memFree=27230392/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=196984 CPUtime=342.17 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 47764 0 0 0 34204 13 0 0 20 0 1 0 317448832 201711616 48335 33554432000 134512640 134579096 4288074176 4288073040 134520141 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 49246 48335 228 17 0 48552 0
Current children cumulated CPU time (s) 342.17
Current children cumulated vsize (KiB) 196984

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 32419
/proc/meminfo: memFree=27211228/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=198144 CPUtime=402.16 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 48050 0 0 0 40203 13 0 0 20 0 1 0 317448832 202899456 48621 33554432000 134512640 134579096 4288074176 4288073008 134517919 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 49536 48621 228 17 0 48842 0
Current children cumulated CPU time (s) 402.16
Current children cumulated vsize (KiB) 198144

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 32419
/proc/meminfo: memFree=27111560/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=276068 CPUtime=462.15 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 67530 0 0 0 46196 19 0 0 20 0 1 0 317448832 282693632 68101 33554432000 134512640 134579096 4288074176 4288072832 134522427 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 69017 68101 228 17 0 68323 0
Current children cumulated CPU time (s) 462.15
Current children cumulated vsize (KiB) 276068

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32419
/proc/meminfo: memFree=27022756/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=330820 CPUtime=522.14 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 81231 0 0 0 52191 23 0 0 20 0 1 0 317448832 338759680 81802 33554432000 134512640 134579096 4288074176 4288072996 134556411 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 82705 81802 228 17 0 82011 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 330820

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32420
/proc/meminfo: memFree=26991628/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=349356 CPUtime=582.13 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 85846 0 0 0 58189 24 0 0 20 0 1 0 317448832 357740544 86474 33554432000 134512640 134579096 4288074176 4288073084 134527888 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 87339 86474 228 17 0 86645 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 349356

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 32623
/proc/meminfo: memFree=26979288/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=363436 CPUtime=882.04 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 88331 0 0 0 88178 26 0 0 20 0 1 0 317448832 372158464 88989 33554432000 134512640 134579096 4288074176 4288073040 134519934 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 90859 88989 228 17 0 90165 0
Current children cumulated CPU time (s) 882.04
Current children cumulated vsize (KiB) 363436

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32623
/proc/meminfo: memFree=26977180/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=367276 CPUtime=942.03 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 88876 0 0 0 94177 26 0 0 20 0 1 0 317448832 376090624 89534 33554432000 134512640 134579096 4288074176 4288073040 134520225 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 91819 89534 228 17 0 91125 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 367276

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32626
/proc/meminfo: memFree=26975568/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=368556 CPUtime=1002.02 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 89203 0 0 0 100176 26 0 0 20 0 1 0 317448832 377401344 89861 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 92139 89861 228 17 0 91445 0
Current children cumulated CPU time (s) 1002.02
Current children cumulated vsize (KiB) 368556

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32626
/proc/meminfo: memFree=26972972/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=370604 CPUtime=1062.01 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 89787 0 0 0 106174 27 0 0 20 0 1 0 317448832 379498496 90445 33554432000 134512640 134579096 4288074176 4288073040 134519943 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 92651 90445 228 17 0 91957 0
Current children cumulated CPU time (s) 1062.01
Current children cumulated vsize (KiB) 370604

[startup+1122.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 32626
/proc/meminfo: memFree=26960076/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=371884 CPUtime=1122 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 89996 0 0 0 112173 27 0 0 20 0 1 0 317448832 380809216 90654 33554432000 134512640 134579096 4288074176 4288073040 134519955 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 92971 90654 228 17 0 92277 0
Current children cumulated CPU time (s) 1122
Current children cumulated vsize (KiB) 371884

[startup+1182.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 32627
/proc/meminfo: memFree=26933420/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=373932 CPUtime=1182 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 90265 0 0 0 118172 28 0 0 20 0 1 0 317448832 382906368 90923 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 93483 90923 228 17 0 92789 0
Current children cumulated CPU time (s) 1182
Current children cumulated vsize (KiB) 373932

[startup+1242.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 32627
/proc/meminfo: memFree=26907256/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=375212 CPUtime=1241.99 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 90471 0 0 0 124171 28 0 0 20 0 1 0 317448832 384217088 91129 33554432000 134512640 134579096 4288074176 4288073084 134519884 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 93803 91129 228 17 0 93109 0
Current children cumulated CPU time (s) 1241.99
Current children cumulated vsize (KiB) 375212

[startup+1302.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 32627
/proc/meminfo: memFree=26879572/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=376236 CPUtime=1301.98 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 90625 0 0 0 130170 28 0 0 20 0 1 0 317448832 385265664 91283 33554432000 134512640 134579096 4288074176 4288073040 134520229 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 94059 91283 228 17 0 93365 0
Current children cumulated CPU time (s) 1301.98
Current children cumulated vsize (KiB) 376236

[startup+1362.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 32627
/proc/meminfo: memFree=26855252/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=376492 CPUtime=1361.96 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 90892 0 0 0 136168 28 0 0 20 0 1 0 317448832 385527808 91550 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 94123 91550 228 17 0 93429 0
Current children cumulated CPU time (s) 1361.96
Current children cumulated vsize (KiB) 376492

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32627
/proc/meminfo: memFree=26834296/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=379820 CPUtime=1421.96 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91149 0 0 0 142168 28 0 0 20 0 1 0 317448832 388935680 91807 33554432000 134512640 134579096 4288074176 4288073104 134559578 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 94955 91807 228 17 0 94261 0
Current children cumulated CPU time (s) 1421.96
Current children cumulated vsize (KiB) 379820

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32628
/proc/meminfo: memFree=26811604/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=380588 CPUtime=1481.95 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91249 0 0 0 148166 29 0 0 20 0 1 0 317448832 389722112 91907 33554432000 134512640 134579096 4288074176 4288073040 134520067 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 95147 91907 228 17 0 94453 0
Current children cumulated CPU time (s) 1481.95
Current children cumulated vsize (KiB) 380588

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32628
/proc/meminfo: memFree=26807140/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=381612 CPUtime=1541.94 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91337 0 0 0 154165 29 0 0 20 0 1 0 317448832 390770688 91995 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 95403 91995 228 17 0 94709 0
Current children cumulated CPU time (s) 1541.94
Current children cumulated vsize (KiB) 381612

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32631
/proc/meminfo: memFree=26807012/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=381612 CPUtime=1601.93 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91337 0 0 0 160164 29 0 0 20 0 1 0 317448832 390770688 91995 33554432000 134512640 134579096 4288074176 4288073008 134517928 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 95403 91995 228 17 0 94709 0
Current children cumulated CPU time (s) 1601.93
Current children cumulated vsize (KiB) 381612

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 32631
/proc/meminfo: memFree=26806776/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=381612 CPUtime=1661.92 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91337 0 0 0 166163 29 0 0 20 0 1 0 317448832 390770688 91995 33554432000 134512640 134579096 4288074176 4288073084 134519884 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 95403 91995 228 17 0 94709 0
Current children cumulated CPU time (s) 1661.92
Current children cumulated vsize (KiB) 381612

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 32631
/proc/meminfo: memFree=26806900/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=381612 CPUtime=1721.91 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 91337 0 0 0 172162 29 0 0 20 0 1 0 317448832 390770688 91995 33554432000 134512640 134579096 4288074176 4288073008 134517901 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 95403 91995 228 17 0 94709 0
Current children cumulated CPU time (s) 1721.91
Current children cumulated vsize (KiB) 381612

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32632
/proc/meminfo: memFree=26741304/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=448496 CPUtime=1781.9 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 107985 0 0 0 178156 34 0 0 20 0 1 0 317448832 459259904 108643 33554432000 134512640 134579096 4288074176 4288073104 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 112124 108643 228 17 0 111430 0
Current children cumulated CPU time (s) 1781.9
Current children cumulated vsize (KiB) 448496



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32632
/proc/meminfo: memFree=26717868/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=470120 CPUtime=1800.1 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 113384 0 0 0 179975 35 0 0 20 0 1 0 317448832 481402880 114042 33554432000 134512640 134579096 4288074176 4288073040 134519943 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 117530 114042 228 17 0 116836 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 470120

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32632
/proc/meminfo: memFree=26717868/32873648 swapFree=6860/6860
[pid=32366] ppid=32364 vsize=470120 CPUtime=1800.1 cores=1,3,5,7
/proc/32366/stat : 32366 (Pueblo) R 32364 32366 31568 0 -1 4202496 113384 0 0 0 179975 35 0 0 20 0 1 0 317448832 481402880 114042 33554432000 134512640 134579096 4288074176 4288073040 134519943 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/32366/statm: 117530 114042 228 17 0 116836 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 470120

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.52
CPU time (s): 1800.12
CPU user time (s): 1799.76
CPU system time (s): 0.367944
CPU usage (%): 99.9783
Max. virtual memory (cumulated for all children) (KiB): 470120

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.76
system time used= 0.367944
maximum resident set size= 456168
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 113384
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 169
involuntary context switches= 1854

runsolver used 3.23051 second user time and 9.53355 second system time

The end

Launcher Data 

Begin job on node116 at 2012-06-01 03:13:48
IDJOB=3720721
IDBENCH=89634
IDSOLVER=2305
FILE ID=node116/3720721-1338513227
RUNJOBID= node116-1338506006-31585
PBS_JOBID= 14635775
Free space on /tmp= 71096 MiB

SOLVER NAME= Pueblo 1.4
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-61.opb
COMMAND LINE= Pueblo BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3720721-1338513227/watcher-3720721-1338513227 -o /tmp/evaluation-result-3720721-1338513227/solver-3720721-1338513227 -C 1800 -W 1900 -M 15500  Pueblo HOME/instance-3720721-1338513227.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 242cdc00579036e1487a0255b4e1d84c
RANDOM SEED=1524525238

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        25605820 kB
Buffers:          469828 kB
Cached:          3862392 kB
SwapCached:         3032 kB
Active:          4013464 kB
Inactive:        2381820 kB
Active(anon):    2052820 kB
Inactive(anon):     8516 kB
Active(file):    1960644 kB
Inactive(file):  2373304 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67103476 kB
Dirty:             11452 kB
Writeback:             4 kB
AnonPages:       2063816 kB
Mapped:            12864 kB
Shmem:                68 kB
Slab:             732996 kB
SReclaimable:     176940 kB
SUnreclaim:       556056 kB
KernelStack:        1464 kB
PageTables:         7544 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    2181528 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1728512 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3720721-1338513227.opb

Free space on /tmp at the end= 71088 MiB
End job on node116 at 2012-06-01 03:43:50