Trace number 3720739

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: Pueblo 1.4? (TO) 1800.06 1800.53

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-123.opb
MD5SUMe6dc64843ebe4c9cb8812bfa08aa0858
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables36611
Total number of constraints853935
Number of constraints which are clauses766797
Number of constraints which are cardinality constraints (but not clauses)2865
Number of constraints which are nor clauses,nor cardinality constraints84273
Minimum length of a constraint1
Maximum length of a constraint756
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 757
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c Pueblo version 1.4 (September 2005)
0.00/0.00	c Developed @ University of Michigan, Ann Arbor, MI
0.00/0.00	c  by Hossein Sheini
66.07/66.15	c starting to Solve
66.07/66.15	c #variables read: 36611 - #constraints read: 726553

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3720739-1338513238/watcher-3720739-1338513238 -o /tmp/evaluation-result-3720739-1338513238/solver-3720739-1338513238 -C 1800 -W 1900 -M 15500 Pueblo HOME/instance-3720739-1338513238.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28607
/proc/meminfo: memFree=31119668/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=3236 CPUtime=0 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 348 0 0 0 0 0 0 0 20 0 1 0 317449799 3313664 285 33554432000 134512640 134579096 4294225120 4294092544 134546735 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 809 285 221 17 0 115 0

[startup+0.0432451 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28607
/proc/meminfo: memFree=31119668/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=4036 CPUtime=0.04 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 546 0 0 0 4 0 0 0 20 0 1 0 317449799 4132864 483 33554432000 134512640 134579096 4294225120 4294092516 2331460 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 1009 483 221 17 0 315 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 4036

[startup+0.100206 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28607
/proc/meminfo: memFree=31119668/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=5236 CPUtime=0.09 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 853 0 0 0 9 0 0 0 20 0 1 0 317449799 5361664 790 33554432000 134512640 134579096 4294225120 4294092532 2331373 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 1309 790 221 17 0 615 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5236

[startup+0.300183 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28607
/proc/meminfo: memFree=31119668/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=9364 CPUtime=0.29 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 1890 0 0 0 29 0 0 0 20 0 1 0 317449799 9588736 1827 33554432000 134512640 134579096 4294225120 4294092516 2331382 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 2341 1827 221 17 0 1647 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9364

[startup+0.70018 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28607
/proc/meminfo: memFree=31119668/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=17356 CPUtime=0.69 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 3902 0 0 0 69 0 0 0 20 0 1 0 317449799 17772544 3839 33554432000 134512640 134579096 4294225120 4294092516 2331382 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 4339 3839 221 17 0 3645 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17356

[startup+1.50018 s]
/proc/loadavg: 2.04 2.03 1.97 3/178 28608
/proc/meminfo: memFree=31099604/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=33208 CPUtime=1.49 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 7867 0 0 0 148 1 0 0 20 0 1 0 317449799 34004992 7804 33554432000 134512640 134579096 4294225120 4294092580 2331402 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 8302 7804 221 17 0 7608 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 33208

[startup+3.10023 s]
/proc/loadavg: 2.04 2.03 1.97 3/178 28608
/proc/meminfo: memFree=31077780/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=63580 CPUtime=3.09 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 15458 0 0 0 306 3 0 0 20 0 1 0 317449799 65105920 15395 33554432000 134512640 134579096 4294225120 4294092580 2331397 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 15895 15395 221 17 0 15201 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 63580

[startup+6.30018 s]
/proc/loadavg: 2.04 2.03 1.97 3/177 28608
/proc/meminfo: memFree=31015656/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=122992 CPUtime=6.28 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 30291 0 0 0 623 5 0 0 20 0 1 0 317449799 125943808 30224 33554432000 134512640 134579096 4294225120 4294092396 7398448 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 30748 30224 221 17 0 30054 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 122992

[startup+12.701 s]
/proc/loadavg: 2.11 2.04 1.98 3/178 28609
/proc/meminfo: memFree=30985944/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=138872 CPUtime=12.68 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 33645 0 0 0 1262 6 0 0 20 0 1 0 317449799 142204928 33578 33554432000 134512640 134579096 4294225120 4294224096 134532045 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 34718 33578 229 17 0 34024 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 138872

[startup+25.501 s]
/proc/loadavg: 2.10 2.04 1.98 3/178 28609
/proc/meminfo: memFree=30985680/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=140060 CPUtime=25.48 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 33953 0 0 0 2542 6 0 0 20 0 1 0 317449799 143421440 33883 33554432000 134512640 134579096 4294225120 4294224080 134532440 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/28607/statm: 35015 33883 229 17 0 34321 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 140060

[startup+51.1002 s]
/proc/loadavg: 2.06 2.03 1.98 3/178 28657
/proc/meminfo: memFree=31008588/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=159120 CPUtime=51.07 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 38184 0 0 0 5101 6 0 0 20 0 1 0 317449799 162938880 38113 33554432000 134512640 134579096 4294225120 4294224096 134532044 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 39780 38113 229 17 0 39086 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 159120

[startup+102.307 s]
/proc/loadavg: 2.08 2.04 1.98 3/178 28657
/proc/meminfo: memFree=30954896/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=174688 CPUtime=102.26 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 42292 0 0 0 10219 7 0 0 20 0 1 0 317449799 178880512 42530 33554432000 134512640 134579096 4294225120 4294223776 134522500 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 43672 42530 230 17 0 42978 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 174688

[startup+162.3 s]
/proc/loadavg: 2.08 2.05 1.99 3/178 28657
/proc/meminfo: memFree=30921520/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=175584 CPUtime=162.24 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 42481 0 0 0 16217 7 0 0 20 0 1 0 317449799 179798016 42687 33554432000 134512640 134579096 4294225120 4294224048 134559555 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 43896 42687 230 17 0 43202 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 175584

[startup+222.301 s]
/proc/loadavg: 2.02 2.03 1.99 3/178 28657
/proc/meminfo: memFree=30920800/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=176800 CPUtime=222.23 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 42743 0 0 0 22216 7 0 0 20 0 1 0 317449799 181043200 42949 33554432000 134512640 134579096 4294225120 4294224028 134519884 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 44200 42949 230 17 0 43506 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 176800

[startup+282.3 s]
/proc/loadavg: 2.01 2.03 1.99 3/178 28657
/proc/meminfo: memFree=30892904/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=192596 CPUtime=282.22 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 46431 0 0 0 28214 8 0 0 20 0 1 0 317449799 197218304 46637 33554432000 134512640 134579096 4294225120 4294224000 134558596 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 48149 46637 230 17 0 47455 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 192596

[startup+342.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/178 28658
/proc/meminfo: memFree=30852580/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=232376 CPUtime=342.2 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 56350 0 0 0 34209 11 0 0 20 0 1 0 317449799 237953024 56708 33554432000 134512640 134579096 4294225120 4294223952 134517919 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 58094 56708 230 17 0 57400 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 232376

[startup+402.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/179 28661
/proc/meminfo: memFree=30808036/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=276876 CPUtime=402.19 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 67491 0 0 0 40205 14 0 0 20 0 1 0 317449799 283521024 67849 33554432000 134512640 134579096 4294225120 4294224048 134559526 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 69219 67849 230 17 0 68525 0
Current children cumulated CPU time (s) 402.19
Current children cumulated vsize (KiB) 276876

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/178 28661
/proc/meminfo: memFree=30768240/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=308640 CPUtime=462.19 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 75394 0 0 0 46203 16 0 0 20 0 1 0 317449799 316047360 75752 33554432000 134512640 134579096 4294225120 4294223984 134519997 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 77160 75752 230 17 0 76466 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 308640

[startup+522.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 28661
/proc/meminfo: memFree=30707700/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=344720 CPUtime=522.17 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 84446 0 0 0 52197 20 0 0 20 0 1 0 317449799 352993280 84819 33554432000 134512640 134579096 4294225120 4294223952 134517893 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 86180 84819 230 17 0 85486 0
Current children cumulated CPU time (s) 522.17
Current children cumulated vsize (KiB) 344720

[startup+582.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 28661
/proc/meminfo: memFree=30639280/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=399376 CPUtime=582.13 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 98167 0 0 0 58189 24 0 0 20 0 1 0 317449799 408961024 98607 33554432000 134512640 134579096 4294225120 4294223952 134517872 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 99844 98607 230 17 0 99150 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 399376

[startup+642.301 s]

################
# More data... #
################

[startup+882.301 s]
/proc/loadavg: 2.50 2.16 2.04 3/183 28832
/proc/meminfo: memFree=30355568/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=587188 CPUtime=882.05 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 144397 0 0 0 88165 40 0 0 20 0 1 0 317449799 601280512 145366 33554432000 134512640 134579096 4294225120 4294223936 134519077 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 146797 145366 230 17 0 146103 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 587188

[startup+942.3 s]
/proc/loadavg: 2.31 2.17 2.05 3/178 28866
/proc/meminfo: memFree=30322520/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=616556 CPUtime=942.04 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 151628 0 0 0 94161 43 0 0 20 0 1 0 317449799 631353344 152597 33554432000 134512640 134579096 4294225120 4294223968 134527740 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 154139 152597 230 17 0 153445 0
Current children cumulated CPU time (s) 942.04
Current children cumulated vsize (KiB) 616556

[startup+1002.3 s]
/proc/loadavg: 2.10 2.14 2.04 3/178 28869
/proc/meminfo: memFree=30267464/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=643564 CPUtime=1002.03 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 158393 0 0 0 100158 45 0 0 20 0 1 0 317449799 659009536 159362 33554432000 134512640 134579096 4294225120 4294224048 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 160891 159362 230 17 0 160197 0
Current children cumulated CPU time (s) 1002.03
Current children cumulated vsize (KiB) 643564

[startup+1062.3 s]
/proc/loadavg: 2.04 2.11 2.04 3/177 28869
/proc/meminfo: memFree=30232928/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=672464 CPUtime=1062.02 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 165573 0 0 0 106154 48 0 0 20 0 1 0 317449799 688603136 166549 33554432000 134512640 134579096 4294225120 4294223984 134519929 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 168116 166549 230 17 0 167422 0
Current children cumulated CPU time (s) 1062.02
Current children cumulated vsize (KiB) 672464

[startup+1122.3 s]
/proc/loadavg: 2.01 2.09 2.03 3/177 28869
/proc/meminfo: memFree=30186456/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=705724 CPUtime=1121.99 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 173845 0 0 0 112148 51 0 0 20 0 1 0 317449799 722661376 174911 33554432000 134512640 134579096 4294225120 4294223824 1609942 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 176431 174911 230 17 0 175737 0
Current children cumulated CPU time (s) 1121.99
Current children cumulated vsize (KiB) 705724

[startup+1182.3 s]
/proc/loadavg: 2.06 2.08 2.03 3/177 28869
/proc/meminfo: memFree=30146568/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=744252 CPUtime=1181.96 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 183448 0 0 0 118141 55 0 0 20 0 1 0 317449799 762114048 184545 33554432000 134512640 134579096 4294225120 4294223824 1609942 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 186063 184545 230 17 0 185369 0
Current children cumulated CPU time (s) 1181.96
Current children cumulated vsize (KiB) 744252

[startup+1242.3 s]
/proc/loadavg: 2.07 2.08 2.03 3/177 28870
/proc/meminfo: memFree=30108280/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=779612 CPUtime=1241.92 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 192223 0 0 0 124134 58 0 0 20 0 1 0 317449799 798322688 193448 33554432000 134512640 134579096 4294225120 4294223936 134519125 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 194903 193448 230 17 0 194209 0
Current children cumulated CPU time (s) 1241.92
Current children cumulated vsize (KiB) 779612

[startup+1302.3 s]
/proc/loadavg: 2.02 2.06 2.03 3/177 28870
/proc/meminfo: memFree=30078184/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=809520 CPUtime=1301.91 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 199730 0 0 0 130131 60 0 0 20 0 1 0 317449799 828948480 200980 33554432000 134512640 134579096 4294225120 4294223984 134519970 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 202380 200980 230 17 0 201686 0
Current children cumulated CPU time (s) 1301.91
Current children cumulated vsize (KiB) 809520

[startup+1362.3 s]
/proc/loadavg: 2.01 2.05 2.02 3/177 28870
/proc/meminfo: memFree=30046068/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=842144 CPUtime=1361.9 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 207879 0 0 0 136127 63 0 0 20 0 1 0 317449799 862355456 209129 33554432000 134512640 134579096 4294225120 4294223624 1582375 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 210536 209129 230 17 0 209842 0
Current children cumulated CPU time (s) 1361.9
Current children cumulated vsize (KiB) 842144

[startup+1422.31 s]
/proc/loadavg: 2.00 2.04 2.01 3/177 28870
/proc/meminfo: memFree=30011236/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=876412 CPUtime=1421.88 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 216386 0 0 0 142123 65 0 0 20 0 1 0 317449799 897445888 217636 33554432000 134512640 134579096 4294225120 4294224012 134520011 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 219103 217636 230 17 0 218409 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 876412

[startup+1482.3 s]
/proc/loadavg: 2.00 2.03 2.01 3/177 28870
/proc/meminfo: memFree=29975204/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=913744 CPUtime=1481.87 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 225682 0 0 0 148118 69 0 0 20 0 1 0 317449799 935673856 226932 33554432000 134512640 134579096 4294225120 4294224048 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 228436 226932 230 17 0 227742 0
Current children cumulated CPU time (s) 1481.87
Current children cumulated vsize (KiB) 913744

[startup+1542.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 28871
/proc/meminfo: memFree=29950280/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=938236 CPUtime=1541.86 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 231798 0 0 0 154115 71 0 0 20 0 1 0 317449799 960753664 233048 33554432000 134512640 134579096 4294225120 4294224048 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 234559 233048 230 17 0 233865 0
Current children cumulated CPU time (s) 1541.86
Current children cumulated vsize (KiB) 938236

[startup+1602.3 s]
/proc/loadavg: 2.08 2.03 2.01 3/178 28874
/proc/meminfo: memFree=29925864/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=963872 CPUtime=1601.85 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 238092 0 0 0 160112 73 0 0 20 0 1 0 317449799 987004928 239342 33554432000 134512640 134579096 4294225120 4294224048 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 240968 239342 230 17 0 240274 0
Current children cumulated CPU time (s) 1601.85
Current children cumulated vsize (KiB) 963872

[startup+1662.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/177 28874
/proc/meminfo: memFree=29889788/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=998900 CPUtime=1661.84 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 246785 0 0 0 166109 75 0 0 20 0 1 0 317449799 1022873600 248035 33554432000 134512640 134579096 4294225120 4294223984 134520212 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 249725 248035 230 17 0 249031 0
Current children cumulated CPU time (s) 1661.84
Current children cumulated vsize (KiB) 998900

[startup+1722.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 28874
/proc/meminfo: memFree=29853952/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=1034592 CPUtime=1721.84 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 255708 0 0 0 172106 78 0 0 20 0 1 0 317449799 1059422208 256958 33554432000 134512640 134579096 4294225120 4294223984 134519970 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 258648 256958 230 17 0 257954 0
Current children cumulated CPU time (s) 1721.84
Current children cumulated vsize (KiB) 1034592

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 28874
/proc/meminfo: memFree=29819356/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=1069412 CPUtime=1781.83 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 264324 0 0 0 178102 81 0 0 20 0 1 0 317449799 1095077888 265561 33554432000 134512640 134579096 4294225120 4294224048 134559533 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 267353 265561 230 17 0 266659 0
Current children cumulated CPU time (s) 1781.83
Current children cumulated vsize (KiB) 1069412



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 28874
/proc/meminfo: memFree=29812164/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=1076540 CPUtime=1800.03 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 266149 0 0 0 179922 81 0 0 20 0 1 0 317449799 1102376960 267383 33554432000 134512640 134579096 4294225120 4294223984 134520048 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 269135 267383 230 17 0 268441 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1076540

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 28874
/proc/meminfo: memFree=29812164/32873648 swapFree=6860/6860
[pid=28607] ppid=28605 vsize=1076540 CPUtime=1800.03 cores=1,3,5,7
/proc/28607/stat : 28607 (Pueblo) R 28605 28607 27856 0 -1 4202496 266149 0 0 0 179922 81 0 0 20 0 1 0 317449799 1102376960 267383 33554432000 134512640 134579096 4294225120 4294223984 134520048 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28607/statm: 269135 267383 230 17 0 268441 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1076540

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.53
CPU time (s): 1800.06
CPU user time (s): 1799.23
CPU system time (s): 0.837872
CPU usage (%): 99.9742
Max. virtual memory (cumulated for all children) (KiB): 1076540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.23
system time used= 0.837872
maximum resident set size= 1069532
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 266149
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 283
involuntary context switches= 2210

runsolver used 3.42048 second user time and 9.13561 second system time

The end

Launcher Data 

Begin job on node124 at 2012-06-01 03:13:59
IDJOB=3720739
IDBENCH=89740
IDSOLVER=2305
FILE ID=node124/3720739-1338513238
RUNJOBID= node124-1338506006-27873
PBS_JOBID= 14635767
Free space on /tmp= 70736 MiB

SOLVER NAME= Pueblo 1.4
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-123.opb
COMMAND LINE= Pueblo BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3720739-1338513238/watcher-3720739-1338513238 -o /tmp/evaluation-result-3720739-1338513238/solver-3720739-1338513238 -C 1800 -W 1900 -M 15500  Pueblo HOME/instance-3720739-1338513238.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e6dc64843ebe4c9cb8812bfa08aa0858
RANDOM SEED=1352954897

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5357.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31120692 kB
Buffers:           16052 kB
Cached:           935952 kB
SwapCached:         8056 kB
Active:           280396 kB
Inactive:         754848 kB
Active(anon):      77940 kB
Inactive(anon):     7692 kB
Active(file):     202456 kB
Inactive(file):   747156 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67091252 kB
Dirty:             39416 kB
Writeback:             0 kB
AnonPages:         84696 kB
Mapped:             8808 kB
Shmem:                 0 kB
Slab:             580772 kB
SReclaimable:      24924 kB
SUnreclaim:       555848 kB
KernelStack:        1456 kB
PageTables:         4232 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     199084 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3720739-1338513238.opb

Free space on /tmp at the end= 70736 MiB
End job on node124 at 2012-06-01 03:44:02