Trace number 3720822

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: Pueblo 1.4? (TO) 1800.08 1800.41

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K128.opb
MD5SUM17c4ca9a6493665b57c1ccd2ab23e03d
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables15232
Total number of constraints15490
Number of constraints which are clauses15362
Number of constraints which are cardinality constraints (but not clauses)128
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint128
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 129
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c Pueblo version 1.4 (September 2005)
0.00/0.00	c Developed @ University of Michigan, Ann Arbor, MI
0.00/0.00	c  by Hossein Sheini
0.59/0.66	c starting to Solve
0.59/0.66	c #variables read: 15232 - #constraints read: 15488

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3720822-1338514962/watcher-3720822-1338514962 -o /tmp/evaluation-result-3720822-1338514962/solver-3720822-1338514962 -C 1800 -W 1900 -M 15500 Pueblo HOME/instance-3720822-1338514962.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 22534
/proc/meminfo: memFree=29537584/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=3096 CPUtime=0 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 297 0 0 0 0 0 0 0 20 0 1 0 317621651 3170304 235 33554432000 134512640 134579096 4294468768 4294336004 9700784 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 775 239 211 17 0 81 0

[startup+0.0830481 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 22534
/proc/meminfo: memFree=29537584/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=5764 CPUtime=0.07 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 976 0 0 0 7 0 0 0 20 0 1 0 317621651 5902336 914 33554432000 134512640 134579096 4294468768 4294336164 10023661 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 1441 914 219 17 0 747 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5764

[startup+0.100223 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 22534
/proc/meminfo: memFree=29537584/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=6028 CPUtime=0.09 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 1064 0 0 0 9 0 0 0 20 0 1 0 317621651 6172672 1002 33554432000 134512640 134579096 4294468768 4294336192 134546737 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 1507 1002 219 17 0 813 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 6028

[startup+0.300137 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 22534
/proc/meminfo: memFree=29537584/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=9016 CPUtime=0.29 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 1810 0 0 0 29 0 0 0 20 0 1 0 317621651 9232384 1748 33554432000 134512640 134579096 4294468768 4294467744 134532045 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 2254 1748 226 17 0 1560 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9016

[startup+0.70012 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 22534
/proc/meminfo: memFree=29537584/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=12452 CPUtime=0.69 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 2651 0 0 0 69 0 0 0 20 0 1 0 317621651 12750848 2589 33554432000 134512640 134579096 4294468768 4294467584 134519095 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 3113 2589 228 17 0 2419 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 12452

[startup+1.5001 s]
/proc/loadavg: 2.02 2.01 2.00 2/176 22536
/proc/meminfo: memFree=29634228/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=12908 CPUtime=1.49 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 2667 0 0 0 149 0 0 0 20 0 1 0 317621651 13217792 2605 33554432000 134512640 134579096 4294468768 4294467588 134556250 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 3227 2605 228 17 0 2533 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 12908

[startup+3.10011 s]
/proc/loadavg: 2.02 2.01 2.00 2/175 22536
/proc/meminfo: memFree=29633724/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=12796 CPUtime=3.08 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 2692 0 0 0 308 0 0 0 20 0 1 0 317621651 13103104 2613 33554432000 134512640 134579096 4294468768 4294467588 134556204 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 3199 2613 228 17 0 2505 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 12796

[startup+6.3001 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 22584
/proc/meminfo: memFree=29618896/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=13756 CPUtime=6.28 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 3006 0 0 0 628 0 0 0 20 0 1 0 317621651 14086144 2927 33554432000 134512640 134579096 4294468768 4294467584 134519114 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 3439 2927 228 17 0 2745 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 13756

[startup+12.7002 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 22584
/proc/meminfo: memFree=29614424/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=17572 CPUtime=12.68 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 3943 0 0 0 1268 0 0 0 20 0 1 0 317621651 17993728 3864 33554432000 134512640 134579096 4294468768 4294467424 134522729 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 4393 3864 228 17 0 3699 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 17572

[startup+25.5002 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 22584
/proc/meminfo: memFree=29603284/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=25864 CPUtime=25.48 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 6030 0 0 0 2547 1 0 0 20 0 1 0 317621651 26484736 5948 33554432000 134512640 134579096 4294468768 4294467584 134519085 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 6466 5948 228 17 0 5772 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 25864

[startup+51.1001 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 22584
/proc/meminfo: memFree=29583932/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=35148 CPUtime=51.07 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 8524 0 0 0 5106 1 0 0 20 0 1 0 317621651 35991552 8271 33554432000 134512640 134579096 4294468768 4294467600 134517901 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 8787 8271 228 17 0 8093 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 35148

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22584
/proc/meminfo: memFree=29536896/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=62324 CPUtime=102.26 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 15464 0 0 0 10224 2 0 0 20 0 1 0 317621651 63819776 15053 33554432000 134512640 134579096 4294468768 4294467424 134522733 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 15581 15053 228 17 0 14887 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 62324

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22585
/proc/meminfo: memFree=29517684/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=73536 CPUtime=162.25 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 18347 0 0 0 16222 3 0 0 20 0 1 0 317621651 75300864 17861 33554432000 134512640 134579096 4294468768 4294467616 134527712 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 18384 17861 228 17 0 17690 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 73536

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22585
/proc/meminfo: memFree=29499888/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=84924 CPUtime=222.23 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 21917 0 0 0 22220 3 0 0 20 0 1 0 317621651 86962176 20703 33554432000 134512640 134579096 4294468768 4294467600 134517893 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 21231 20703 228 17 0 20537 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 84924

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22585
/proc/meminfo: memFree=29474948/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=106636 CPUtime=282.22 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 27368 0 0 0 28218 4 0 0 20 0 1 0 317621651 109195264 26151 33554432000 134512640 134579096 4294468768 4294467600 134517908 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 26659 26151 228 17 0 25965 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 106636

[startup+342.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 22585
/proc/meminfo: memFree=29470504/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=111456 CPUtime=342.22 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 28562 0 0 0 34217 5 0 0 20 0 1 0 317621651 114130944 27345 33554432000 134512640 134579096 4294468768 4294467600 134517933 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 27864 27345 228 17 0 27170 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 111456

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 22585
/proc/meminfo: memFree=29462124/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=116808 CPUtime=402.21 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 29951 0 0 0 40216 5 0 0 20 0 1 0 317621651 119611392 28700 33554432000 134512640 134579096 4294468768 4294467696 134559292 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 29202 28700 228 17 0 28508 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 116808

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 22589
/proc/meminfo: memFree=29458004/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=120060 CPUtime=462.19 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 31027 0 0 0 46214 5 0 0 20 0 1 0 317621651 122941440 29500 33554432000 134512640 134579096 4294468768 4294467424 134522688 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 30015 29500 228 17 0 29321 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 120060

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22589
/proc/meminfo: memFree=29428368/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=145184 CPUtime=522.18 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 38708 0 0 0 52212 6 0 0 20 0 1 0 317621651 148668416 35793 33554432000 134512640 134579096 4294468768 4294467424 134522724 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 36296 35793 228 17 0 35602 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 145184

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22589
/proc/meminfo: memFree=29405924/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=153964 CPUtime=582.18 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 40971 0 0 0 58211 7 0 0 20 0 1 0 317621651 157659136 37956 33554432000 134512640 134579096 4294468768 4294467600 134517872 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 38491 37956 228 17 0 37797 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 153964

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 22590
/proc/meminfo: memFree=29283100/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=822.13 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70400 0 0 0 82201 12 0 0 20 0 1 0 317621651 274960384 66619 33554432000 134512640 134579096 4294468768 4294467600 134517908 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66619 228 17 0 66435 0
Current children cumulated CPU time (s) 822.13
Current children cumulated vsize (KiB) 268516

[startup+882.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 22590
/proc/meminfo: memFree=29283100/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=882.12 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70400 0 0 0 88200 12 0 0 20 0 1 0 317621651 274960384 66619 33554432000 134512640 134579096 4294468768 4294467600 134517919 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66619 228 17 0 66435 0
Current children cumulated CPU time (s) 882.12
Current children cumulated vsize (KiB) 268516

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22590
/proc/meminfo: memFree=29282836/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=942.1 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 94198 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467600 134517903 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 942.1
Current children cumulated vsize (KiB) 268516

[startup+1002.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 22590
/proc/meminfo: memFree=29266452/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=1002.09 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 100197 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467600 134517903 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 1002.09
Current children cumulated vsize (KiB) 268516

[startup+1062.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 22594
/proc/meminfo: memFree=29266956/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=1062.08 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 106196 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467588 134556361 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 1062.08
Current children cumulated vsize (KiB) 268516

[startup+1122.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 22617
/proc/meminfo: memFree=29260996/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=1122.08 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 112196 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467584 134519085 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 1122.08
Current children cumulated vsize (KiB) 268516

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22617
/proc/meminfo: memFree=29261256/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=1182.07 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 118195 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467600 134517901 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 1182.07
Current children cumulated vsize (KiB) 268516

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22617
/proc/meminfo: memFree=29260884/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=268516 CPUtime=1242.06 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 70405 0 0 0 124194 12 0 0 20 0 1 0 317621651 274960384 66621 33554432000 134512640 134579096 4294468768 4294467632 134520048 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 67129 66621 228 17 0 66435 0
Current children cumulated CPU time (s) 1242.06
Current children cumulated vsize (KiB) 268516

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22617
/proc/meminfo: memFree=29251460/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=278104 CPUtime=1302.05 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 72760 0 0 0 130193 12 0 0 20 0 1 0 317621651 284778496 68976 33554432000 134512640 134579096 4294468768 4294467584 134519095 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 69526 68976 228 17 0 68832 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 278104

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22618
/proc/meminfo: memFree=29251336/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=278104 CPUtime=1362.03 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 72768 0 0 0 136191 12 0 0 20 0 1 0 317621651 284778496 68984 33554432000 134512640 134579096 4294468768 4294464576 134533451 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 69526 68984 228 17 0 68832 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 278104

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22618
/proc/meminfo: memFree=29251460/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=278104 CPUtime=1422.03 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 72768 0 0 0 142191 12 0 0 20 0 1 0 317621651 284778496 68984 33554432000 134512640 134579096 4294468768 4294467600 134517908 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 69526 68984 228 17 0 68832 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 278104

[startup+1482.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 22618
/proc/meminfo: memFree=29251020/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=278104 CPUtime=1482.01 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 72769 0 0 0 148189 12 0 0 20 0 1 0 317621651 284778496 68986 33554432000 134512640 134579096 4294468768 4294467600 134517908 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 69526 68986 228 17 0 68832 0
Current children cumulated CPU time (s) 1482.01
Current children cumulated vsize (KiB) 278104

[startup+1542.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 22618
/proc/meminfo: memFree=29228576/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1542.01 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75959 0 0 0 154188 13 0 0 20 0 1 0 317621651 297492480 72117 33554432000 134512640 134579096 4294468768 4294467600 134517903 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72117 228 17 0 71936 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 290520

[startup+1602.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 22618
/proc/meminfo: memFree=29187660/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1602 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75961 0 0 0 160187 13 0 0 20 0 1 0 317621651 297492480 72119 33554432000 134512640 134579096 4294468768 4294467424 134522688 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72119 228 17 0 71936 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 290520

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 22622
/proc/meminfo: memFree=29154804/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1661.99 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75961 0 0 0 166186 13 0 0 20 0 1 0 317621651 297492480 72119 33554432000 134512640 134579096 4294468768 4294467584 134519120 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72119 228 17 0 71936 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 290520

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22622
/proc/meminfo: memFree=29125100/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1721.98 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75963 0 0 0 172185 13 0 0 20 0 1 0 317621651 297492480 72119 33554432000 134512640 134579096 4294468768 4294467588 134556250 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72119 228 17 0 71936 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 290520

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22622
/proc/meminfo: memFree=29120636/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1781.97 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75963 0 0 0 178184 13 0 0 20 0 1 0 317621651 297492480 72119 33554432000 134512640 134579096 4294468768 4294464848 134533511 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72119 228 17 0 71936 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 290520



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 22622
/proc/meminfo: memFree=29120236/32873648 swapFree=7116/7116
[pid=22534] ppid=22532 vsize=290520 CPUtime=1800.07 cores=0,2,4,6
/proc/22534/stat : 22534 (Pueblo) R 22532 22534 19648 0 -1 4202496 75963 0 0 0 179994 13 0 0 20 0 1 0 317621651 297492480 72119 33554432000 134512640 134579096 4294468768 4294467584 134519077 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22534/statm: 72630 72119 228 17 0 71936 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 290520

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.41
CPU time (s): 1800.08
CPU user time (s): 1799.95
CPU system time (s): 0.132979
CPU usage (%): 99.9819
Max. virtual memory (cumulated for all children) (KiB): 290520

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.95
system time used= 0.132979
maximum resident set size= 288476
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 75963
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 59
involuntary context switches= 1945

runsolver used 3.33949 second user time and 8.60569 second system time

The end

Launcher Data 

Begin job on node123 at 2012-06-01 03:42:42
IDJOB=3720822
IDBENCH=90142
IDSOLVER=2305
FILE ID=node123/3720822-1338514962
RUNJOBID= node123-1338506003-19664
PBS_JOBID= 14635768
Free space on /tmp= 71312 MiB

SOLVER NAME= Pueblo 1.4
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K128.opb
COMMAND LINE= Pueblo BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3720822-1338514962/watcher-3720822-1338514962 -o /tmp/evaluation-result-3720822-1338514962/solver-3720822-1338514962 -C 1800 -W 1900 -M 15500  Pueblo HOME/instance-3720822-1338514962.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 17c4ca9a6493665b57c1ccd2ab23e03d
RANDOM SEED=1106773013

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29538112 kB
Buffers:          409280 kB
Cached:          1952704 kB
SwapCached:         2224 kB
Active:           828680 kB
Inactive:        1650784 kB
Active(anon):     112500 kB
Inactive(anon):     5460 kB
Active(file):     716180 kB
Inactive(file):  1645324 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67100300 kB
Dirty:              3028 kB
Writeback:             0 kB
AnonPages:        120408 kB
Mapped:            11300 kB
Shmem:                 0 kB
Slab:             721100 kB
SReclaimable:     165400 kB
SUnreclaim:       555700 kB
KernelStack:        1456 kB
PageTables:         4200 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     234224 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3720822-1338514962.opb

Free space on /tmp at the end= 71312 MiB
End job on node123 at 2012-06-01 04:12:44