Trace number 3439343

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.24 5000.27

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf
MD5SUMd705043763df769aab1e385bbbc2b11e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1325.32
Satisfiable
(Un)Satisfiability was proved
Number of variables184
Number of clauses896
Sum of the clauses size3042
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 214
Number of clauses of size 3514
Number of clauses of size 4368
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439343-1306929583/watcher-3439343-1306929583 -o /tmp/evaluation-result-3439343-1306929583/solver-3439343-1306929583 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3439343-1306929583.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 8.11 8.09 1/419 7609
/proc/meminfo: memFree=26317848/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=12168 CPUtime=0 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 463 0 0 0 0 0 0 0 21 0 1 0 804556464 12460032 401 33554432000 4194304 4394578 140735783506192 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3042 401 266 49 0 183 0

[startup+0.049625 s]
/proc/loadavg: 8.05 8.11 8.09 1/419 7609
/proc/meminfo: memFree=26317848/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=12300 CPUtime=0.04 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 508 0 0 0 4 0 0 0 21 0 1 0 804556464 12595200 446 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3075 446 267 49 0 216 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 12300

[startup+0.100604 s]
/proc/loadavg: 8.05 8.11 8.09 1/419 7609
/proc/meminfo: memFree=26317848/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=12432 CPUtime=0.09 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 542 0 0 0 9 0 0 0 21 0 1 0 804556464 12730368 480 33554432000 4194304 4394578 140735783506192 18446744073709551615 4316072 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3108 480 267 49 0 249 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12432

[startup+0.300567 s]
/proc/loadavg: 8.05 8.11 8.09 1/419 7609
/proc/meminfo: memFree=26317848/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=12960 CPUtime=0.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 665 0 0 0 29 0 0 0 22 0 1 0 804556464 13271040 603 33554432000 4194304 4394578 140735783506192 18446744073709551615 4287934 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3240 603 267 49 0 381 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12960

[startup+0.700496 s]
/proc/loadavg: 8.05 8.11 8.09 1/419 7609
/proc/meminfo: memFree=26317848/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=13612 CPUtime=0.69 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 843 0 0 0 69 0 0 0 24 0 1 0 804556464 13938688 781 33554432000 4194304 4394578 140735783506192 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3403 781 267 49 0 544 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 13612

[startup+1.50035 s]
/proc/loadavg: 8.05 8.11 8.09 3/425 7618
/proc/meminfo: memFree=26310680/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=14800 CPUtime=1.49 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 1148 0 0 0 149 0 0 0 25 0 1 0 804556464 15155200 1086 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 3700 1086 267 49 0 841 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 14800

[startup+3.10105 s]
/proc/loadavg: 7.56 8.01 8.05 3/425 7618
/proc/meminfo: memFree=26305976/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=17044 CPUtime=3.09 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 1685 0 0 0 309 0 0 0 25 0 1 0 804556464 17453056 1623 33554432000 4194304 4394578 140735783506192 18446744073709551615 4308934 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 4261 1623 267 49 0 1402 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 17044

[startup+6.30047 s]
/proc/loadavg: 7.56 8.01 8.05 3/425 7618
/proc/meminfo: memFree=26298536/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=20820 CPUtime=6.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 2640 0 0 0 629 0 0 0 25 0 1 0 804556464 21319680 2578 33554432000 4194304 4394578 140735783506192 18446744073709551615 4308916 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 5205 2578 267 49 0 2346 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 20820

[startup+12.7003 s]
/proc/loadavg: 6.71 7.81 7.99 3/425 7618
/proc/meminfo: memFree=26284736/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=27084 CPUtime=12.69 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 4208 0 0 0 1269 0 0 0 25 0 1 0 804556464 27734016 4146 33554432000 4194304 4394578 140735783506192 18446744073709551615 4296451 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 6771 4146 267 49 0 3912 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 27084

[startup+25.501 s]
/proc/loadavg: 5.98 7.62 7.92 3/425 7619
/proc/meminfo: memFree=26259108/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=41256 CPUtime=25.49 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 7752 0 0 0 2548 1 0 0 25 0 1 0 804556464 42246144 7690 33554432000 4194304 4394578 140735783506192 18446744073709551615 4316134 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 10314 7690 267 49 0 7455 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 41256

[startup+51.1003 s]
/proc/loadavg: 4.62 7.17 7.77 3/425 7619
/proc/meminfo: memFree=26206264/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=71584 CPUtime=51.08 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 15314 0 0 0 5106 2 0 0 25 0 1 0 804556464 73302016 15252 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298682 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 17896 15252 267 49 0 15037 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 71584

[startup+102.315 s]
/proc/loadavg: 3.09 6.31 7.44 3/425 7630
/proc/meminfo: memFree=26107216/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=122172 CPUtime=102.3 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 27972 0 0 0 10225 5 0 0 25 0 1 0 804556464 125104128 27910 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 30543 27910 267 49 0 27684 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 122172

[startup+162.301 s]
/proc/loadavg: 2.43 5.54 7.10 3/425 7631
/proc/meminfo: memFree=26012092/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=173600 CPUtime=162.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 40823 0 0 0 16220 9 0 0 25 0 1 0 804556464 177766400 40761 33554432000 4194304 4394578 140735783506192 18446744073709551615 4291898 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 43400 40761 267 49 0 40541 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 173600

[startup+222.301 s]
/proc/loadavg: 2.16 4.89 6.78 3/425 7633
/proc/meminfo: memFree=25887692/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=237308 CPUtime=222.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 56771 0 0 0 22216 13 0 0 25 0 1 0 804556464 243003392 56709 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298326 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 59327 56709 267 49 0 56468 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 237308

[startup+282.301 s]
/proc/loadavg: 2.20 4.39 6.49 3/425 7636
/proc/meminfo: memFree=25803724/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=270044 CPUtime=282.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 64951 0 0 0 28214 15 0 0 25 0 1 0 804556464 276525056 64889 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 67511 64889 267 49 0 64652 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 270044

[startup+342.301 s]
/proc/loadavg: 2.14 3.97 6.21 3/425 7639
/proc/meminfo: memFree=25721200/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=334984 CPUtime=342.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 81194 0 0 0 34210 19 0 0 25 0 1 0 804556464 343023616 81132 33554432000 4194304 4394578 140735783506192 18446744073709551615 4291837 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 83746 81132 267 49 0 80887 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 334984

[startup+402.3 s]
/proc/loadavg: 2.05 3.61 5.94 3/425 7641
/proc/meminfo: memFree=25603500/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=393080 CPUtime=402.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 95697 0 0 0 40207 22 0 0 25 0 1 0 804556464 402513920 95635 33554432000 4194304 4394578 140735783506192 18446744073709551615 4284756 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 98270 95635 267 49 0 95411 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 393080

[startup+462.3 s]
/proc/loadavg: 2.02 3.31 5.69 3/425 7642
/proc/meminfo: memFree=25487164/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=459304 CPUtime=462.28 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 112266 0 0 0 46203 25 0 0 25 0 1 0 804556464 470327296 112204 33554432000 4194304 4394578 140735783506192 18446744073709551615 4296188 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 114826 112204 267 49 0 111967 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 459304

[startup+522.3 s]
/proc/loadavg: 2.11 3.10 5.47 3/425 7644
/proc/meminfo: memFree=25382736/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=525660 CPUtime=522.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 128843 0 0 0 52200 29 0 0 25 0 1 0 804556464 538275840 128781 33554432000 4194304 4394578 140735783506192 18446744073709551615 4292192 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 131415 128781 267 49 0 128556 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 525660

[startup+582.3 s]
/proc/loadavg: 2.11 2.92 5.25 3/425 7645
/proc/meminfo: memFree=25333480/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=525660 CPUtime=582.29 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 128850 0 0 0 58200 29 0 0 25 0 1 0 804556464 538275840 128788 33554432000 4194304 4394578 140735783506192 18446744073709551615 4313431 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 131415 128788 267 49 0 128556 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 525660

[startup+642.3 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.06 2.06 2.09 3/425 7750
/proc/meminfo: memFree=20142364/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3215796 CPUtime=4062.28 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 801382 0 0 0 406048 180 0 0 25 0 1 0 804556464 3292975104 801320 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 803949 801320 267 49 0 801090 0
Current children cumulated CPU time (s) 4062.28
Current children cumulated vsize (KiB) 3215796

[startup+4122.3 s]
/proc/loadavg: 2.02 2.04 2.08 3/425 7752
/proc/meminfo: memFree=20020576/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3280240 CPUtime=4122.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 817489 0 0 0 412043 184 0 0 25 0 1 0 804556464 3358965760 817427 33554432000 4194304 4394578 140735783506192 18446744073709551615 246516495045 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 820060 817427 267 49 0 817201 0
Current children cumulated CPU time (s) 4122.27
Current children cumulated vsize (KiB) 3280240

[startup+4182.3 s]
/proc/loadavg: 2.05 2.05 2.08 3/425 7753
/proc/meminfo: memFree=19899640/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3331016 CPUtime=4182.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 830178 0 0 0 418040 187 0 0 25 0 1 0 804556464 3410960384 830116 33554432000 4194304 4394578 140735783506192 18446744073709551615 4299119 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 832754 830116 267 49 0 829895 0
Current children cumulated CPU time (s) 4182.27
Current children cumulated vsize (KiB) 3331016

[startup+4242.3 s]
/proc/loadavg: 2.02 2.04 2.07 4/425 7755
/proc/meminfo: memFree=19789892/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3392808 CPUtime=4242.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 845652 0 0 0 424037 190 0 0 25 0 1 0 804556464 3474235392 845590 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 848202 845590 267 49 0 845343 0
Current children cumulated CPU time (s) 4242.27
Current children cumulated vsize (KiB) 3392808

[startup+4302.3 s]
/proc/loadavg: 2.00 2.03 2.07 3/425 7757
/proc/meminfo: memFree=19694648/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3423476 CPUtime=4302.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 853319 0 0 0 430035 192 0 0 25 0 1 0 804556464 3505639424 853257 33554432000 4194304 4394578 140735783506192 18446744073709551615 4287674 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 855869 853257 267 49 0 853010 0
Current children cumulated CPU time (s) 4302.27
Current children cumulated vsize (KiB) 3423476

[startup+4362.3 s]
/proc/loadavg: 2.04 2.03 2.07 3/425 7758
/proc/meminfo: memFree=19586736/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3487728 CPUtime=4362.26 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 869364 0 0 0 436030 196 0 0 25 0 1 0 804556464 3571433472 869302 33554432000 4194304 4394578 140735783506192 18446744073709551615 4299025 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 871932 869302 267 49 0 869073 0
Current children cumulated CPU time (s) 4362.26
Current children cumulated vsize (KiB) 3487728

[startup+4422.3 s]
/proc/loadavg: 2.01 2.03 2.06 3/425 7760
/proc/meminfo: memFree=19480076/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3548124 CPUtime=4422.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 884463 0 0 0 442027 200 0 0 25 0 1 0 804556464 3633278976 884401 33554432000 4194304 4394578 140735783506192 18446744073709551615 4296866 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 887031 884401 267 49 0 884172 0
Current children cumulated CPU time (s) 4422.27
Current children cumulated vsize (KiB) 3548124

[startup+4482.3 s]
/proc/loadavg: 2.20 2.06 2.07 3/425 7761
/proc/meminfo: memFree=19350964/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3614388 CPUtime=4482.26 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 901041 0 0 0 448023 203 0 0 25 0 1 0 804556464 3701133312 900979 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298776 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 903597 900979 267 49 0 900738 0
Current children cumulated CPU time (s) 4482.26
Current children cumulated vsize (KiB) 3614388

[startup+4542.3 s]
/proc/loadavg: 2.19 2.08 2.08 3/425 7763
/proc/meminfo: memFree=19239960/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3675596 CPUtime=4542.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 916345 0 0 0 454021 206 0 0 25 0 1 0 804556464 3763810304 916283 33554432000 4194304 4394578 140735783506192 18446744073709551615 4312416 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 918899 916283 267 49 0 916040 0
Current children cumulated CPU time (s) 4542.27
Current children cumulated vsize (KiB) 3675596

[startup+4602.3 s]
/proc/loadavg: 2.07 2.06 2.07 3/425 7765
/proc/meminfo: memFree=19164664/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3680004 CPUtime=4602.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 917448 0 0 0 460021 206 0 0 25 0 1 0 804556464 3768324096 917386 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298676 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 920001 917386 267 49 0 917142 0
Current children cumulated CPU time (s) 4602.27
Current children cumulated vsize (KiB) 3680004

[startup+4662.3 s]
/proc/loadavg: 2.02 2.05 2.07 3/425 7766
/proc/meminfo: memFree=19053156/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3730488 CPUtime=4662.26 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 930048 0 0 0 466018 208 0 0 25 0 1 0 804556464 3820019712 929986 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298721 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 932622 929986 267 49 0 929763 0
Current children cumulated CPU time (s) 4662.26
Current children cumulated vsize (KiB) 3730488

[startup+4722.32 s]
/proc/loadavg: 2.06 2.05 2.07 3/425 7768
/proc/meminfo: memFree=18958892/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3796824 CPUtime=4722.28 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 946630 0 0 0 472016 212 0 0 25 0 1 0 804556464 3887947776 946568 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 949206 946568 267 49 0 946347 0
Current children cumulated CPU time (s) 4722.28
Current children cumulated vsize (KiB) 3796824

[startup+4782.3 s]
/proc/loadavg: 2.02 2.04 2.06 3/425 7769
/proc/meminfo: memFree=18909256/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3847128 CPUtime=4782.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 959208 0 0 0 478012 215 0 0 25 0 1 0 804556464 3939459072 959146 33554432000 4194304 4394578 140735783506192 18446744073709551615 4296751 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 961782 959146 267 49 0 958923 0
Current children cumulated CPU time (s) 4782.27
Current children cumulated vsize (KiB) 3847128

[startup+4842.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/425 7771
/proc/meminfo: memFree=18842268/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3912764 CPUtime=4842.27 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 975613 0 0 0 484009 218 0 0 25 0 1 0 804556464 4006670336 975551 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298358 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 978191 975551 267 49 0 975332 0
Current children cumulated CPU time (s) 4842.27
Current children cumulated vsize (KiB) 3912764

[startup+4902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/425 7773
/proc/meminfo: memFree=18769712/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=3945996 CPUtime=4902.26 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 983935 0 0 0 490006 220 0 0 25 0 1 0 804556464 4040699904 983873 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 986499 983873 267 49 0 983640 0
Current children cumulated CPU time (s) 4902.26
Current children cumulated vsize (KiB) 3945996

[startup+4962.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/425 7774
/proc/meminfo: memFree=18638996/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=4013000 CPUtime=4962.26 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 1000686 0 0 0 496002 224 0 0 25 0 1 0 804556464 4109312000 1000624 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298298 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 1003250 1000624 267 49 0 1000391 0
Current children cumulated CPU time (s) 4962.26
Current children cumulated vsize (KiB) 4013000



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000.1 s]
/proc/loadavg: 2.00 2.02 2.04 2/424 7776
/proc/meminfo: memFree=22265740/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=4050840 CPUtime=5000.07 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4202496 1010134 0 0 0 499781 226 0 0 25 0 1 0 804556464 4148060160 1010072 33554432000 4194304 4394578 140735783506192 18446744073709551615 4298679 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7609/statm: 1012710 1010072 267 49 0 1009851 0
Current children cumulated CPU time (s) 5000.07
Current children cumulated vsize (KiB) 4050840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.22 s]
/proc/loadavg: 2.00 2.02 2.04 2/424 7776
/proc/meminfo: memFree=22265740/32951124 swapFree=44043512/67111528
[pid=7609] ppid=7607 vsize=0 CPUtime=5000.18 cores=1,3,5,7
/proc/7609/stat : 7609 (SApperloT2010) R 7607 7609 7579 0 -1 4203524 1010134 0 0 0 499782 236 0 0 25 0 1 0 804556464 0 0 33554432000 0 0 0 0 0 0 0 4096 6 18446744073709551615 0 0 17 1 0 0 0
/proc/7609/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.18
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.27
CPU time (s): 5000.24
CPU user time (s): 4997.82
CPU system time (s): 2.41963
CPU usage (%): 99.9995
Max. virtual memory (cumulated for all children) (KiB): 4050840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4997.82
system time used= 2.41963
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1010134
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 6000

runsolver used 18.8421 second user time and 44.8152 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-01 13:59:43
IDJOB=3439343
IDBENCH=84018
IDSOLVER=1933
FILE ID=node134/3439343-1306929583
RUNJOBID= node134-1306929583-7598
PBS_JOBID= 13488583
Free space on /tmp= 73716 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n28-02-S818962541.shuffled-as.sat03-1628.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439343-1306929583/watcher-3439343-1306929583 -o /tmp/evaluation-result-3439343-1306929583/solver-3439343-1306929583 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3439343-1306929583.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d705043763df769aab1e385bbbc2b11e
RANDOM SEED=2076326964

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26318120 kB
Buffers:        165864 kB
Cached:         353772 kB
SwapCached:       9540 kB
Active:        5947296 kB
Inactive:       394112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26318120 kB
SwapTotal:    67111528 kB
SwapFree:     44043512 kB
Dirty:               4 kB
Writeback:           0 kB
AnonPages:     5820564 kB
Mapped:          20240 kB
Slab:           132040 kB
PageTables:      89324 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 110746716 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73716 MiB
End job on node134 at 2011-06-01 15:23:05