Trace number 3439788

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.09 4999.95

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p15-s54275047.cnf
MD5SUM67948a6aed9ea09317abe3c8a9a27a03
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark30.0564
Satisfiable
(Un)Satisfiability was proved
Number of variables1590
Number of clauses272291
Sum of the clauses size546092
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2272251
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439788-1306945296/watcher-3439788-1306945296 -o /tmp/evaluation-result-3439788-1306945296/solver-3439788-1306945296 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3439788-1306945296.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.04 1.01 1.01 2/526 12215
/proc/meminfo: memFree=23304472/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=17156 CPUtime=0 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 1175 0 0 0 0 0 0 0 18 0 1 0 786945456 17567744 1115 33554432000 4194304 4394578 140736866413312 18446744073709551615 233510297344 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 4289 1115 247 49 0 1430 0

[startup+0.0304179 s]
/proc/loadavg: 1.04 1.01 1.01 2/526 12215
/proc/meminfo: memFree=23304472/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=20060 CPUtime=0.02 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 1912 0 0 0 2 0 0 0 18 0 1 0 786945456 20541440 1852 33554432000 4194304 4394578 140736866413312 18446744073709551615 233509958341 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 5015 1853 247 49 0 2156 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 20060

[startup+0.100388 s]
/proc/loadavg: 1.04 1.01 1.01 2/526 12215
/proc/meminfo: memFree=23304472/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=29960 CPUtime=0.09 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 4383 0 0 0 9 0 0 0 18 0 1 0 786945456 30679040 4323 33554432000 4194304 4394578 140736866413312 18446744073709551615 233509958341 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 7490 4325 247 49 0 4631 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29960

[startup+0.30035 s]
/proc/loadavg: 1.04 1.01 1.01 2/526 12215
/proc/meminfo: memFree=23304472/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=37552 CPUtime=0.29 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 6273 0 0 0 27 2 0 0 18 0 1 0 786945456 38453248 6212 33554432000 4194304 4394578 140736866413312 18446744073709551615 233510322071 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 9388 6212 256 49 0 6529 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 37552

[startup+0.700287 s]
/proc/loadavg: 1.04 1.01 1.01 2/526 12215
/proc/meminfo: memFree=23304472/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=46856 CPUtime=0.69 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 9695 0 0 0 64 5 0 0 18 0 1 0 786945456 47980544 8570 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 11714 8570 267 49 0 8855 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 46856

[startup+1.50013 s]
/proc/loadavg: 1.04 1.01 1.01 3/527 12216
/proc/meminfo: memFree=23252640/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=57220 CPUtime=1.49 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 12234 0 0 0 143 6 0 0 20 0 1 0 786945456 58593280 11109 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 14305 11109 267 49 0 11446 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 57220

[startup+3.10085 s]
/proc/loadavg: 1.04 1.01 1.01 3/527 12216
/proc/meminfo: memFree=23234412/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=69456 CPUtime=3.09 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 15198 0 0 0 303 6 0 0 25 0 1 0 786945456 71122944 14073 33554432000 4194304 4394578 140736866413312 18446744073709551615 233509958341 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 17364 14073 267 49 0 14505 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 69456

[startup+6.30027 s]
/proc/loadavg: 1.12 1.03 1.01 3/527 12217
/proc/meminfo: memFree=23210156/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=87456 CPUtime=6.29 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 19436 0 0 0 622 7 0 0 25 0 1 0 786945456 89554944 18311 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298350 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 21864 18311 267 49 0 19005 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 87456

[startup+12.7011 s]
/proc/loadavg: 1.19 1.05 1.02 3/527 12217
/proc/meminfo: memFree=23171588/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=114204 CPUtime=12.69 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 25641 0 0 0 1261 8 0 0 25 0 1 0 786945456 116944896 24516 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 28551 24516 267 49 0 25692 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 114204

[startup+25.5008 s]
/proc/loadavg: 1.37 1.09 1.03 3/527 12217
/proc/meminfo: memFree=23122860/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=158584 CPUtime=25.49 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 35625 0 0 0 2539 10 0 0 25 0 1 0 786945456 162390016 34500 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 39646 34500 267 49 0 36787 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 158584

[startup+51.1002 s]
/proc/loadavg: 1.65 1.18 1.06 3/527 12218
/proc/meminfo: memFree=23088312/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=186792 CPUtime=51.09 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 41810 0 0 0 5097 12 0 0 25 0 1 0 786945456 191275008 40685 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 46698 40685 267 49 0 43839 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 186792

[startup+102.32 s]
/proc/loadavg: 1.84 1.30 1.11 3/527 12219
/proc/meminfo: memFree=23028996/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=233232 CPUtime=102.31 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 51885 0 0 0 10217 14 0 0 25 0 1 0 786945456 238829568 50760 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298816 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 58308 50760 267 49 0 55449 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 233232

[startup+162.3 s]
/proc/loadavg: 1.94 1.43 1.16 3/527 12221
/proc/meminfo: memFree=23000556/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=254772 CPUtime=162.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 56299 0 0 0 16214 16 0 0 25 0 1 0 786945456 260886528 55174 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 63693 55174 267 49 0 60834 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 254772

[startup+222.3 s]
/proc/loadavg: 1.98 1.53 1.21 3/527 12225
/proc/meminfo: memFree=22983004/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=268728 CPUtime=222.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 59333 0 0 0 22214 16 0 0 25 0 1 0 786945456 275177472 58208 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298350 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 67182 58208 267 49 0 64323 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 268728

[startup+282.301 s]
/proc/loadavg: 1.99 1.61 1.26 3/527 12227
/proc/meminfo: memFree=22942932/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=311248 CPUtime=282.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 68356 0 0 0 28213 17 0 0 25 0 1 0 786945456 318717952 67231 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 77812 67231 267 49 0 74953 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 311248

[startup+342.301 s]
/proc/loadavg: 1.99 1.68 1.30 3/527 12229
/proc/meminfo: memFree=22923792/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=323924 CPUtime=342.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 70958 0 0 0 34212 18 0 0 25 0 1 0 786945456 331698176 69833 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 80981 69833 267 49 0 78122 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 323924

[startup+402.3 s]
/proc/loadavg: 2.08 1.77 1.35 3/527 12230
/proc/meminfo: memFree=22909740/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=335892 CPUtime=402.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 73380 0 0 0 40211 19 0 0 25 0 1 0 786945456 343953408 72255 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 83973 72255 267 49 0 81114 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 335892

[startup+462.3 s]
/proc/loadavg: 2.11 1.83 1.40 3/527 12232
/proc/meminfo: memFree=22891972/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=348372 CPUtime=462.3 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 75884 0 0 0 46211 19 0 0 25 0 1 0 786945456 356732928 74759 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 87093 74759 267 49 0 84234 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 348372

[startup+522.301 s]
/proc/loadavg: 2.04 1.86 1.43 3/527 12233
/proc/meminfo: memFree=22884972/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=354900 CPUtime=522.31 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 77308 0 0 0 52211 20 0 0 25 0 1 0 786945456 363417600 76183 33554432000 4194304 4394578 140736866413312 18446744073709551615 4346189 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 88725 76183 267 49 0 85866 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 354900

[startup+582.301 s]
/proc/loadavg: 2.10 1.91 1.48 3/527 12235
/proc/meminfo: memFree=22873524/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=360660 CPUtime=582.31 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 78567 0 0 0 58211 20 0 0 25 0 1 0 786945456 369315840 77442 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 90165 77442 267 49 0 87306 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 360660

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.02 2.04 2.00 3/527 12340
/proc/meminfo: memFree=22486788/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=712888 CPUtime=4062.43 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 151484 0 0 0 406208 35 0 0 25 0 1 0 786945456 729997312 150359 33554432000 4194304 4394578 140736866413312 18446744073709551615 4313558 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 178222 150359 267 49 0 175363 0
Current children cumulated CPU time (s) 4062.43
Current children cumulated vsize (KiB) 712888

[startup+4122.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/527 12341
/proc/meminfo: memFree=22485740/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=713912 CPUtime=4122.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 151706 0 0 0 412206 35 0 0 25 0 1 0 786945456 731045888 150581 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 178478 150581 267 49 0 175619 0
Current children cumulated CPU time (s) 4122.41
Current children cumulated vsize (KiB) 713912

[startup+4182.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/527 12343
/proc/meminfo: memFree=22484696/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=714936 CPUtime=4182.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 152065 0 0 0 418206 35 0 0 25 0 1 0 786945456 732094464 150940 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 178734 150940 267 49 0 175875 0
Current children cumulated CPU time (s) 4182.41
Current children cumulated vsize (KiB) 714936

[startup+4242.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/527 12345
/proc/meminfo: memFree=22483772/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=715960 CPUtime=4242.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 152269 0 0 0 424206 35 0 0 25 0 1 0 786945456 733143040 151144 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298818 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 178990 151144 267 49 0 176131 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 715960

[startup+4302.3 s]
/proc/loadavg: 2.12 2.04 2.01 3/527 12346
/proc/meminfo: memFree=22482476/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=716472 CPUtime=4302.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 152448 0 0 0 430206 35 0 0 25 0 1 0 786945456 733667328 151323 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 179118 151323 267 49 0 176259 0
Current children cumulated CPU time (s) 4302.41
Current children cumulated vsize (KiB) 716472

[startup+4362.3 s]
/proc/loadavg: 2.10 2.05 2.01 3/527 12348
/proc/meminfo: memFree=22472748/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=725176 CPUtime=4362.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 154360 0 0 0 436205 36 0 0 25 0 1 0 786945456 742580224 153235 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 181294 153235 267 49 0 178435 0
Current children cumulated CPU time (s) 4362.41
Current children cumulated vsize (KiB) 725176

[startup+4422.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/527 12349
/proc/meminfo: memFree=22465736/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=730296 CPUtime=4422.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155354 0 0 0 442205 36 0 0 25 0 1 0 786945456 747823104 154229 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182574 154229 267 49 0 179715 0
Current children cumulated CPU time (s) 4422.41
Current children cumulated vsize (KiB) 730296

[startup+4482.3 s]
/proc/loadavg: 2.07 2.04 2.00 3/527 12351
/proc/meminfo: memFree=22464212/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=731320 CPUtime=4482.41 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155542 0 0 0 448205 36 0 0 25 0 1 0 786945456 748871680 154417 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182830 154417 267 49 0 179971 0
Current children cumulated CPU time (s) 4482.41
Current children cumulated vsize (KiB) 731320

[startup+4542.3 s]
/proc/loadavg: 2.08 2.05 2.00 3/527 12353
/proc/meminfo: memFree=22461804/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=731320 CPUtime=4542.42 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155578 0 0 0 454206 36 0 0 25 0 1 0 786945456 748871680 154453 33554432000 4194304 4394578 140736866413312 18446744073709551615 4338256 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182830 154453 267 49 0 179971 0
Current children cumulated CPU time (s) 4542.42
Current children cumulated vsize (KiB) 731320

[startup+4602.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/527 12354
/proc/meminfo: memFree=22461120/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=731320 CPUtime=4602.43 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155597 0 0 0 460207 36 0 0 25 0 1 0 786945456 748871680 154472 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298807 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182830 154472 267 49 0 179971 0
Current children cumulated CPU time (s) 4602.43
Current children cumulated vsize (KiB) 731320

[startup+4662.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/527 12356
/proc/meminfo: memFree=22457844/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=731320 CPUtime=4662.42 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155604 0 0 0 466206 36 0 0 25 0 1 0 786945456 748871680 154479 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182830 154479 267 49 0 179971 0
Current children cumulated CPU time (s) 4662.42
Current children cumulated vsize (KiB) 731320

[startup+4722.32 s]
/proc/loadavg: 2.00 2.02 2.00 3/527 12357
/proc/meminfo: memFree=22457276/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=731320 CPUtime=4722.44 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 155653 0 0 0 472208 36 0 0 25 0 1 0 786945456 748871680 154528 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298919 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 182830 154528 267 49 0 179971 0
Current children cumulated CPU time (s) 4722.44
Current children cumulated vsize (KiB) 731320

[startup+4782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/527 12359
/proc/meminfo: memFree=22455368/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=733368 CPUtime=4782.42 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 156003 0 0 0 478206 36 0 0 25 0 1 0 786945456 750968832 154878 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298795 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 183342 154878 267 49 0 180483 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 733368

[startup+4842.3 s]
/proc/loadavg: 2.16 2.04 2.01 3/527 12361
/proc/meminfo: memFree=22453576/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=733368 CPUtime=4842.42 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 156004 0 0 0 484206 36 0 0 25 0 1 0 786945456 750968832 154879 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 183342 154879 267 49 0 180483 0
Current children cumulated CPU time (s) 4842.42
Current children cumulated vsize (KiB) 733368

[startup+4902.3 s]
/proc/loadavg: 2.14 2.05 2.01 3/527 12362
/proc/meminfo: memFree=22453896/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=734392 CPUtime=4902.42 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 156170 0 0 0 490206 36 0 0 25 0 1 0 786945456 752017408 155045 33554432000 4194304 4394578 140736866413312 18446744073709551615 4335367 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 183598 155045 267 49 0 180739 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 734392

[startup+4962.3 s]
/proc/loadavg: 2.05 2.04 2.00 3/527 12364
/proc/meminfo: memFree=22450124/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=735416 CPUtime=4962.43 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 156458 0 0 0 496206 37 0 0 25 0 1 0 786945456 753065984 155333 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 183854 155333 267 49 0 180995 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 735416



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.02 2.03 2.00 2/526 12366
/proc/meminfo: memFree=22678860/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=738744 CPUtime=5000.04 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 157015 0 0 0 499967 37 0 0 25 0 1 0 786945456 756473856 155890 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298993 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 184686 155890 267 49 0 181827 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 738744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.02 2.03 2.00 2/526 12366
/proc/meminfo: memFree=22678860/32951124 swapFree=64303760/67111528
[pid=12215] ppid=12213 vsize=738744 CPUtime=5000.04 cores=1,3,5,7
/proc/12215/stat : 12215 (SApperloT2010) R 12213 12215 11369 0 -1 4202496 157015 0 0 0 499967 37 0 0 25 0 1 0 786945456 756473856 155890 33554432000 4194304 4394578 140736866413312 18446744073709551615 4298993 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/12215/statm: 184686 155890 267 49 0 181827 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 738744

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.95
CPU time (s): 5000.09
CPU user time (s): 4999.69
CPU system time (s): 0.402938
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 738744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.68
system time used= 0.402938
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 157015
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 5922

runsolver used 25.6831 second user time and 60.6908 second system time

The end

Launcher Data 

Begin job on node145 at 2011-06-01 18:21:36
IDJOB=3439788
IDBENCH=88225
IDSOLVER=1933
FILE ID=node145/3439788-1306945296
RUNJOBID= node145-1306945296-12196
PBS_JOBID= 13488576
Free space on /tmp= 73948 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q585-n40-p15-s54275047.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439788-1306945296/watcher-3439788-1306945296 -o /tmp/evaluation-result-3439788-1306945296/solver-3439788-1306945296 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3439788-1306945296.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 67948a6aed9ea09317abe3c8a9a27a03
RANDOM SEED=404737668

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23304628 kB
Buffers:        147688 kB
Cached:         239488 kB
SwapCached:        944 kB
Active:        9169860 kB
Inactive:       208692 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23304628 kB
SwapTotal:    67111528 kB
SwapFree:     64303760 kB
Dirty:            4320 kB
Writeback:           0 kB
AnonPages:     8990752 kB
Mapped:          34396 kB
Slab:           132704 kB
PageTables:      65592 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 153228904 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73952 MiB
End job on node145 at 2011-06-01 19:44:58