Trace number 3439868

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: LR_GL_SHR 2011-03-02? (TO) 5000.05 4999.93

General information on the benchmark

NameAPPLICATIONS/crypto/
md5gen/gus-md5-11.cnf
MD5SUM49867705b76fc90285dd6fc48de2613c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1376.76
Satisfiable
(Un)Satisfiability was proved
Number of variables69561
Number of clauses226787
Sum of the clauses size587727
Maximum clause length3
Minimum clause length1
Number of clauses of size 1129
Number of clauses of size 292376
Number of clauses of size 3134282
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439868-1306899543/watcher-3439868-1306899543 -o /tmp/evaluation-result-3439868-1306899543/solver-3439868-1306899543 -C 5000 -W 5100 -M 15500 HOME/lr_gl_shr HOME/instance-3439868-1306899543.cnf -verb=0 -model 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.21 1.59 2/464 17136
/proc/meminfo: memFree=3933252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=28036 CPUtime=0 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 2157 0 0 0 0 0 0 0 21 0 1 0 801554122 28708864 2047 33554432000 4194304 4300056 140735584695264 18446744073709551615 4286249 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 7009 2047 222 26 0 3641 0

[startup+0.094468 s]
/proc/loadavg: 1.00 1.21 1.59 2/464 17136
/proc/meminfo: memFree=3933252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=37192 CPUtime=0.08 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 5537 0 0 0 8 0 0 0 21 0 1 0 801554122 38084608 4961 33554432000 4194304 4300056 140735584695264 18446744073709551615 248089359045 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 9298 4963 222 26 0 5930 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 37192

[startup+0.100465 s]
/proc/loadavg: 1.00 1.21 1.59 2/464 17136
/proc/meminfo: memFree=3933252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=37720 CPUtime=0.09 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 5725 0 0 0 9 0 0 0 21 0 1 0 801554122 38625280 5140 33554432000 4194304 4300056 140735584695264 18446744073709551615 4286350 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 9430 5141 222 26 0 6062 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37720

[startup+0.300436 s]
/proc/loadavg: 1.00 1.21 1.59 2/464 17136
/proc/meminfo: memFree=3933252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=49840 CPUtime=0.29 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 9409 0 0 0 28 1 0 0 22 0 1 0 801554122 51036160 8437 33554432000 4194304 4300056 140735584695264 18446744073709551615 4286249 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 12460 8437 228 26 0 9092 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 49840

[startup+0.700363 s]
/proc/loadavg: 1.00 1.21 1.59 2/464 17136
/proc/meminfo: memFree=3933252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=45172 CPUtime=0.69 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 12244 0 0 0 68 1 0 0 24 0 1 0 801554122 46256128 7209 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256570 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 11293 7209 244 26 0 7925 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 45172

[startup+1.50022 s]
/proc/loadavg: 1.00 1.21 1.59 3/465 17137
/proc/meminfo: memFree=3903368/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=45172 CPUtime=1.49 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 12304 0 0 0 148 1 0 0 25 0 1 0 801554122 46256128 7269 33554432000 4194304 4300056 140735584695264 18446744073709551615 4263033 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 11293 7269 244 26 0 7925 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 45172

[startup+3.10093 s]
/proc/loadavg: 1.08 1.22 1.59 3/465 17137
/proc/meminfo: memFree=3902252/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=45172 CPUtime=3.09 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 12383 0 0 0 308 1 0 0 25 0 1 0 801554122 46256128 7348 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 11293 7348 244 26 0 7925 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 45172

[startup+6.30037 s]
/proc/loadavg: 1.08 1.22 1.59 3/465 17137
/proc/meminfo: memFree=3901572/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=45172 CPUtime=6.29 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 12591 0 0 0 628 1 0 0 25 0 1 0 801554122 46256128 7555 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256367 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 11293 7555 246 26 0 7925 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 45172

[startup+12.7002 s]
/proc/loadavg: 1.22 1.25 1.60 3/465 17138
/proc/meminfo: memFree=3897900/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=52244 CPUtime=12.69 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 13065 0 0 0 1268 1 0 0 25 0 1 0 801554122 53497856 8023 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256511 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 13061 8023 246 26 0 9693 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 52244

[startup+25.501 s]
/proc/loadavg: 1.34 1.27 1.60 3/465 17138
/proc/meminfo: memFree=3890220/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=52244 CPUtime=25.49 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 13955 0 0 0 2548 1 0 0 25 0 1 0 801554122 53497856 8907 33554432000 4194304 4300056 140735584695264 18446744073709551615 4263129 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 13061 8907 246 26 0 9693 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 52244

[startup+51.1005 s]
/proc/loadavg: 1.56 1.33 1.61 3/465 17139
/proc/meminfo: memFree=3864136/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=70920 CPUtime=51.09 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 18689 0 0 0 5107 2 0 0 25 0 1 0 801554122 72622080 13631 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 17730 13631 246 26 0 14362 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 70920

[startup+102.318 s]
/proc/loadavg: 1.82 1.44 1.63 3/465 17195
/proc/meminfo: memFree=3841964/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=82596 CPUtime=102.31 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 22047 0 0 0 10228 3 0 0 25 0 1 0 801554122 84578304 16967 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256515 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 20649 16967 246 26 0 17281 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 82596

[startup+162.301 s]
/proc/loadavg: 1.93 1.53 1.65 3/465 17197
/proc/meminfo: memFree=3811348/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=101564 CPUtime=162.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 26107 0 0 0 16226 4 0 0 25 0 1 0 801554122 104001536 21010 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256057 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 25391 21010 246 26 0 22023 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 101564

[startup+222.3 s]
/proc/loadavg: 1.97 1.62 1.67 3/465 17198
/proc/meminfo: memFree=3791940/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=132384 CPUtime=222.29 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 30504 0 0 0 22224 5 0 0 25 0 1 0 801554122 135561216 25376 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 33096 25376 246 26 0 29728 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 132384

[startup+282.301 s]
/proc/loadavg: 1.99 1.68 1.69 3/465 17200
/proc/meminfo: memFree=3776748/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=132384 CPUtime=282.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 34050 0 0 0 28223 7 0 0 25 0 1 0 801554122 135561216 28896 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256480 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 33096 28896 246 26 0 29728 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 132384

[startup+342.301 s]
/proc/loadavg: 2.13 1.80 1.73 3/465 17201
/proc/meminfo: memFree=3765528/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=182472 CPUtime=342.29 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 36579 0 0 0 34222 7 0 0 25 0 1 0 801554122 186851328 31409 33554432000 4194304 4300056 140735584695264 18446744073709551615 4263191 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 45618 31409 246 26 0 42250 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 182472

[startup+402.3 s]
/proc/loadavg: 2.09 1.84 1.74 3/465 17203
/proc/meminfo: memFree=3748372/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=183728 CPUtime=402.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 40761 0 0 0 40221 9 0 0 25 0 1 0 801554122 188137472 35568 33554432000 4194304 4300056 140735584695264 18446744073709551615 4252370 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 45932 35568 246 26 0 42564 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 183728

[startup+462.301 s]
/proc/loadavg: 2.03 1.87 1.76 3/465 17205
/proc/meminfo: memFree=3733816/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=184992 CPUtime=462.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 44436 0 0 0 46220 10 0 0 25 0 1 0 801554122 189431808 39214 33554432000 4194304 4300056 140735584695264 18446744073709551615 4262719 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 46248 39214 246 26 0 42880 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 184992

[startup+522.3 s]
/proc/loadavg: 2.01 1.89 1.77 3/465 17206
/proc/meminfo: memFree=3716776/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=268228 CPUtime=522.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 48487 0 0 0 52218 12 0 0 25 0 1 0 801554122 274665472 43236 33554432000 4194304 4300056 140735584695264 18446744073709551615 4252414 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 67057 43236 246 26 0 63689 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 268228

[startup+582.301 s]
/proc/loadavg: 2.00 1.91 1.78 3/465 17208
/proc/meminfo: memFree=3683368/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=269936 CPUtime=582.3 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 52598 0 0 0 58217 13 0 0 25 0 1 0 801554122 276414464 47321 33554432000 4194304 4300056 140735584695264 18446744073709551615 4273366 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 67484 47321 246 26 0 64116 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 269936

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.01 2.02 2.00 3/465 17394
/proc/meminfo: memFree=3458128/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=436436 CPUtime=4062.41 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 269194 0 0 0 406154 87 0 0 25 0 1 0 801554122 446910464 76224 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256322 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 109109 76224 248 26 0 105741 0
Current children cumulated CPU time (s) 4062.41
Current children cumulated vsize (KiB) 436436

[startup+4122.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/465 17395
/proc/meminfo: memFree=3415424/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=436436 CPUtime=4122.39 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 271488 0 0 0 412151 88 0 0 25 0 1 0 801554122 446910464 78504 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256291 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 109109 78504 248 26 0 105741 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 436436

[startup+4182.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/465 17397
/proc/meminfo: memFree=3650228/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=97976 CPUtime=4182.39 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 274034 0 0 0 418149 90 0 0 25 0 1 0 801554122 100327424 20198 33554432000 4194304 4300056 140735584695264 18446744073709551615 4262966 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 24494 20198 248 26 0 21126 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 97976

[startup+4242.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/465 17398
/proc/meminfo: memFree=3654776/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=128328 CPUtime=4242.39 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 281282 0 0 0 424148 91 0 0 25 0 1 0 801554122 131407872 27415 33554432000 4194304 4300056 140735584695264 18446744073709551615 4262793 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 32082 27415 248 26 0 28714 0
Current children cumulated CPU time (s) 4242.39
Current children cumulated vsize (KiB) 128328

[startup+4302.3 s]
/proc/loadavg: 2.12 2.04 2.01 3/465 17400
/proc/meminfo: memFree=3592964/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=147296 CPUtime=4302.39 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 285393 0 0 0 430147 92 0 0 25 0 1 0 801554122 150831104 31492 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256255 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 36824 31492 248 26 0 33456 0
Current children cumulated CPU time (s) 4302.39
Current children cumulated vsize (KiB) 147296

[startup+4362.3 s]
/proc/loadavg: 2.08 2.05 2.01 3/465 17402
/proc/meminfo: memFree=3621924/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=178116 CPUtime=4362.4 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 289397 0 0 0 436147 93 0 0 25 0 1 0 801554122 182390784 35470 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256057 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 44529 35470 248 26 0 41161 0
Current children cumulated CPU time (s) 4362.4
Current children cumulated vsize (KiB) 178116

[startup+4422.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/465 17403
/proc/meminfo: memFree=3605384/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=178116 CPUtime=4422.4 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 293583 0 0 0 442146 94 0 0 25 0 1 0 801554122 182390784 39633 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 44529 39633 248 26 0 41161 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 178116

[startup+4482.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/465 17405
/proc/meminfo: memFree=3558588/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=228204 CPUtime=4482.4 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 297149 0 0 0 448145 95 0 0 25 0 1 0 801554122 233680896 43175 33554432000 4194304 4300056 140735584695264 18446744073709551615 4255938 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 57051 43175 248 26 0 53683 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 228204

[startup+4542.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/465 17406
/proc/meminfo: memFree=3529276/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=228204 CPUtime=4542.4 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 301282 0 0 0 454143 97 0 0 25 0 1 0 801554122 233680896 47279 33554432000 4194304 4300056 140735584695264 18446744073709551615 4262499 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 57051 47279 248 26 0 53683 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 228204

[startup+4602.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/465 17408
/proc/meminfo: memFree=3559216/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=228204 CPUtime=4602.42 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 305173 0 0 0 460144 98 0 0 25 0 1 0 801554122 233680896 51141 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256504 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 57051 51141 248 26 0 53683 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 228204

[startup+4662.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/465 17410
/proc/meminfo: memFree=3543916/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4662.41 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 308708 0 0 0 466142 99 0 0 25 0 1 0 801554122 317022208 54645 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 54645 248 26 0 74030 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 309592

[startup+4722.32 s]
/proc/loadavg: 2.00 2.01 2.00 3/465 17411
/proc/meminfo: memFree=3533312/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4722.43 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 311263 0 0 0 472143 100 0 0 25 0 1 0 801554122 317022208 57180 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256570 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 57180 248 26 0 74030 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 309592

[startup+4782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/465 17413
/proc/meminfo: memFree=3524452/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4782.4 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 313336 0 0 0 478140 100 0 0 25 0 1 0 801554122 317022208 59243 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 59243 248 26 0 74030 0
Current children cumulated CPU time (s) 4782.4
Current children cumulated vsize (KiB) 309592

[startup+4842.3 s]
/proc/loadavg: 2.13 2.03 2.01 3/465 17414
/proc/meminfo: memFree=3492176/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4842.41 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 313799 0 0 0 484140 101 0 0 25 0 1 0 801554122 317022208 59702 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256022 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 59702 248 26 0 74030 0
Current children cumulated CPU time (s) 4842.41
Current children cumulated vsize (KiB) 309592

[startup+4902.3 s]
/proc/loadavg: 2.11 2.04 2.01 3/465 17416
/proc/meminfo: memFree=3518792/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4902.42 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 314689 0 0 0 490140 102 0 0 25 0 1 0 801554122 317022208 60583 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 60583 248 26 0 74030 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 309592

[startup+4962.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/465 17427
/proc/meminfo: memFree=3478584/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=4962.42 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 315341 0 0 0 496140 102 0 0 25 0 1 0 801554122 317022208 61222 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 61222 248 26 0 74030 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 309592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.02 2.03 2.00 3/465 17428
/proc/meminfo: memFree=3513160/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=5000.02 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 315643 0 0 0 499900 102 0 0 25 0 1 0 801554122 317022208 61518 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 61518 248 26 0 74030 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 309592

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.02 2.03 2.00 3/465 17428
/proc/meminfo: memFree=3513160/32950928 swapFree=45617060/67111528
[pid=17136] ppid=17134 vsize=309592 CPUtime=5000.02 cores=1,3,5,7
/proc/17136/stat : 17136 (lr_gl_shr) R 17134 17136 15952 0 -1 4202496 315643 0 0 0 499900 102 0 0 25 0 1 0 801554122 317022208 61518 33554432000 4194304 4300056 140735584695264 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/17136/statm: 77398 61518 248 26 0 74030 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 309592

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.93
CPU time (s): 5000.05
CPU user time (s): 4999.02
CPU system time (s): 1.03584
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 436436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.02
system time used= 1.03584
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 315643
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 3544

runsolver used 22.2826 second user time and 54.9356 second system time

The end

Launcher Data 

Begin job on node123 at 2011-06-01 05:39:03
IDJOB=3439868
IDBENCH=70830
IDSOLVER=1938
FILE ID=node123/3439868-1306899543
RUNJOBID= node123-1306899543-17117
PBS_JOBID= 13488453
Free space on /tmp= 16292 MiB

SOLVER NAME= minisat hack: LR_GL_SHR 2011-03-02
BENCH NAME= SAT09/APPLICATIONS/crypto/md5gen/gus-md5-11.cnf
COMMAND LINE= HOME/lr_gl_shr BENCHNAME -verb=0 -model
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439868-1306899543/watcher-3439868-1306899543 -o /tmp/evaluation-result-3439868-1306899543/solver-3439868-1306899543 -C 5000 -W 5100 -M 15500  HOME/lr_gl_shr HOME/instance-3439868-1306899543.cnf -verb=0 -model

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 49867705b76fc90285dd6fc48de2613c
RANDOM SEED=521961623

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       3933284 kB
Buffers:         92796 kB
Cached:       26044960 kB
SwapCached:       9236 kB
Active:       14260720 kB
Inactive:     13834424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       3933284 kB
SwapTotal:    67111528 kB
SwapFree:     45617060 kB
Dirty:            6220 kB
Writeback:           0 kB
AnonPages:     1955780 kB
Mapped:          23544 kB
Slab:           775748 kB
PageTables:      77608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 133386496 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 16288 MiB
End job on node123 at 2011-06-01 07:02:25