Trace number 3372736

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587f (fixed)? (TO) 5000.06 4999.92

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_1_keyfind_1.cnf
MD5SUM5092a9db644d53c7bc023e4dff206812
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1192
Number of clauses10656
Sum of the clauses size56868
Maximum clause length8
Minimum clause length1
Number of clauses of size 1264
Number of clauses of size 2128
Number of clauses of size 32016
Number of clauses of size 4320
Number of clauses of size 52048
Number of clauses of size over 55880

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372736-1305424749/watcher-3372736-1305424749 -o /tmp/evaluation-result-3372736-1305424749/solver-3372736-1305424749 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3372736-1305424749.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/347 17602
/proc/meminfo: memFree=25794024/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=7416 CPUtime=0 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 470 0 0 0 0 0 0 0 23 0 1 0 654075394 7593984 394 33554432000 4194304 4409284 140735453260960 18446744073709551615 4310045 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 1854 394 128 53 0 277 0

[startup+0.014204 s]
/proc/loadavg: 2.00 2.00 2.00 2/347 17602
/proc/meminfo: memFree=25794024/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=7416 CPUtime=0.01 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 470 0 0 0 1 0 0 0 23 0 1 0 654075394 7593984 394 33554432000 4194304 4409284 140735453260960 18446744073709551615 4310066 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 1854 394 128 53 0 277 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 7416

[startup+0.100188 s]
/proc/loadavg: 2.00 2.00 2.00 2/347 17602
/proc/meminfo: memFree=25794024/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=7928 CPUtime=0.09 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 602 0 0 0 9 0 0 0 23 0 1 0 654075394 8118272 526 33554432000 4194304 4409284 140735453260960 18446744073709551615 4268562 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 1982 526 132 53 0 405 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7928

[startup+0.300151 s]
/proc/loadavg: 2.00 2.00 2.00 2/347 17602
/proc/meminfo: memFree=25794024/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=7404 CPUtime=0.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 615 0 0 0 29 0 0 0 25 0 1 0 654075394 7581696 408 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 1851 408 141 53 0 274 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7404

[startup+0.701086 s]
/proc/loadavg: 2.00 2.00 2.00 2/347 17602
/proc/meminfo: memFree=25794024/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=8716 CPUtime=0.69 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1127 0 0 0 68 1 0 0 25 0 1 0 654075394 8925184 729 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 2179 729 141 53 0 602 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 8716

[startup+1.50093 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17603
/proc/meminfo: memFree=25788320/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=9112 CPUtime=1.49 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 2153 0 0 0 144 5 0 0 25 0 1 0 654075394 9330688 828 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 2278 828 141 53 0 701 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 9112

[startup+3.10064 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17603
/proc/meminfo: memFree=25783792/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=10488 CPUtime=3.09 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 4863 0 0 0 298 11 0 0 25 0 1 0 654075394 10739712 1178 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 2622 1178 141 53 0 1045 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 10488

[startup+6.30105 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17603
/proc/meminfo: memFree=25776820/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=10680 CPUtime=6.3 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 8107 0 0 0 611 19 0 0 25 0 1 0 654075394 10936320 1195 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358611 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 2670 1195 141 53 0 1093 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 10680

[startup+12.7009 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17604
/proc/meminfo: memFree=25774668/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=13844 CPUtime=12.7 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 10855 0 0 0 1245 25 0 0 25 0 1 0 654075394 14176256 2018 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 3461 2018 141 53 0 1884 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 13844

[startup+25.5005 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17604
/proc/meminfo: memFree=25773436/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=15508 CPUtime=25.49 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 17633 0 0 0 2516 33 0 0 25 0 1 0 654075394 15880192 2434 33554432000 4194304 4409284 140735453260960 18446744073709551615 4359879 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 3877 2434 141 53 0 2300 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 15508

[startup+51.1009 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17605
/proc/meminfo: memFree=25763340/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=16696 CPUtime=51.09 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 27378 0 0 0 5057 52 0 0 25 0 1 0 654075394 17096704 2680 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 4174 2680 141 53 0 2597 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 16696

[startup+102.312 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17606
/proc/meminfo: memFree=25744224/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=22592 CPUtime=102.31 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 41302 0 0 0 10150 81 0 0 25 0 1 0 654075394 23134208 4173 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358764 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 5648 4173 141 53 0 4071 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 22592

[startup+162.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 17617
/proc/meminfo: memFree=25720772/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=25648 CPUtime=162.3 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 63986 0 0 0 16107 123 0 0 25 0 1 0 654075394 26263552 4937 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 6412 4937 141 53 0 4835 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 25648

[startup+222.301 s]
/proc/loadavg: 2.04 2.01 2.00 3/348 18092
/proc/meminfo: memFree=25738064/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=24488 CPUtime=222.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 88591 0 0 0 22071 158 0 0 25 0 1 0 654075394 25075712 4679 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 6122 4679 141 53 0 4545 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 24488

[startup+282.301 s]
/proc/loadavg: 2.01 2.01 2.00 3/348 18096
/proc/meminfo: memFree=25711256/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=24084 CPUtime=282.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 113391 0 0 0 28041 188 0 0 25 0 1 0 654075394 24662016 4546 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358421 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 6021 4546 141 53 0 4444 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 24084

[startup+342.301 s]
/proc/loadavg: 2.10 2.04 2.01 3/348 18098
/proc/meminfo: memFree=25723528/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=27352 CPUtime=342.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 128553 0 0 0 34018 211 0 0 25 0 1 0 654075394 28008448 5363 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358437 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 6838 5363 141 53 0 5261 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 27352

[startup+402.301 s]
/proc/loadavg: 2.04 2.03 2.00 3/348 18100
/proc/meminfo: memFree=25717928/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=29512 CPUtime=402.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 142784 0 0 0 39995 234 0 0 25 0 1 0 654075394 30220288 5909 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358529 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 7378 5909 141 53 0 5801 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 29512

[startup+462.301 s]
/proc/loadavg: 2.06 2.04 2.00 3/348 18102
/proc/meminfo: memFree=25705140/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=25764 CPUtime=462.29 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 158173 0 0 0 45975 254 0 0 25 0 1 0 654075394 26382336 4966 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358557 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 6441 4966 141 53 0 4864 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 25764

[startup+522.301 s]
/proc/loadavg: 2.02 2.03 2.00 3/348 18103
/proc/meminfo: memFree=25700156/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=35024 CPUtime=522.3 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 172227 0 0 0 51957 273 0 0 25 0 1 0 654075394 35864576 7313 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358673 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 8756 7313 141 53 0 7179 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 35024

[startup+582.301 s]
/proc/loadavg: 2.00 2.02 2.00 3/348 18105
/proc/meminfo: memFree=25707464/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=35068 CPUtime=582.3 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 192026 0 0 0 57934 296 0 0 25 0 1 0 654075394 35909632 7321 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358673 0 0 4096 17506 0 0 0 17 1 0 0 0
/proc/17602/statm: 8767 7321 141 53 0 7190 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 35068

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 24122
/proc/meminfo: memFree=25573108/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=96864 CPUtime=4062.43 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 881038 0 0 0 404963 1280 0 0 25 0 1 0 654075394 99188736 22770 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358356 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24216 22770 141 53 0 22639 0
Current children cumulated CPU time (s) 4062.43
Current children cumulated vsize (KiB) 96864

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/348 24123
/proc/meminfo: memFree=25597892/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=93656 CPUtime=4122.41 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 890413 0 0 0 410945 1296 0 0 25 0 1 0 654075394 95903744 21939 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358516 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 23414 21939 141 53 0 21837 0
Current children cumulated CPU time (s) 4122.41
Current children cumulated vsize (KiB) 93656

[startup+4182.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/348 24125
/proc/meminfo: memFree=25572824/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=80732 CPUtime=4182.42 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 902105 0 0 0 416931 1311 0 0 25 0 1 0 654075394 82669568 18708 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 20183 18708 141 53 0 18606 0
Current children cumulated CPU time (s) 4182.42
Current children cumulated vsize (KiB) 80732

[startup+4242.3 s]
/proc/loadavg: 2.16 2.04 2.01 3/348 24126
/proc/meminfo: memFree=25603308/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=94164 CPUtime=4242.41 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 905463 0 0 0 422917 1324 0 0 25 0 1 0 654075394 96423936 22066 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358437 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 23541 22066 141 53 0 21964 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 94164

[startup+4302.3 s]
/proc/loadavg: 2.12 2.04 2.01 3/348 24128
/proc/meminfo: memFree=25580716/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=92708 CPUtime=4302.42 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 920219 0 0 0 428900 1342 0 0 25 0 1 0 654075394 94932992 21704 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358325 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 23177 21704 141 53 0 21600 0
Current children cumulated CPU time (s) 4302.42
Current children cumulated vsize (KiB) 92708

[startup+4362.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/348 24130
/proc/meminfo: memFree=25611212/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=93284 CPUtime=4362.41 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 935687 0 0 0 434884 1357 0 0 25 0 1 0 654075394 95522816 21865 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 23321 21865 141 53 0 21744 0
Current children cumulated CPU time (s) 4362.41
Current children cumulated vsize (KiB) 93284

[startup+4422.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/348 24131
/proc/meminfo: memFree=25594568/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=74920 CPUtime=4422.42 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 941748 0 0 0 440870 1372 0 0 25 0 1 0 654075394 76718080 17274 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 18730 17274 141 53 0 17153 0
Current children cumulated CPU time (s) 4422.42
Current children cumulated vsize (KiB) 74920

[startup+4482.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/348 24133
/proc/meminfo: memFree=25598640/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=99780 CPUtime=4482.42 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 947963 0 0 0 446859 1383 0 0 25 0 1 0 654075394 102174720 23489 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24945 23489 141 53 0 23368 0
Current children cumulated CPU time (s) 4482.42
Current children cumulated vsize (KiB) 99780

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/348 24134
/proc/meminfo: memFree=25584852/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=96048 CPUtime=4542.42 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 957733 0 0 0 452845 1397 0 0 25 0 1 0 654075394 98353152 22537 33554432000 4194304 4409284 140735453260960 18446744073709551615 4359918 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24012 22537 141 53 0 22435 0
Current children cumulated CPU time (s) 4542.42
Current children cumulated vsize (KiB) 96048

[startup+4602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/348 24136
/proc/meminfo: memFree=25623016/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=74920 CPUtime=4602.44 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 969068 0 0 0 458832 1412 0 0 25 0 1 0 654075394 76718080 17267 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 18730 17267 141 53 0 17153 0
Current children cumulated CPU time (s) 4602.44
Current children cumulated vsize (KiB) 74920

[startup+4662.3 s]
/proc/loadavg: 2.13 2.03 2.01 3/348 24138
/proc/meminfo: memFree=25569428/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=96616 CPUtime=4662.43 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 974492 0 0 0 464815 1428 0 0 25 0 1 0 654075394 98934784 22691 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358342 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24154 22691 141 53 0 22577 0
Current children cumulated CPU time (s) 4662.43
Current children cumulated vsize (KiB) 96616

[startup+4722.31 s]
/proc/loadavg: 2.05 2.03 2.00 3/348 24139
/proc/meminfo: memFree=25600036/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=95256 CPUtime=4722.44 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 990964 0 0 0 470801 1443 0 0 25 0 1 0 654075394 97542144 22353 33554432000 4194304 4409284 140735453260960 18446744073709551615 4360264 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 23814 22353 141 53 0 22237 0
Current children cumulated CPU time (s) 4722.44
Current children cumulated vsize (KiB) 95256

[startup+4782.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/348 24141
/proc/meminfo: memFree=25591592/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=75908 CPUtime=4782.43 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1002158 0 0 0 476787 1456 0 0 25 0 1 0 654075394 77729792 17502 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358347 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 18977 17502 141 53 0 17400 0
Current children cumulated CPU time (s) 4782.43
Current children cumulated vsize (KiB) 75908

[startup+4842.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/348 24142
/proc/meminfo: memFree=25566524/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=97840 CPUtime=4842.43 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1007641 0 0 0 482773 1470 0 0 25 0 1 0 654075394 100188160 22985 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358609 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24460 22985 141 53 0 22883 0
Current children cumulated CPU time (s) 4842.43
Current children cumulated vsize (KiB) 97840

[startup+4902.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/348 24144
/proc/meminfo: memFree=25539588/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=98536 CPUtime=4902.43 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1024041 0 0 0 488756 1487 0 0 25 0 1 0 654075394 100900864 23159 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358325 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 24634 23159 141 53 0 23057 0
Current children cumulated CPU time (s) 4902.43
Current children cumulated vsize (KiB) 98536

[startup+4962.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/348 24146
/proc/meminfo: memFree=25568840/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=60104 CPUtime=4962.44 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1035006 0 0 0 494743 1501 0 0 25 0 1 0 654075394 61546496 13576 33554432000 4194304 4409284 140735453260960 18446744073709551615 4358850 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 15026 13576 141 53 0 13449 0
Current children cumulated CPU time (s) 4962.44
Current children cumulated vsize (KiB) 60104



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.00 2.02 2.00 2/346 24148
/proc/meminfo: memFree=25716648/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=80528 CPUtime=5000.05 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1040112 0 0 0 498495 1510 0 0 25 0 1 0 654075394 82460672 18682 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 20132 18682 141 53 0 18555 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 80528

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.00 2.02 2.00 2/346 24148
/proc/meminfo: memFree=25716648/32951124 swapFree=40554400/67111528
[pid=17602] ppid=17600 vsize=80528 CPUtime=5000.05 cores=1,3,5,7
/proc/17602/stat : 17602 (lingeling) R 17600 17602 17363 0 -1 4202496 1040112 0 0 0 498495 1510 0 0 25 0 1 0 654075394 82460672 18682 33554432000 4194304 4409284 140735453260960 18446744073709551615 230809190295 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17602/statm: 20132 18682 141 53 0 18555 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 80528

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.92
CPU time (s): 5000.06
CPU user time (s): 4984.95
CPU system time (s): 15.1067
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 124596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4984.96
system time used= 15.1067
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1040112
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 46391

runsolver used 16.1845 second user time and 38.3692 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-15 03:59:09
IDJOB=3372736
IDBENCH=83412
IDSOLVER=1850
FILE ID=node104/3372736-1305424749
RUNJOBID= node104-1305419747-17382
PBS_JOBID= 13324584
Free space on /tmp= 73396 MiB

SOLVER NAME= Lingeling 587f (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_1_keyfind_1.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372736-1305424749/watcher-3372736-1305424749 -o /tmp/evaluation-result-3372736-1305424749/solver-3372736-1305424749 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3372736-1305424749.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5092a9db644d53c7bc023e4dff206812
RANDOM SEED=654203870

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25794180 kB
Buffers:        300788 kB
Cached:        2377588 kB
SwapCached:     122128 kB
Active:         937664 kB
Inactive:      5953300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25794180 kB
SwapTotal:    67111528 kB
SwapFree:     40554400 kB
Dirty:            1188 kB
Writeback:           0 kB
AnonPages:     4103412 kB
Mapped:          11084 kB
Slab:           117572 kB
PageTables:      83664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 74833720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73428 MiB
End job on node104 at 2011-05-15 05:22:31