Trace number 3309850

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587? (TO) 5000.1 4999.92

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_3_keyfind_1.cnf
MD5SUMff59ad0e88befc51bfa041e45143dc53
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2808
Number of clauses30432
Sum of the clauses size167020
Maximum clause length8
Minimum clause length1
Number of clauses of size 1280
Number of clauses of size 2384
Number of clauses of size 35024
Number of clauses of size 4960
Number of clauses of size 56144
Number of clauses of size over 517640

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309850-1303996982/watcher-3309850-1303996982 -o /tmp/evaluation-result-3309850-1303996982/solver-3309850-1303996982 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3309850-1303996982.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 9258
/proc/meminfo: memFree=15174888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=7376 CPUtime=0 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 431 0 0 0 0 0 0 0 25 0 1 0 492113767 7553024 368 33554432000 4194304 4409164 140735092340448 18446744073709551615 4200647 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 1844 368 112 53 0 267 0

[startup+0.0929041 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 9258
/proc/meminfo: memFree=15174888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=9916 CPUtime=0.09 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 1154 0 0 0 9 0 0 0 25 0 1 0 492113767 10153984 1004 33554432000 4194304 4409164 140735092340448 18446744073709551615 4271656 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 2479 1004 130 53 0 902 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9916

[startup+0.100911 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 9258
/proc/meminfo: memFree=15174888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=9916 CPUtime=0.09 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 1154 0 0 0 9 0 0 0 25 0 1 0 492113767 10153984 1004 33554432000 4194304 4409164 140735092340448 18446744073709551615 4271982 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 2479 1004 130 53 0 902 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9916

[startup+0.300868 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 9258
/proc/meminfo: memFree=15174888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=9720 CPUtime=0.29 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 1158 0 0 0 29 0 0 0 25 0 1 0 492113767 9953280 959 33554432000 4194304 4409164 140735092340448 18446744073709551615 4325458 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 2430 959 134 53 0 853 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 9720

[startup+0.700789 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 9258
/proc/meminfo: memFree=15174888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=9720 CPUtime=0.69 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 1165 0 0 0 69 0 0 0 25 0 1 0 492113767 9953280 966 33554432000 4194304 4409164 140735092340448 18446744073709551615 4243001 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 2430 966 136 53 0 853 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 9720

[startup+1.50062 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9259
/proc/meminfo: memFree=15168812/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=11792 CPUtime=1.49 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 1978 0 0 0 147 2 0 0 25 0 1 0 492113767 12075008 1506 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 2948 1506 141 53 0 1371 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 11792

[startup+3.10032 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9259
/proc/meminfo: memFree=15164704/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=12504 CPUtime=3.09 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 4033 0 0 0 305 4 0 0 25 0 1 0 492113767 12804096 1684 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 3126 1684 141 53 0 1549 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 12504

[startup+6.30071 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9259
/proc/meminfo: memFree=15161108/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=13452 CPUtime=6.29 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 8616 0 0 0 621 8 0 0 25 0 1 0 492113767 13774848 1894 33554432000 4194304 4409164 140735092340448 18446744073709551615 4243014 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/9258/statm: 3363 1894 141 53 0 1786 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 13452

[startup+12.7005 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9260
/proc/meminfo: memFree=15147088/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=15960 CPUtime=12.69 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 16051 0 0 0 1254 15 0 0 25 0 1 0 492113767 16343040 2516 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358782 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 3990 2516 141 53 0 2413 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 15960

[startup+25.5011 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9260
/proc/meminfo: memFree=15158240/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=21756 CPUtime=25.49 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 29717 0 0 0 2524 25 0 0 25 0 1 0 492113767 22278144 3965 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 5439 3965 141 53 0 3862 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 21756

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9261
/proc/meminfo: memFree=15145944/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=33192 CPUtime=51.09 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 47768 0 0 0 5072 37 0 0 25 0 1 0 492113767 33988608 6824 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358505 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 8298 6824 141 53 0 6721 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 33192

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 4/178 9262
/proc/meminfo: memFree=15119028/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=46176 CPUtime=102.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 68552 0 0 0 10173 57 0 0 25 0 1 0 492113767 47284224 10070 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358813 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 11544 10070 141 53 0 9967 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 46176

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9266
/proc/meminfo: memFree=15105284/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=38848 CPUtime=162.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 91924 0 0 0 16156 74 0 0 25 0 1 0 492113767 39780352 8238 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 9712 8238 141 53 0 8135 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 38848

[startup+222.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9268
/proc/meminfo: memFree=15104860/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=61668 CPUtime=222.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 111530 0 0 0 22139 91 0 0 25 0 1 0 492113767 63148032 13508 33554432000 4194304 4409164 140735092340448 18446744073709551615 4360089 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 15417 13508 141 53 0 13840 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 61668

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9270
/proc/meminfo: memFree=15113648/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=41436 CPUtime=282.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 138439 0 0 0 28117 113 0 0 25 0 1 0 492113767 42430464 8885 33554432000 4194304 4409164 140735092340448 18446744073709551615 4230698 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 10359 8885 141 53 0 8782 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 41436

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9271
/proc/meminfo: memFree=15099612/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=50660 CPUtime=342.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 172275 0 0 0 34094 136 0 0 25 0 1 0 492113767 51875840 11191 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358475 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 12665 11191 141 53 0 11088 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 50660

[startup+402.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9273
/proc/meminfo: memFree=15106160/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=42964 CPUtime=402.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 186179 0 0 0 40076 154 0 0 25 0 1 0 492113767 43995136 9299 33554432000 4194304 4409164 140735092340448 18446744073709551615 4359778 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 10741 9299 141 53 0 9164 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 42964

[startup+462.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9274
/proc/meminfo: memFree=15094112/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=61544 CPUtime=462.31 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 212770 0 0 0 46054 177 0 0 25 0 1 0 492113767 63021056 13912 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 15386 13912 141 53 0 13809 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 61544

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9276
/proc/meminfo: memFree=15083172/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=68400 CPUtime=522.3 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 240340 0 0 0 52031 199 0 0 25 0 1 0 492113767 70041600 15626 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358730 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 17100 15626 141 53 0 15523 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 68400

[startup+582.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9278
/proc/meminfo: memFree=15131384/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=44808 CPUtime=582.31 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 261701 0 0 0 58019 212 0 0 25 0 1 0 492113767 45883392 9728 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358614 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 11202 9728 141 53 0 9625 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 44808

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9383
/proc/meminfo: memFree=14504276/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264432 CPUtime=4062.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 665989 0 0 0 405581 663 0 0 25 0 1 0 492113767 270778368 64634 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358534 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66108 64634 141 53 0 64531 0
Current children cumulated CPU time (s) 4062.44
Current children cumulated vsize (KiB) 264432

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9384
/proc/meminfo: memFree=14504480/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264432 CPUtime=4122.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 665989 0 0 0 411576 668 0 0 25 0 1 0 492113767 270778368 64634 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358333 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66108 64634 141 53 0 64531 0
Current children cumulated CPU time (s) 4122.44
Current children cumulated vsize (KiB) 264432

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9386
/proc/meminfo: memFree=14504448/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264504 CPUtime=4182.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 666435 0 0 0 417569 675 0 0 25 0 1 0 492113767 270852096 64652 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358512 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66126 64652 141 53 0 64549 0
Current children cumulated CPU time (s) 4182.44
Current children cumulated vsize (KiB) 264504

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 9387
/proc/meminfo: memFree=14504404/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264504 CPUtime=4242.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 666435 0 0 0 423563 681 0 0 25 0 1 0 492113767 270852096 64652 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358614 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66126 64652 141 53 0 64549 0
Current children cumulated CPU time (s) 4242.44
Current children cumulated vsize (KiB) 264504

[startup+4302.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 9389
/proc/meminfo: memFree=14504496/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264596 CPUtime=4302.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 666893 0 0 0 429556 688 0 0 25 0 1 0 492113767 270946304 64675 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358348 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66149 64675 141 53 0 64572 0
Current children cumulated CPU time (s) 4302.44
Current children cumulated vsize (KiB) 264596

[startup+4362.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 9390
/proc/meminfo: memFree=14504948/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264596 CPUtime=4362.45 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 666893 0 0 0 435548 697 0 0 25 0 1 0 492113767 270946304 64675 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358487 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66149 64675 141 53 0 64572 0
Current children cumulated CPU time (s) 4362.45
Current children cumulated vsize (KiB) 264596

[startup+4422.3 s]
/proc/loadavg: 1.92 1.99 1.99 2/172 9410
/proc/meminfo: memFree=14961936/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264596 CPUtime=4422.44 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 666893 0 0 0 441543 701 0 0 25 0 1 0 492113767 270946304 64675 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358434 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66149 64675 141 53 0 64572 0
Current children cumulated CPU time (s) 4422.44
Current children cumulated vsize (KiB) 264596

[startup+4482.3 s]
/proc/loadavg: 1.34 1.80 1.93 2/172 9412
/proc/meminfo: memFree=14962208/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264720 CPUtime=4482.45 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 667366 0 0 0 447535 710 0 0 25 0 1 0 492113767 271073280 64706 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358434 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66180 64706 141 53 0 64603 0
Current children cumulated CPU time (s) 4482.45
Current children cumulated vsize (KiB) 264720

[startup+4542.3 s]
/proc/loadavg: 1.17 1.67 1.87 2/172 9413
/proc/meminfo: memFree=14962164/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264720 CPUtime=4542.45 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 667366 0 0 0 453531 714 0 0 25 0 1 0 492113767 271073280 64706 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358614 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66180 64706 141 53 0 64603 0
Current children cumulated CPU time (s) 4542.45
Current children cumulated vsize (KiB) 264720

[startup+4602.3 s]
/proc/loadavg: 1.06 1.55 1.82 2/172 9415
/proc/meminfo: memFree=14961888/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264804 CPUtime=4602.45 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 667850 0 0 0 459526 719 0 0 25 0 1 0 492113767 271159296 64727 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358614 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66201 64727 141 53 0 64624 0
Current children cumulated CPU time (s) 4602.45
Current children cumulated vsize (KiB) 264804

[startup+4662.3 s]
/proc/loadavg: 1.02 1.44 1.76 2/172 9416
/proc/meminfo: memFree=14962088/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264804 CPUtime=4662.46 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 667850 0 0 0 465521 725 0 0 25 0 1 0 492113767 271159296 64727 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358711 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66201 64727 141 53 0 64624 0
Current children cumulated CPU time (s) 4662.46
Current children cumulated vsize (KiB) 264804

[startup+4722.31 s]
/proc/loadavg: 1.01 1.36 1.71 2/172 9418
/proc/meminfo: memFree=14961940/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264804 CPUtime=4722.46 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 667850 0 0 0 471516 730 0 0 25 0 1 0 492113767 271159296 64727 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358434 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66201 64727 141 53 0 64624 0
Current children cumulated CPU time (s) 4722.46
Current children cumulated vsize (KiB) 264804

[startup+4782.3 s]
/proc/loadavg: 1.00 1.29 1.66 2/172 9420
/proc/meminfo: memFree=14962260/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264872 CPUtime=4782.46 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 668342 0 0 0 477509 737 0 0 25 0 1 0 492113767 271228928 64744 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358434 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66218 64744 141 53 0 64641 0
Current children cumulated CPU time (s) 4782.46
Current children cumulated vsize (KiB) 264872

[startup+4842.3 s]
/proc/loadavg: 1.00 1.24 1.62 2/172 9421
/proc/meminfo: memFree=14961976/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264872 CPUtime=4842.47 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 668342 0 0 0 483504 743 0 0 25 0 1 0 492113767 271228928 64744 33554432000 4194304 4409164 140735092340448 18446744073709551615 4359755 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66218 64744 141 53 0 64641 0
Current children cumulated CPU time (s) 4842.47
Current children cumulated vsize (KiB) 264872

[startup+4902.3 s]
/proc/loadavg: 1.00 1.19 1.58 2/172 9423
/proc/meminfo: memFree=14962292/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=264872 CPUtime=4902.46 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 668342 0 0 0 489498 748 0 0 25 0 1 0 492113767 271228928 64744 33554432000 4194304 4409164 140735092340448 18446744073709551615 4358588 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 66218 64744 141 53 0 64641 0
Current children cumulated CPU time (s) 4902.46
Current children cumulated vsize (KiB) 264872

[startup+4962.3 s]
/proc/loadavg: 1.00 1.15 1.54 2/172 9425
/proc/meminfo: memFree=14957056/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=270228 CPUtime=4962.47 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 679186 0 0 0 495489 758 0 0 25 0 1 0 492113767 276713472 66083 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 67557 66083 141 53 0 65980 0
Current children cumulated CPU time (s) 4962.47
Current children cumulated vsize (KiB) 270228



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 1.00 1.13 1.52 2/172 9425
/proc/meminfo: memFree=14951808/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=275492 CPUtime=5000.08 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 680502 0 0 0 499246 762 0 0 25 0 1 0 492113767 282103808 67399 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 68873 67399 141 53 0 67296 0
Current children cumulated CPU time (s) 5000.08
Current children cumulated vsize (KiB) 275492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 1.00 1.13 1.52 2/172 9425
/proc/meminfo: memFree=14951808/32951124 swapFree=67111528/67111528
[pid=9258] ppid=9256 vsize=275492 CPUtime=5000.08 cores=0,2,4,6
/proc/9258/stat : 9258 (lingeling) R 9256 9258 8659 0 -1 4202496 680502 0 0 0 499246 762 0 0 25 0 1 0 492113767 282103808 67399 33554432000 4194304 4409164 140735092340448 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/9258/statm: 68873 67399 141 53 0 67296 0
Current children cumulated CPU time (s) 5000.08
Current children cumulated vsize (KiB) 275492

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.92
CPU time (s): 5000.1
CPU user time (s): 4992.46
CPU system time (s): 7.63584
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 300972

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4992.46
system time used= 7.63584
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 680502
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 15579

runsolver used 7.8918 second user time and 15.6346 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-28 15:23:02
IDJOB=3309850
IDBENCH=83408
IDSOLVER=1693
FILE ID=node141/3309850-1303996982
RUNJOBID= node141-1303987378-8677
PBS_JOBID= 13168733
Free space on /tmp= 71420 MiB

SOLVER NAME= Lingeling 587
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_3_keyfind_1.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309850-1303996982/watcher-3309850-1303996982 -o /tmp/evaluation-result-3309850-1303996982/solver-3309850-1303996982 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3309850-1303996982.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff59ad0e88befc51bfa041e45143dc53
RANDOM SEED=328038163

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15175052 kB
Buffers:       1620440 kB
Cached:       15466652 kB
SwapCached:          0 kB
Active:        7857468 kB
Inactive:      9337120 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15175052 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1196 kB
Writeback:          24 kB
AnonPages:      106988 kB
Mapped:          15272 kB
Slab:           517948 kB
PageTables:       4704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   250552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71424 MiB
End job on node141 at 2011-04-28 16:46:23