Trace number 3439398

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.07 4999.94

General information on the benchmark

NameSAT04/handmade/kexu/frb-0.8/
frb59-26-1.used-as.sat04-891.cnf
MD5SUM5877850d9f604b6973676132cbba5c90
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark502.369
Satisfiable
(Un)Satisfiability was proved
Number of variables1534
Number of clauses132295
Sum of the clauses size266006
Maximum clause length26
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2132236
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 559

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439398-1306931065/watcher-3439398-1306931065 -o /tmp/evaluation-result-3439398-1306931065/solver-3439398-1306931065 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3439398-1306931065.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/521 9820
/proc/meminfo: memFree=21814436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=15228 CPUtime=0 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 966 0 0 0 0 0 0 0 25 0 1 0 785522003 15593472 906 33554432000 4194304 4394578 140737134557760 18446744073709551615 228095111877 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 3807 906 247 49 0 948 0

[startup+0.0791689 s]
/proc/loadavg: 2.00 2.00 2.00 2/521 9820
/proc/meminfo: memFree=21814436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=24536 CPUtime=0.07 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 3296 0 0 0 7 0 0 0 25 0 1 0 785522003 25124864 3235 33554432000 4194304 4394578 140737134557760 18446744073709551615 228095475607 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 6134 3235 255 49 0 3275 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 24536

[startup+0.101146 s]
/proc/loadavg: 2.00 2.00 2.00 2/521 9820
/proc/meminfo: memFree=21814436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=24536 CPUtime=0.09 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 3296 0 0 0 9 0 0 0 25 0 1 0 785522003 25124864 3235 33554432000 4194304 4394578 140737134557760 18446744073709551615 228095475607 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 6134 3235 255 49 0 3275 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24536

[startup+0.301124 s]
/proc/loadavg: 2.00 2.00 2.00 2/521 9820
/proc/meminfo: memFree=21814436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=30808 CPUtime=0.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 5382 0 0 0 28 1 0 0 25 0 1 0 785522003 31547392 4803 33554432000 4194304 4394578 140737134557760 18446744073709551615 4287897 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 7702 4803 266 49 0 4843 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30808

[startup+0.701064 s]
/proc/loadavg: 2.00 2.00 2.00 2/521 9820
/proc/meminfo: memFree=21814436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=36112 CPUtime=0.69 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 6698 0 0 0 68 1 0 0 25 0 1 0 785522003 36978688 6119 33554432000 4194304 4394578 140737134557760 18446744073709551615 228095111877 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 9028 6119 266 49 0 6169 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 36112

[startup+1.50092 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9821
/proc/meminfo: memFree=21787032/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=42616 CPUtime=1.49 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 8318 0 0 0 147 2 0 0 25 0 1 0 785522003 43638784 7739 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 10654 7739 266 49 0 7795 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 42616

[startup+3.10063 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9821
/proc/meminfo: memFree=21777608/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=53580 CPUtime=3.09 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 11031 0 0 0 307 2 0 0 25 0 1 0 785522003 54865920 10452 33554432000 4194304 4394578 140737134557760 18446744073709551615 4338212 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 13395 10452 266 49 0 10536 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 53580

[startup+6.30102 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9821
/proc/meminfo: memFree=21759368/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=69852 CPUtime=6.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 14992 0 0 0 626 3 0 0 25 0 1 0 785522003 71528448 14413 33554432000 4194304 4394578 140737134557760 18446744073709551615 4287306 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9820/statm: 17463 14413 266 49 0 14604 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 69852

[startup+12.7009 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9821
/proc/meminfo: memFree=21747276/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=78568 CPUtime=12.67 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 16974 0 0 0 1264 3 0 0 25 0 1 0 785522003 80453632 16395 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 19642 16395 266 49 0 16783 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 78568

[startup+25.5005 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9821
/proc/meminfo: memFree=21735612/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=90900 CPUtime=25.47 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 19670 0 0 0 2543 4 0 0 25 0 1 0 785522003 93081600 19091 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 22725 19091 266 49 0 19866 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 90900

[startup+51.1008 s]
/proc/loadavg: 2.00 2.00 2.00 3/522 9825
/proc/meminfo: memFree=21720432/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=105532 CPUtime=51.07 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 22823 0 0 0 5103 4 0 0 25 0 1 0 785522003 108064768 22244 33554432000 4194304 4394578 140737134557760 18446744073709551615 4313480 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 26383 22244 266 49 0 23524 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 105532

[startup+102.32 s]
/proc/loadavg: 2.09 2.03 2.01 3/522 9826
/proc/meminfo: memFree=21695748/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=128756 CPUtime=102.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 27780 0 0 0 10224 5 0 0 25 0 1 0 785522003 131846144 27201 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 32189 27201 266 49 0 29330 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 128756

[startup+162.3 s]
/proc/loadavg: 2.07 2.03 2.01 3/522 9828
/proc/meminfo: memFree=21666308/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=155244 CPUtime=162.27 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 33808 0 0 0 16221 6 0 0 25 0 1 0 785522003 158969856 33229 33554432000 4194304 4394578 140737134557760 18446744073709551615 4346474 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 38811 33229 266 49 0 35952 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 155244

[startup+222.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/522 9830
/proc/meminfo: memFree=21658316/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=163212 CPUtime=222.28 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 35560 0 0 0 22221 7 0 0 25 0 1 0 785522003 167129088 34981 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 40803 34981 266 49 0 37944 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 163212

[startup+282.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/522 9831
/proc/meminfo: memFree=21639036/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=180152 CPUtime=282.27 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 39149 0 0 0 28220 7 0 0 25 0 1 0 785522003 184475648 38570 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298818 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 45038 38570 266 49 0 42179 0
Current children cumulated CPU time (s) 282.27
Current children cumulated vsize (KiB) 180152

[startup+342.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/522 9833
/proc/meminfo: memFree=21628936/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=188728 CPUtime=342.28 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 40777 0 0 0 34220 8 0 0 25 0 1 0 785522003 193257472 40198 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 47182 40198 266 49 0 44323 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 188728

[startup+402.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/522 9834
/proc/meminfo: memFree=21613360/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=204204 CPUtime=402.28 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 43988 0 0 0 40219 9 0 0 25 0 1 0 785522003 209104896 43409 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298818 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 51051 43409 266 49 0 48192 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 204204

[startup+462.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/522 9836
/proc/meminfo: memFree=21597436/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=218044 CPUtime=462.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 46939 0 0 0 46219 10 0 0 25 0 1 0 785522003 223277056 46360 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 54511 46360 266 49 0 51652 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 218044

[startup+522.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/522 9838
/proc/meminfo: memFree=21592416/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=219452 CPUtime=522.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 47294 0 0 0 52219 10 0 0 25 0 1 0 785522003 224718848 46715 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 54863 46715 266 49 0 52004 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 219452

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/522 9839
/proc/meminfo: memFree=21587776/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=220924 CPUtime=582.29 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 47593 0 0 0 58219 10 0 0 25 0 1 0 785522003 226226176 47014 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 55231 47014 266 49 0 52372 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 220924

[startup+642.3 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.02 2.04 2.00 3/522 9944
/proc/meminfo: memFree=21302276/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=390360 CPUtime=4062.41 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 82729 0 0 0 406221 20 0 0 25 0 1 0 785522003 399728640 82150 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 97590 82150 266 49 0 94731 0
Current children cumulated CPU time (s) 4062.41
Current children cumulated vsize (KiB) 390360

[startup+4122.3 s]
/proc/loadavg: 2.13 2.06 2.01 3/522 9946
/proc/meminfo: memFree=21302600/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=390936 CPUtime=4122.39 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 82881 0 0 0 412219 20 0 0 25 0 1 0 785522003 400318464 82302 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 97734 82302 266 49 0 94875 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 390936

[startup+4182.3 s]
/proc/loadavg: 2.10 2.06 2.01 3/522 9947
/proc/meminfo: memFree=21299696/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=392984 CPUtime=4182.4 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 83284 0 0 0 418219 21 0 0 25 0 1 0 785522003 402415616 82705 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298664 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 98246 82705 266 49 0 95387 0
Current children cumulated CPU time (s) 4182.4
Current children cumulated vsize (KiB) 392984

[startup+4242.3 s]
/proc/loadavg: 2.04 2.05 2.00 3/522 9949
/proc/meminfo: memFree=21297792/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=393496 CPUtime=4242.4 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 83430 0 0 0 424219 21 0 0 25 0 1 0 785522003 402939904 82851 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298841 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 98374 82851 266 49 0 95515 0
Current children cumulated CPU time (s) 4242.4
Current children cumulated vsize (KiB) 393496

[startup+4302.3 s]
/proc/loadavg: 2.01 2.04 2.00 3/522 9950
/proc/meminfo: memFree=21295004/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=396184 CPUtime=4302.4 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 83926 0 0 0 430219 21 0 0 25 0 1 0 785522003 405692416 83347 33554432000 4194304 4394578 140737134557760 18446744073709551615 4287241 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99046 83347 266 49 0 96187 0
Current children cumulated CPU time (s) 4302.4
Current children cumulated vsize (KiB) 396184

[startup+4362.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/522 9952
/proc/meminfo: memFree=21292852/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=396952 CPUtime=4362.4 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 84073 0 0 0 436219 21 0 0 25 0 1 0 785522003 406478848 83494 33554432000 4194304 4394578 140737134557760 18446744073709551615 4299008 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99238 83494 266 49 0 96379 0
Current children cumulated CPU time (s) 4362.4
Current children cumulated vsize (KiB) 396952

[startup+4422.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/522 9954
/proc/meminfo: memFree=21291312/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=397208 CPUtime=4422.41 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 84120 0 0 0 442220 21 0 0 25 0 1 0 785522003 406740992 83541 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99302 83541 266 49 0 96443 0
Current children cumulated CPU time (s) 4422.41
Current children cumulated vsize (KiB) 397208

[startup+4482.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/522 9955
/proc/meminfo: memFree=21286668/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=397720 CPUtime=4482.41 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 84251 0 0 0 448220 21 0 0 25 0 1 0 785522003 407265280 83672 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99430 83672 266 49 0 96571 0
Current children cumulated CPU time (s) 4482.41
Current children cumulated vsize (KiB) 397720

[startup+4542.3 s]
/proc/loadavg: 2.06 2.05 2.01 3/522 9957
/proc/meminfo: memFree=21284020/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=398488 CPUtime=4542.41 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 84360 0 0 0 454220 21 0 0 25 0 1 0 785522003 408051712 83781 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99622 83781 266 49 0 96763 0
Current children cumulated CPU time (s) 4542.41
Current children cumulated vsize (KiB) 398488

[startup+4602.3 s]
/proc/loadavg: 1.94 2.02 1.99 2/516 9976
/proc/meminfo: memFree=21643680/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=399960 CPUtime=4602.42 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 84618 0 0 0 460221 21 0 0 25 0 1 0 785522003 409559040 84039 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 99990 84039 266 49 0 97131 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 399960

[startup+4662.3 s]
/proc/loadavg: 1.34 1.83 1.93 2/516 9978
/proc/meminfo: memFree=21640532/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=403544 CPUtime=4662.41 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 85267 0 0 0 466220 21 0 0 25 0 1 0 785522003 413229056 84688 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298841 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 100886 84688 266 49 0 98027 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 403544

[startup+4722.32 s]
/proc/loadavg: 1.12 1.68 1.87 2/516 9980
/proc/meminfo: memFree=21639352/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=405208 CPUtime=4722.43 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 85565 0 0 0 472222 21 0 0 25 0 1 0 785522003 414932992 84986 33554432000 4194304 4394578 140737134557760 18446744073709551615 4292207 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 101302 84986 266 49 0 98443 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 405208

[startup+4782.3 s]
/proc/loadavg: 1.04 1.55 1.81 2/516 9981
/proc/meminfo: memFree=21630616/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=417692 CPUtime=4782.42 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 88166 0 0 0 478220 22 0 0 25 0 1 0 785522003 427716608 87587 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 104423 87587 266 49 0 101564 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 417692

[startup+4842.3 s]
/proc/loadavg: 1.01 1.45 1.76 2/516 9983
/proc/meminfo: memFree=21623108/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=425420 CPUtime=4842.42 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 89762 0 0 0 484220 22 0 0 25 0 1 0 785522003 435630080 89183 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298814 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 106355 89183 266 49 0 103496 0
Current children cumulated CPU time (s) 4842.42
Current children cumulated vsize (KiB) 425420

[startup+4902.3 s]
/proc/loadavg: 1.00 1.36 1.71 2/516 9984
/proc/meminfo: memFree=21617588/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=432588 CPUtime=4902.42 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 91253 0 0 0 490220 22 0 0 25 0 1 0 785522003 442970112 90674 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298338 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 108147 90674 266 49 0 105288 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 432588

[startup+4962.3 s]
/proc/loadavg: 1.00 1.30 1.66 2/516 9986
/proc/meminfo: memFree=21617420/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=432588 CPUtime=4962.43 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 91254 0 0 0 496220 23 0 0 25 0 1 0 785522003 442970112 90675 33554432000 4194304 4394578 140737134557760 18446744073709551615 4299384 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 108147 90675 266 49 0 105288 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 432588



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 1.16 1.29 1.64 2/516 9987
/proc/meminfo: memFree=21617504/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=432588 CPUtime=5000.04 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 91255 0 0 0 499981 23 0 0 25 0 1 0 785522003 442970112 90676 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298335 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 108147 90676 266 49 0 105288 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 432588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 1.16 1.29 1.64 2/516 9987
/proc/meminfo: memFree=21617504/32951124 swapFree=58800704/67111528
[pid=9820] ppid=9818 vsize=432588 CPUtime=5000.04 cores=0,2,4,6
/proc/9820/stat : 9820 (SApperloT2010) R 9818 9820 8575 0 -1 4202496 91255 0 0 0 499981 23 0 0 25 0 1 0 785522003 442970112 90676 33554432000 4194304 4394578 140737134557760 18446744073709551615 4298335 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/9820/statm: 108147 90676 266 49 0 105288 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 432588

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.94
CPU time (s): 5000.07
CPU user time (s): 4999.82
CPU system time (s): 0.247962
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 432588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.82
system time used= 0.247962
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 91255
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 5913

runsolver used 27.2669 second user time and 59.093 second system time

The end

Launcher Data 

Begin job on node142 at 2011-06-01 14:24:25
IDJOB=3439398
IDBENCH=84568
IDSOLVER=1933
FILE ID=node142/3439398-1306931065
RUNJOBID= node142-1306925663-9540
PBS_JOBID= 13488478
Free space on /tmp= 73852 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT04/handmade/kexu/frb-0.8/frb59-26-1.used-as.sat04-891.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439398-1306931065/watcher-3439398-1306931065 -o /tmp/evaluation-result-3439398-1306931065/solver-3439398-1306931065 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3439398-1306931065.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5877850d9f604b6973676132cbba5c90
RANDOM SEED=27545711

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21814600 kB
Buffers:        120376 kB
Cached:         182140 kB
SwapCached:      11420 kB
Active:        9245468 kB
Inactive:      1638792 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21814600 kB
SwapTotal:    67111528 kB
SwapFree:     58800704 kB
Dirty:            1976 kB
Writeback:           0 kB
AnonPages:    10579432 kB
Mapped:          32044 kB
Slab:           106208 kB
PageTables:      75328 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145589016 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73856 MiB
End job on node142 at 2011-06-01 15:47:47