Trace number 3438608

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.06 4999.93

General information on the benchmark

NameCRAFTED/sgi/
new-difficult-23-189-21-75.cnf
MD5SUM46a186d5aa9ba41a176adf24fb365342
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.140977
Satisfiable
(Un)Satisfiability was proved
Number of variables483
Number of clauses25396
Sum of the clauses size51233
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 225375
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438608-1306893960/watcher-3438608-1306893960 -o /tmp/evaluation-result-3438608-1306893960/solver-3438608-1306893960 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438608-1306893960.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.95 1.02 1.21 2/530 29659
/proc/meminfo: memFree=5945116/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=13496 CPUtime=0.01 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 747 0 0 0 1 0 0 0 23 0 1 0 781812310 13819904 686 33554432000 4194304 4394578 140734605006784 18446744073709551615 212039316165 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 3374 689 247 49 0 515 0

[startup+0.11718 s]
/proc/loadavg: 0.95 1.02 1.21 2/530 29659
/proc/meminfo: memFree=5945116/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=16728 CPUtime=0.1 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 1676 0 0 0 10 0 0 0 24 0 1 0 781812310 17129472 1514 33554432000 4194304 4394578 140734605006784 18446744073709551615 4296489 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 4182 1514 266 49 0 1323 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 16728

[startup+0.201165 s]
/proc/loadavg: 0.95 1.02 1.21 2/530 29659
/proc/meminfo: memFree=5945116/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=18196 CPUtime=0.19 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 2015 0 0 0 19 0 0 0 24 0 1 0 781812310 18632704 1853 33554432000 4194304 4394578 140734605006784 18446744073709551615 212039316165 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 4549 1853 266 49 0 1690 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 18196

[startup+0.301146 s]
/proc/loadavg: 0.95 1.02 1.21 2/530 29659
/proc/meminfo: memFree=5945116/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=19252 CPUtime=0.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 2301 0 0 0 29 0 0 0 25 0 1 0 781812310 19714048 2139 33554432000 4194304 4394578 140734605006784 18446744073709551615 4287357 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 4813 2139 266 49 0 1954 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 19252

[startup+0.701072 s]
/proc/loadavg: 0.95 1.02 1.21 2/530 29659
/proc/meminfo: memFree=5945116/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=21940 CPUtime=0.69 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 2954 0 0 0 69 0 0 0 25 0 1 0 781812310 22466560 2792 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298927 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 5485 2792 266 49 0 2626 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 21940

[startup+1.50097 s]
/proc/loadavg: 0.95 1.02 1.21 3/536 29668
/proc/meminfo: memFree=5930196/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=23740 CPUtime=1.48 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 3372 0 0 0 148 0 0 0 25 0 1 0 781812310 24309760 3210 33554432000 4194304 4394578 140734605006784 18446744073709551615 4285615 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 5935 3210 266 49 0 3076 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 23740

[startup+3.10068 s]
/proc/loadavg: 0.95 1.02 1.21 3/536 29668
/proc/meminfo: memFree=5926848/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=26088 CPUtime=3.08 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 3919 0 0 0 308 0 0 0 25 0 1 0 781812310 26714112 3757 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 6522 3757 266 49 0 3663 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 26088

[startup+6.3011 s]
/proc/loadavg: 1.03 1.03 1.22 3/536 29668
/proc/meminfo: memFree=5922884/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=30164 CPUtime=6.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 4798 0 0 0 628 1 0 0 25 0 1 0 781812310 30887936 4636 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 7541 4636 266 49 0 4682 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 30164

[startup+12.7009 s]
/proc/loadavg: 1.11 1.05 1.22 3/536 29668
/proc/meminfo: memFree=5915104/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=35764 CPUtime=12.69 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 5985 0 0 0 1268 1 0 0 25 0 1 0 781812310 36622336 5823 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 8941 5823 266 49 0 6082 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 35764

[startup+25.5007 s]
/proc/loadavg: 1.45 1.13 1.24 3/536 29669
/proc/meminfo: memFree=5909400/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=43192 CPUtime=25.49 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 7573 0 0 0 2548 1 0 0 25 0 1 0 781812310 44228608 7411 33554432000 4194304 4394578 140734605006784 18446744073709551615 4296472 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 10798 7411 266 49 0 7939 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 43192

[startup+51.1011 s]
/proc/loadavg: 1.64 1.19 1.26 3/536 29670
/proc/meminfo: memFree=5899080/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=55204 CPUtime=51.09 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 10038 0 0 0 5108 1 0 0 25 0 1 0 781812310 56528896 9876 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 13801 9876 266 49 0 10942 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 55204

[startup+102.301 s]
/proc/loadavg: 2.02 1.36 1.31 3/536 29671
/proc/meminfo: memFree=5891120/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=65116 CPUtime=102.3 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 12002 0 0 0 10229 1 0 0 25 0 1 0 781812310 66678784 11840 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 16279 11840 266 49 0 13420 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 65116

[startup+162.301 s]
/proc/loadavg: 2.06 1.49 1.36 3/536 29672
/proc/meminfo: memFree=5877800/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=77428 CPUtime=162.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 14537 0 0 0 16227 2 0 0 25 0 1 0 781812310 79286272 14375 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 19357 14375 266 49 0 16498 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 77428

[startup+222.32 s]
/proc/loadavg: 1.97 1.57 1.39 3/536 29701
/proc/meminfo: memFree=5870392/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=85480 CPUtime=222.31 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 16179 0 0 0 22229 2 0 0 25 0 1 0 781812310 87531520 16017 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 21370 16017 266 49 0 18511 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 85480

[startup+282.301 s]
/proc/loadavg: 1.99 1.64 1.43 3/536 29703
/proc/meminfo: memFree=5865496/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=89648 CPUtime=282.3 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 17080 0 0 0 28227 3 0 0 25 0 1 0 781812310 91799552 16918 33554432000 4194304 4394578 140734605006784 18446744073709551615 4296785 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 22412 16918 266 49 0 19553 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 89648

[startup+342.301 s]
/proc/loadavg: 1.99 1.70 1.46 3/536 29704
/proc/meminfo: memFree=5860992/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=95044 CPUtime=342.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 18186 0 0 0 34226 3 0 0 25 0 1 0 781812310 97325056 18024 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 23761 18024 266 49 0 20902 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 95044

[startup+402.3 s]
/proc/loadavg: 1.99 1.76 1.49 3/536 29706
/proc/meminfo: memFree=5858224/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=97716 CPUtime=402.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 18830 0 0 0 40226 3 0 0 25 0 1 0 781812310 100061184 18668 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 24429 18668 266 49 0 21570 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 97716

[startup+462.301 s]
/proc/loadavg: 1.99 1.80 1.52 3/536 29707
/proc/meminfo: memFree=5856692/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=99228 CPUtime=462.29 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 19176 0 0 0 46226 3 0 0 25 0 1 0 781812310 101609472 19014 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298841 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 24807 19014 266 49 0 21948 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 99228

[startup+522.301 s]
/proc/loadavg: 1.99 1.83 1.55 3/536 29709
/proc/meminfo: memFree=5854192/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=102340 CPUtime=522.3 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 19818 0 0 0 52227 3 0 0 25 0 1 0 781812310 104796160 19656 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 25585 19656 266 49 0 22726 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 102340

[startup+582.301 s]
/proc/loadavg: 1.99 1.86 1.57 3/536 29711
/proc/meminfo: memFree=5850052/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=107268 CPUtime=582.31 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 20804 0 0 0 58227 4 0 0 25 0 1 0 781812310 109842432 20642 33554432000 4194304 4394578 140734605006784 18446744073709551615 4291928 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 26817 20642 266 49 0 23958 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 107268

[startup+642.3 s]

################
# More data... #
################

[startup+4002.3 s]
/proc/loadavg: 2.16 2.04 2.01 3/536 29820
/proc/meminfo: memFree=5791816/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=180588 CPUtime=4002.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 34950 0 0 0 400231 9 0 0 25 0 1 0 781812310 184922112 34373 33554432000 4194304 4394578 140734605006784 18446744073709551615 4315594 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 45147 34373 267 49 0 42288 0
Current children cumulated CPU time (s) 4002.4
Current children cumulated vsize (KiB) 180588

[startup+4062.3 s]
/proc/loadavg: 2.27 2.09 2.03 3/536 29822
/proc/meminfo: memFree=5788920/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=182636 CPUtime=4062.41 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35421 0 0 0 406232 9 0 0 25 0 1 0 781812310 187019264 34844 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 45659 34844 267 49 0 42800 0
Current children cumulated CPU time (s) 4062.41
Current children cumulated vsize (KiB) 182636

[startup+4122.3 s]
/proc/loadavg: 2.10 2.07 2.02 3/536 29823
/proc/meminfo: memFree=5789512/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=183404 CPUtime=4122.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35557 0 0 0 412231 9 0 0 25 0 1 0 781812310 187805696 34980 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298721 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 45851 34980 267 49 0 42992 0
Current children cumulated CPU time (s) 4122.4
Current children cumulated vsize (KiB) 183404

[startup+4182.32 s]
/proc/loadavg: 2.03 2.05 2.01 3/536 29825
/proc/meminfo: memFree=5788964/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=184172 CPUtime=4182.42 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35690 0 0 0 418233 9 0 0 25 0 1 0 781812310 188592128 35113 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46043 35113 267 49 0 43184 0
Current children cumulated CPU time (s) 4182.42
Current children cumulated vsize (KiB) 184172

[startup+4242.3 s]
/proc/loadavg: 2.01 2.04 2.01 3/536 29826
/proc/meminfo: memFree=5788428/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=184428 CPUtime=4242.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35732 0 0 0 424231 9 0 0 25 0 1 0 781812310 188854272 35155 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46107 35155 267 49 0 43248 0
Current children cumulated CPU time (s) 4242.4
Current children cumulated vsize (KiB) 184428

[startup+4302.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/536 29828
/proc/meminfo: memFree=5788252/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=185068 CPUtime=4302.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35861 0 0 0 430231 9 0 0 25 0 1 0 781812310 189509632 35284 33554432000 4194304 4394578 140734605006784 18446744073709551615 4287909 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46267 35284 267 49 0 43408 0
Current children cumulated CPU time (s) 4302.4
Current children cumulated vsize (KiB) 185068

[startup+4362.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/536 29829
/proc/meminfo: memFree=5787960/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=185516 CPUtime=4362.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 35961 0 0 0 436231 9 0 0 25 0 1 0 781812310 189968384 35384 33554432000 4194304 4394578 140734605006784 18446744073709551615 4299387 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46379 35384 267 49 0 43520 0
Current children cumulated CPU time (s) 4362.4
Current children cumulated vsize (KiB) 185516

[startup+4422.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/536 29831
/proc/meminfo: memFree=5787296/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=186156 CPUtime=4422.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36069 0 0 0 442231 9 0 0 25 0 1 0 781812310 190623744 35492 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46539 35492 267 49 0 43680 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 186156

[startup+4482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/536 29833
/proc/meminfo: memFree=5786880/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=186796 CPUtime=4482.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36179 0 0 0 448231 9 0 0 25 0 1 0 781812310 191279104 35602 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46699 35602 267 49 0 43840 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 186796

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/536 29834
/proc/meminfo: memFree=5786580/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=187308 CPUtime=4542.4 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36265 0 0 0 454231 9 0 0 25 0 1 0 781812310 191803392 35688 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 46827 35688 267 49 0 43968 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 187308

[startup+4602.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/536 29836
/proc/meminfo: memFree=5784920/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=188076 CPUtime=4602.41 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36380 0 0 0 460232 9 0 0 25 0 1 0 781812310 192589824 35803 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47019 35803 267 49 0 44160 0
Current children cumulated CPU time (s) 4602.41
Current children cumulated vsize (KiB) 188076

[startup+4662.3 s]
/proc/loadavg: 2.12 2.06 2.02 3/536 29837
/proc/meminfo: memFree=5784500/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=188332 CPUtime=4662.41 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36452 0 0 0 466232 9 0 0 25 0 1 0 781812310 192851968 35875 33554432000 4194304 4394578 140734605006784 18446744073709551615 4338278 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47083 35875 267 49 0 44224 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 188332

[startup+4722.3 s]
/proc/loadavg: 2.04 2.05 2.01 3/536 29839
/proc/meminfo: memFree=5783960/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=188332 CPUtime=4722.43 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36460 0 0 0 472233 10 0 0 25 0 1 0 781812310 192851968 35883 33554432000 4194304 4394578 140734605006784 18446744073709551615 4316134 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47083 35883 267 49 0 44224 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 188332

[startup+4782.3 s]
/proc/loadavg: 2.06 2.05 2.01 3/536 29844
/proc/meminfo: memFree=5782504/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=189740 CPUtime=4782.42 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36717 0 0 0 478232 10 0 0 25 0 1 0 781812310 194293760 36140 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47435 36140 267 49 0 44576 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 189740

[startup+4842.32 s]
/proc/loadavg: 2.02 2.04 2.00 3/536 29845
/proc/meminfo: memFree=5783080/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=189932 CPUtime=4842.43 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36773 0 0 0 484233 10 0 0 25 0 1 0 781812310 194490368 36196 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47483 36196 267 49 0 44624 0
Current children cumulated CPU time (s) 4842.43
Current children cumulated vsize (KiB) 189932

[startup+4902.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/536 29847
/proc/meminfo: memFree=5784144/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=190572 CPUtime=4902.41 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36853 0 0 0 490231 10 0 0 25 0 1 0 781812310 195145728 36276 33554432000 4194304 4394578 140734605006784 18446744073709551615 4327288 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47643 36276 267 49 0 44784 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 190572

[startup+4962.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/536 29848
/proc/meminfo: memFree=5783852/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=191212 CPUtime=4962.42 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 36949 0 0 0 496232 10 0 0 25 0 1 0 781812310 195801088 36372 33554432000 4194304 4394578 140734605006784 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47803 36372 267 49 0 44944 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 191212



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.00 2.02 2.00 3/536 29850
/proc/meminfo: memFree=5783216/32951124 swapFree=50328308/67111528
[pid=29659] ppid=29657 vsize=191724 CPUtime=5000.03 cores=0,2,4,6
/proc/29659/stat : 29659 (SApperloT2010) R 29657 29659 28304 0 -1 4202496 37042 0 0 0 499993 10 0 0 25 0 1 0 781812310 196325376 36465 33554432000 4194304 4394578 140734605006784 18446744073709551615 4315321 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/29659/statm: 47931 36465 267 49 0 45072 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 191724

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.93
CPU time (s): 5000.06
CPU user time (s): 4999.94
CPU system time (s): 0.114982
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 191724

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.94
system time used= 0.114982
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37042
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 7027

runsolver used 27.7618 second user time and 58.6271 second system time

The end

Launcher Data 

Begin job on node146 at 2011-06-01 04:06:00
IDJOB=3438608
IDBENCH=71805
IDSOLVER=1933
FILE ID=node146/3438608-1306893960
RUNJOBID= node146-1306893960-29647
PBS_JOBID= 13488430
Free space on /tmp= 48476 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/sgi/new-difficult-23-189-21-75.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438608-1306893960/watcher-3438608-1306893960 -o /tmp/evaluation-result-3438608-1306893960/solver-3438608-1306893960 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438608-1306893960.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 46a186d5aa9ba41a176adf24fb365342
RANDOM SEED=876732083

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       5945280 kB
Buffers:        102716 kB
Cached:       15773784 kB
SwapCached:       9228 kB
Active:       17563536 kB
Inactive:      8751700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       5945280 kB
SwapTotal:    67111528 kB
SwapFree:     50328308 kB
Dirty:             408 kB
Writeback:           0 kB
AnonPages:    10437080 kB
Mapped:          27616 kB
Slab:           522888 kB
PageTables:      97472 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 160669752 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 48476 MiB
End job on node146 at 2011-06-01 05:29:22