Trace number 3439083

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.14 5000.02

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4232.cnf
MD5SUM86d9f733c618d2ca060f457ab8a19463
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4230
Number of clauses100443
Sum of the clauses size411786
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490429
Number of clauses of size 510014
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439083-1307641990/watcher-3439083-1307641990 -o /tmp/evaluation-result-3439083-1307641990/solver-3439083-1307641990 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3439083-1307641990.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.02 2.00 2/177 27843
/proc/meminfo: memFree=32110616/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=14288 CPUtime=0 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 788 0 0 0 0 0 0 0 25 0 1 0 875798692 14630912 728 33554432000 4194304 4394578 140734711631888 18446744073709551615 274473967360 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 3572 728 247 49 0 713 0

[startup+0.0405851 s]
/proc/loadavg: 2.06 2.02 2.00 2/177 27843
/proc/meminfo: memFree=32110616/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=19304 CPUtime=0.03 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 2053 0 0 0 3 0 0 0 25 0 1 0 875798692 19767296 1993 33554432000 4194304 4394578 140734711631888 18446744073709551615 274473628357 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 4826 1995 247 49 0 1967 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 19304

[startup+0.100632 s]
/proc/loadavg: 2.06 2.02 2.00 2/177 27843
/proc/meminfo: memFree=32110616/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=25832 CPUtime=0.09 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 3678 0 0 0 9 0 0 0 25 0 1 0 875798692 26451968 3617 33554432000 4194304 4394578 140734711631888 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 6458 3617 255 49 0 3599 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25832

[startup+0.300598 s]
/proc/loadavg: 2.06 2.02 2.00 2/177 27843
/proc/meminfo: memFree=32110616/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=38908 CPUtime=0.29 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 7556 0 0 0 28 1 0 0 25 0 1 0 875798692 39841792 7101 33554432000 4194304 4394578 140734711631888 18446744073709551615 4299025 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 9727 7102 266 49 0 6868 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 38908

[startup+0.700531 s]
/proc/loadavg: 2.06 2.02 2.00 2/177 27843
/proc/meminfo: memFree=32110616/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=43264 CPUtime=0.69 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 8639 0 0 0 68 1 0 0 25 0 1 0 875798692 44302336 8184 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 10816 8185 266 49 0 7957 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 43264

[startup+1.50034 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 27844
/proc/meminfo: memFree=32076664/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=49720 CPUtime=1.49 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 10220 0 0 0 148 1 0 0 25 0 1 0 875798692 50913280 9765 33554432000 4194304 4394578 140734711631888 18446744073709551615 4287934 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 12430 9765 266 49 0 9571 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 49720

[startup+3.10111 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 27844
/proc/meminfo: memFree=32068480/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=60288 CPUtime=3.09 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 12816 0 0 0 307 2 0 0 25 0 1 0 875798692 61734912 12361 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 15072 12361 266 49 0 12213 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 60288

[startup+6.30055 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 27844
/proc/meminfo: memFree=32057744/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=69140 CPUtime=6.29 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 15023 0 0 0 626 3 0 0 25 0 1 0 875798692 70799360 14568 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 17285 14569 266 49 0 14426 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 69140

[startup+12.7004 s]
/proc/loadavg: 2.04 2.02 2.00 3/178 27844
/proc/meminfo: memFree=32042384/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=80100 CPUtime=12.69 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 17635 0 0 0 1265 4 0 0 25 0 1 0 875798692 82022400 17180 33554432000 4194304 4394578 140734711631888 18446744073709551615 4296366 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 20025 17180 266 49 0 17166 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 80100

[startup+25.5012 s]
/proc/loadavg: 2.04 2.02 2.00 3/178 27844
/proc/meminfo: memFree=32022540/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=100864 CPUtime=25.49 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 22592 0 0 0 2544 5 0 0 25 0 1 0 875798692 103284736 22137 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298940 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 25216 22137 266 49 0 22357 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 100864

[startup+51.1006 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 27845
/proc/meminfo: memFree=32006232/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=121176 CPUtime=51.09 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 27036 0 0 0 5103 6 0 0 25 0 1 0 875798692 124084224 26581 33554432000 4194304 4394578 140734711631888 18446744073709551615 274473628357 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 30294 26581 266 49 0 27435 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 121176

[startup+102.307 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 27846
/proc/meminfo: memFree=31951012/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=177416 CPUtime=102.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 40268 0 0 0 10222 8 0 0 25 0 1 0 875798692 181673984 39813 33554432000 4194304 4394578 140734711631888 18446744073709551615 4346306 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 44354 39813 266 49 0 41495 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 177416

[startup+162.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 27848
/proc/meminfo: memFree=31901232/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=231796 CPUtime=162.29 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 53252 0 0 0 16219 10 0 0 25 0 1 0 875798692 237359104 52797 33554432000 4194304 4394578 140734711631888 18446744073709551615 4346169 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 57949 52797 266 49 0 55090 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 231796

[startup+222.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27849
/proc/meminfo: memFree=31855148/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=279084 CPUtime=222.29 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 64116 0 0 0 22217 12 0 0 25 0 1 0 875798692 285782016 63661 33554432000 4194304 4394578 140734711631888 18446744073709551615 4291928 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 69771 63661 266 49 0 66912 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 279084

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27890
/proc/meminfo: memFree=31780408/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=362112 CPUtime=282.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 84435 0 0 0 28213 17 0 0 25 0 1 0 875798692 370802688 83980 33554432000 4194304 4394578 140734711631888 18446744073709551615 4327688 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 90528 83980 266 49 0 87669 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 362112

[startup+342.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 27892
/proc/meminfo: memFree=31694912/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=418536 CPUtime=342.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 98008 0 0 0 34211 19 0 0 25 0 1 0 875798692 428580864 97553 33554432000 4194304 4394578 140734711631888 18446744073709551615 4292833 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 104634 97554 266 49 0 101775 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 418536

[startup+402.301 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 27893
/proc/meminfo: memFree=31647848/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=441060 CPUtime=402.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 103442 0 0 0 40209 21 0 0 25 0 1 0 875798692 451645440 102987 33554432000 4194304 4394578 140734711631888 18446744073709551615 4291928 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 110265 102987 266 49 0 107406 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 441060

[startup+462.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 27895
/proc/meminfo: memFree=31549204/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=508768 CPUtime=462.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 120009 0 0 0 46206 24 0 0 25 0 1 0 875798692 520978432 119554 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 127192 119554 266 49 0 124333 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 508768

[startup+522.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27905
/proc/meminfo: memFree=31512080/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=524016 CPUtime=522.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 123186 0 0 0 52206 24 0 0 25 0 1 0 875798692 536592384 122731 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 131004 122731 266 49 0 128145 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 524016

[startup+582.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27907
/proc/meminfo: memFree=31473576/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=553304 CPUtime=582.3 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 129943 0 0 0 58205 25 0 0 25 0 1 0 875798692 566583296 129488 33554432000 4194304 4394578 140734711631888 18446744073709551615 4346330 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 138326 129488 266 49 0 135467 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 553304

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28041
/proc/meminfo: memFree=28991656/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2425684 CPUtime=4062.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 584777 0 0 0 406124 116 0 0 25 0 1 0 875798692 2483900416 584322 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298795 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 606421 584322 266 49 0 603562 0
Current children cumulated CPU time (s) 4062.4
Current children cumulated vsize (KiB) 2425684

[startup+4122.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/178 28051
/proc/meminfo: memFree=28958468/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2439968 CPUtime=4122.39 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 587979 0 0 0 412122 117 0 0 25 0 1 0 875798692 2498527232 587524 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 609992 587524 266 49 0 607133 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 2439968

[startup+4182.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 28053
/proc/meminfo: memFree=28873212/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2510708 CPUtime=4182.39 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 605707 0 0 0 418119 120 0 0 25 0 1 0 875798692 2570964992 605252 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 627677 605252 266 49 0 624818 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 2510708

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28055
/proc/meminfo: memFree=28808900/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2563992 CPUtime=4242.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 618711 0 0 0 424116 124 0 0 25 0 1 0 875798692 2625527808 618256 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 640998 618256 266 49 0 638139 0
Current children cumulated CPU time (s) 4242.4
Current children cumulated vsize (KiB) 2563992

[startup+4302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28059
/proc/meminfo: memFree=28771816/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2590404 CPUtime=4302.39 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 624699 0 0 0 430114 125 0 0 25 0 1 0 875798692 2652573696 624244 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 647601 624244 266 49 0 644742 0
Current children cumulated CPU time (s) 4302.39
Current children cumulated vsize (KiB) 2590404

[startup+4362.3 s]
/proc/loadavg: 2.10 2.03 2.01 3/178 28061
/proc/meminfo: memFree=28749796/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2595612 CPUtime=4362.39 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 625807 0 0 0 436114 125 0 0 25 0 1 0 875798692 2657906688 625352 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298350 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 648903 625352 266 49 0 646044 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 2595612

[startup+4422.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/178 28062
/proc/meminfo: memFree=28743416/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2604068 CPUtime=4422.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 627445 0 0 0 442114 126 0 0 25 0 1 0 875798692 2666565632 626990 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 651017 626990 266 49 0 648158 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 2604068

[startup+4482.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/178 28064
/proc/meminfo: memFree=28722512/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2607140 CPUtime=4482.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 628274 0 0 0 448114 126 0 0 25 0 1 0 875798692 2669711360 627819 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298795 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 651785 627819 266 49 0 648926 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 2607140

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 28066
/proc/meminfo: memFree=28670240/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2655456 CPUtime=4542.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 640259 0 0 0 454112 128 0 0 25 0 1 0 875798692 2719186944 639804 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 663864 639804 266 49 0 661005 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 2655456

[startup+4602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28067
/proc/meminfo: memFree=28621564/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2699252 CPUtime=4602.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 651052 0 0 0 460112 128 0 0 25 0 1 0 875798692 2764034048 650597 33554432000 4194304 4394578 140734711631888 18446744073709551615 4296366 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 674813 650597 266 49 0 671954 0
Current children cumulated CPU time (s) 4602.4
Current children cumulated vsize (KiB) 2699252

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28069
/proc/meminfo: memFree=28540288/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2774252 CPUtime=4662.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 669609 0 0 0 466109 131 0 0 25 0 1 0 875798692 2840834048 669154 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 693563 669154 266 49 0 690704 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 2774252

[startup+4722.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28070
/proc/meminfo: memFree=28477964/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2809836 CPUtime=4722.41 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 678463 0 0 0 472107 134 0 0 25 0 1 0 875798692 2877272064 678008 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298807 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 702459 678008 266 49 0 699600 0
Current children cumulated CPU time (s) 4722.41
Current children cumulated vsize (KiB) 2809836

[startup+4782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28072
/proc/meminfo: memFree=28451864/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2835140 CPUtime=4782.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 684642 0 0 0 478105 135 0 0 25 0 1 0 875798692 2903183360 684187 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 708785 684187 266 49 0 705926 0
Current children cumulated CPU time (s) 4782.4
Current children cumulated vsize (KiB) 2835140

[startup+4842.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28074
/proc/meminfo: memFree=28424528/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2861544 CPUtime=4842.41 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 691163 0 0 0 484104 137 0 0 25 0 1 0 875798692 2930221056 690708 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 715386 690708 266 49 0 712527 0
Current children cumulated CPU time (s) 4842.41
Current children cumulated vsize (KiB) 2861544

[startup+4902.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 28075
/proc/meminfo: memFree=28331580/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2936892 CPUtime=4902.41 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 709920 0 0 0 490101 140 0 0 25 0 1 0 875798692 3007377408 709465 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 734223 709465 266 49 0 731364 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 2936892

[startup+4962.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/178 28077
/proc/meminfo: memFree=28255752/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=2993476 CPUtime=4962.4 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 723936 0 0 0 496098 142 0 0 25 0 1 0 875798692 3065319424 723481 33554432000 4194304 4394578 140734711631888 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 748369 723481 266 49 0 745510 0
Current children cumulated CPU time (s) 4962.4
Current children cumulated vsize (KiB) 2993476



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 28078
/proc/meminfo: memFree=28225956/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=3016792 CPUtime=5000.02 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4202496 729737 0 0 0 499858 144 0 0 25 0 1 0 875798692 3089195008 729282 33554432000 4194304 4394578 140734711631888 18446744073709551615 4296366 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/27843/statm: 754198 729282 266 49 0 751339 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 3016792

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.01 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 28078
/proc/meminfo: memFree=28225956/32950928 swapFree=67079488/67111528
[pid=27843] ppid=27841 vsize=0 CPUtime=5000.12 cores=0,2,4,6
/proc/27843/stat : 27843 (SApperloT2010) R 27841 27843 27203 0 -1 4203524 729737 0 0 0 499858 154 0 0 25 0 1 0 875798692 0 0 33554432000 0 0 0 0 0 0 0 4096 6 18446744073709551615 0 0 17 4 0 0 0
/proc/27843/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.02
CPU time (s): 5000.14
CPU user time (s): 4998.58
CPU system time (s): 1.55476
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 3016792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4998.58
system time used= 1.55476
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 729737
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 11210

runsolver used 7.83981 second user time and 16.0416 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-09 19:53:10
IDJOB=3439083
IDBENCH=83254
IDSOLVER=1933
FILE ID=node125/3439083-1307641990
RUNJOBID= node125-1307636988-27591
PBS_JOBID= 13549397
Free space on /tmp= 74060 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4232.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439083-1307641990/watcher-3439083-1307641990 -o /tmp/evaluation-result-3439083-1307641990/solver-3439083-1307641990 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3439083-1307641990.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 86d9f733c618d2ca060f457ab8a19463
RANDOM SEED=1589997070

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32111044 kB
Buffers:        202796 kB
Cached:         384160 kB
SwapCached:       3400 kB
Active:         337708 kB
Inactive:       306556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32111044 kB
SwapTotal:    67111528 kB
SwapFree:     67079488 kB
Dirty:            2356 kB
Writeback:          12 kB
AnonPages:       55488 kB
Mapped:          14108 kB
Slab:           130020 kB
PageTables:       4572 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   230700 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74060 MiB
End job on node125 at 2011-06-09 21:16:32