Trace number 3439568

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.11 5000.02

General information on the benchmark

NameSAT05/crafted/sorge05/QG7a/
gensys-ukn006.shuffled-as.sat05-3846.cnf
MD5SUMf38a91a0947f21d9ceeb8762ba4c5f93
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark862.725
Satisfiable
(Un)Satisfiability was proved
Number of variables2969
Number of clauses18473
Sum of the clauses size132415
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 2442
Number of clauses of size 32342
Number of clauses of size 4463
Number of clauses of size 5642
Number of clauses of size over 514542

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439568-1306936727/watcher-3439568-1306936727 -o /tmp/evaluation-result-3439568-1306936727/solver-3439568-1306936727 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3439568-1306936727.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.04 2.00 1/493 31924
/proc/meminfo: memFree=29237788/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=13940 CPUtime=0.01 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 876 0 0 0 1 0 0 0 23 0 1 0 805272339 14274560 815 33554432000 4194304 4394578 140736940657360 18446744073709551615 210646807237 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 3485 816 247 49 0 626 0

[startup+0.111942 s]
/proc/loadavg: 2.01 2.04 2.00 1/493 31924
/proc/meminfo: memFree=29237788/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=15688 CPUtime=0.1 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 1314 0 0 0 10 0 0 0 24 0 1 0 805272339 16064512 1143 33554432000 4194304 4394578 140736940657360 18446744073709551615 210647170967 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 3922 1143 255 49 0 1063 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15688

[startup+0.200926 s]
/proc/loadavg: 2.01 2.04 2.00 1/493 31924
/proc/meminfo: memFree=29237788/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=19244 CPUtime=0.19 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 2316 0 0 0 19 0 0 0 24 0 1 0 805272339 19705856 2137 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 4811 2137 267 49 0 1952 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 19244

[startup+0.300909 s]
/proc/loadavg: 2.01 2.04 2.00 1/493 31924
/proc/meminfo: memFree=29237788/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=20484 CPUtime=0.29 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 2626 0 0 0 29 0 0 0 25 0 1 0 805272339 20975616 2447 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 5121 2447 267 49 0 2262 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 20484

[startup+0.700852 s]
/proc/loadavg: 2.01 2.04 2.00 1/493 31924
/proc/meminfo: memFree=29237788/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=21940 CPUtime=0.69 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 2986 0 0 0 69 0 0 0 25 0 1 0 805272339 22466560 2807 33554432000 4194304 4394578 140736940657360 18446744073709551615 4299025 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 5485 2807 267 49 0 2626 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 21940

[startup+1.50072 s]
/proc/loadavg: 2.01 2.04 2.00 3/499 31935
/proc/meminfo: memFree=29212568/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=23272 CPUtime=1.49 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 3305 0 0 0 149 0 0 0 25 0 1 0 805272339 23830528 3126 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298814 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 5818 3126 267 49 0 2959 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 23272

[startup+3.10045 s]
/proc/loadavg: 2.01 2.04 2.00 3/499 31935
/proc/meminfo: memFree=29208848/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=24988 CPUtime=3.09 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 3703 0 0 0 309 0 0 0 25 0 1 0 805272339 25587712 3524 33554432000 4194304 4394578 140736940657360 18446744073709551615 210647170967 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 6247 3524 267 49 0 3388 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 24988

[startup+6.30091 s]
/proc/loadavg: 2.09 2.06 2.01 3/499 31935
/proc/meminfo: memFree=29204256/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=27668 CPUtime=6.29 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 4290 0 0 0 629 0 0 0 25 0 1 0 805272339 28332032 4111 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 6917 4111 267 49 0 4058 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 27668

[startup+12.7008 s]
/proc/loadavg: 2.08 2.06 2.00 3/499 31935
/proc/meminfo: memFree=29197356/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=30612 CPUtime=12.7 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 4928 0 0 0 1269 1 0 0 25 0 1 0 805272339 31346688 4749 33554432000 4194304 4394578 140736940657360 18446744073709551615 4323474 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 7653 4749 267 49 0 4794 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 30612

[startup+25.5007 s]
/proc/loadavg: 2.06 2.05 2.00 3/499 31935
/proc/meminfo: memFree=29190936/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=34544 CPUtime=25.49 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 5776 0 0 0 2548 1 0 0 25 0 1 0 805272339 35373056 5597 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298733 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 8636 5597 267 49 0 5777 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 34544

[startup+51.1004 s]
/proc/loadavg: 2.04 2.05 2.00 3/499 31935
/proc/meminfo: memFree=29183232/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=38976 CPUtime=51.09 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 6754 0 0 0 5108 1 0 0 25 0 1 0 805272339 39911424 6575 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 9744 6575 267 49 0 6885 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 38976

[startup+102.301 s]
/proc/loadavg: 2.06 2.05 2.00 3/499 31937
/proc/meminfo: memFree=29168704/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=48072 CPUtime=102.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 8740 0 0 0 10229 1 0 0 25 0 1 0 805272339 49225728 8561 33554432000 4194304 4394578 140736940657360 18446744073709551615 4308896 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 12018 8561 267 49 0 9159 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 48072

[startup+162.301 s]
/proc/loadavg: 2.02 2.04 2.00 3/499 31948
/proc/meminfo: memFree=29156840/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=54192 CPUtime=162.29 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 10020 0 0 0 16227 2 0 0 25 0 1 0 805272339 55492608 9841 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 13548 9841 267 49 0 10689 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 54192

[startup+222.318 s]
/proc/loadavg: 2.01 2.03 2.00 3/499 31950
/proc/meminfo: memFree=29149012/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=60616 CPUtime=222.31 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 11507 0 0 0 22229 2 0 0 25 0 1 0 805272339 62070784 11328 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298679 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 15154 11328 267 49 0 12295 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 60616

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/499 31950
/proc/meminfo: memFree=29145776/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=64096 CPUtime=282.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 12272 0 0 0 28227 3 0 0 25 0 1 0 805272339 65634304 12093 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298792 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 16024 12093 267 49 0 13165 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 64096

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/499 31952
/proc/meminfo: memFree=29135840/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=71568 CPUtime=342.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 13763 0 0 0 34227 3 0 0 25 0 1 0 805272339 73285632 13584 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 17892 13584 267 49 0 15033 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 71568

[startup+402.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/499 31954
/proc/meminfo: memFree=29130372/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=77036 CPUtime=402.29 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 14913 0 0 0 40226 3 0 0 25 0 1 0 805272339 78884864 14734 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298966 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 19259 14734 267 49 0 16400 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 77036

[startup+462.301 s]
/proc/loadavg: 2.05 2.02 2.00 3/499 31959
/proc/meminfo: memFree=29124716/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=80936 CPUtime=462.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 15769 0 0 0 46226 4 0 0 25 0 1 0 805272339 82878464 15590 33554432000 4194304 4394578 140736940657360 18446744073709551615 4291296 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 20234 15590 267 49 0 17375 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 80936

[startup+522.301 s]
/proc/loadavg: 2.12 2.05 2.01 3/499 31961
/proc/meminfo: memFree=29120532/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=84588 CPUtime=522.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 16603 0 0 0 52226 4 0 0 25 0 1 0 805272339 86618112 16424 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 21147 16424 267 49 0 18288 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 84588

[startup+582.301 s]
/proc/loadavg: 2.09 2.05 2.01 3/499 31961
/proc/meminfo: memFree=29116668/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=88656 CPUtime=582.3 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 17371 0 0 0 58226 4 0 0 25 0 1 0 805272339 90783744 17192 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298993 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 22164 17192 267 49 0 19305 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 88656

[startup+642.3 s]

################
# More data... #
################

[startup+4062.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/499 32067
/proc/meminfo: memFree=29041800/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=139272 CPUtime=4062.38 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29296 0 0 0 406226 12 0 0 25 0 1 0 805272339 142614528 29067 33554432000 4194304 4394578 140736940657360 18446744073709551615 4287907 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 34818 29067 267 49 0 31959 0
Current children cumulated CPU time (s) 4062.38
Current children cumulated vsize (KiB) 139272

[startup+4122.3 s]
/proc/loadavg: 2.10 2.06 2.01 3/499 32069
/proc/meminfo: memFree=29041752/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=139544 CPUtime=4122.36 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29374 0 0 0 412224 12 0 0 25 0 1 0 805272339 142893056 29145 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298298 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 34886 29145 267 49 0 32027 0
Current children cumulated CPU time (s) 4122.36
Current children cumulated vsize (KiB) 139544

[startup+4182.32 s]
/proc/loadavg: 2.03 2.05 2.01 3/499 32069
/proc/meminfo: memFree=29041624/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140064 CPUtime=4182.38 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29463 0 0 0 418226 12 0 0 25 0 1 0 805272339 143425536 29234 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35016 29234 267 49 0 32157 0
Current children cumulated CPU time (s) 4182.38
Current children cumulated vsize (KiB) 140064

[startup+4242.3 s]
/proc/loadavg: 2.10 2.07 2.01 3/499 32071
/proc/meminfo: memFree=29041368/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140248 CPUtime=4242.36 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29504 0 0 0 424224 12 0 0 25 0 1 0 805272339 143613952 29275 33554432000 4194304 4394578 140736940657360 18446744073709551615 4287234 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35062 29275 267 49 0 32203 0
Current children cumulated CPU time (s) 4242.36
Current children cumulated vsize (KiB) 140248

[startup+4302.3 s]
/proc/loadavg: 2.08 2.06 2.01 3/499 32073
/proc/meminfo: memFree=29040860/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140456 CPUtime=4302.36 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29555 0 0 0 430224 12 0 0 25 0 1 0 805272339 143826944 29326 33554432000 4194304 4394578 140736940657360 18446744073709551615 4327612 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35114 29326 267 49 0 32255 0
Current children cumulated CPU time (s) 4302.36
Current children cumulated vsize (KiB) 140456

[startup+4362.3 s]
/proc/loadavg: 2.03 2.05 2.00 3/499 32075
/proc/meminfo: memFree=29040976/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140456 CPUtime=4362.36 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29580 0 0 0 436224 12 0 0 25 0 1 0 805272339 143826944 29351 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298841 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35114 29351 267 49 0 32255 0
Current children cumulated CPU time (s) 4362.36
Current children cumulated vsize (KiB) 140456

[startup+4422.3 s]
/proc/loadavg: 2.01 2.04 2.00 3/499 32077
/proc/meminfo: memFree=29040716/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140648 CPUtime=4422.36 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29597 0 0 0 442224 12 0 0 25 0 1 0 805272339 144023552 29368 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298862 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35162 29368 267 49 0 32303 0
Current children cumulated CPU time (s) 4422.36
Current children cumulated vsize (KiB) 140648

[startup+4482.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/499 32077
/proc/meminfo: memFree=29040464/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=140648 CPUtime=4482.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29606 0 0 0 448224 13 0 0 25 0 1 0 805272339 144023552 29377 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298841 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35162 29377 267 49 0 32303 0
Current children cumulated CPU time (s) 4482.37
Current children cumulated vsize (KiB) 140648

[startup+4542.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/499 32079
/proc/meminfo: memFree=29040072/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141032 CPUtime=4542.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29674 0 0 0 454224 13 0 0 25 0 1 0 805272339 144416768 29445 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298804 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35258 29445 267 49 0 32399 0
Current children cumulated CPU time (s) 4542.37
Current children cumulated vsize (KiB) 141032

[startup+4602.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/499 32081
/proc/meminfo: memFree=29038700/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141224 CPUtime=4602.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29704 0 0 0 460224 13 0 0 25 0 1 0 805272339 144613376 29475 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298693 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35306 29475 267 49 0 32447 0
Current children cumulated CPU time (s) 4602.37
Current children cumulated vsize (KiB) 141224

[startup+4662.3 s]
/proc/loadavg: 2.10 2.04 2.01 3/499 32083
/proc/meminfo: memFree=29037312/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141416 CPUtime=4662.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29771 0 0 0 466224 13 0 0 25 0 1 0 805272339 144809984 29542 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298686 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35354 29542 267 49 0 32495 0
Current children cumulated CPU time (s) 4662.37
Current children cumulated vsize (KiB) 141416

[startup+4722.3 s]
/proc/loadavg: 2.08 2.05 2.01 3/499 32085
/proc/meminfo: memFree=29039164/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141416 CPUtime=4722.38 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29798 0 0 0 472225 13 0 0 25 0 1 0 805272339 144809984 29569 33554432000 4194304 4394578 140736940657360 18446744073709551615 4308993 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35354 29569 267 49 0 32495 0
Current children cumulated CPU time (s) 4722.38
Current children cumulated vsize (KiB) 141416

[startup+4782.3 s]
/proc/loadavg: 2.15 2.07 2.01 3/499 32085
/proc/meminfo: memFree=29039148/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141704 CPUtime=4782.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29855 0 0 0 478224 13 0 0 25 0 1 0 805272339 145104896 29626 33554432000 4194304 4394578 140736940657360 18446744073709551615 4346684 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35426 29626 267 49 0 32567 0
Current children cumulated CPU time (s) 4782.37
Current children cumulated vsize (KiB) 141704

[startup+4842.32 s]
/proc/loadavg: 2.16 2.08 2.02 3/499 32087
/proc/meminfo: memFree=29037528/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=141848 CPUtime=4842.39 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29885 0 0 0 484225 14 0 0 25 0 1 0 805272339 145252352 29656 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298798 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35462 29656 267 49 0 32603 0
Current children cumulated CPU time (s) 4842.39
Current children cumulated vsize (KiB) 141848

[startup+4902.3 s]
/proc/loadavg: 2.06 2.06 2.01 3/499 32089
/proc/meminfo: memFree=29037896/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=142104 CPUtime=4902.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 29954 0 0 0 490223 14 0 0 25 0 1 0 805272339 145514496 29725 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35526 29725 267 49 0 32667 0
Current children cumulated CPU time (s) 4902.37
Current children cumulated vsize (KiB) 142104

[startup+4962.3 s]
/proc/loadavg: 2.02 2.05 2.01 3/499 32091
/proc/meminfo: memFree=29037516/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=142360 CPUtime=4962.37 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 30004 0 0 0 496223 14 0 0 25 0 1 0 805272339 145776640 29775 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298757 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35590 29775 267 49 0 32731 0
Current children cumulated CPU time (s) 4962.37
Current children cumulated vsize (KiB) 142360



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 2.01 2.04 2.00 3/499 32091
/proc/meminfo: memFree=29037008/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=142360 CPUtime=5000.09 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 30027 0 0 0 499995 14 0 0 25 0 1 0 805272339 145776640 29798 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298919 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35590 29798 267 49 0 32731 0
Current children cumulated CPU time (s) 5000.09
Current children cumulated vsize (KiB) 142360

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000 s]
/proc/loadavg: 2.01 2.04 2.00 3/499 32091
/proc/meminfo: memFree=29037008/32951132 swapFree=57925096/67111528
[pid=31924] ppid=31922 vsize=142360 CPUtime=5000.09 cores=1,3,5,7
/proc/31924/stat : 31924 (SApperloT2010) R 31922 31924 31492 0 -1 4202496 30027 0 0 0 499995 14 0 0 25 0 1 0 805272339 145776640 29798 33554432000 4194304 4394578 140736940657360 18446744073709551615 4298919 0 0 4096 6 0 0 0 17 3 0 0 0
/proc/31924/statm: 35590 29798 267 49 0 32731 0
Current children cumulated CPU time (s) 5000.09
Current children cumulated vsize (KiB) 142360

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.02
CPU time (s): 5000.11
CPU user time (s): 4999.95
CPU system time (s): 0.151976
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 142360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.95
system time used= 0.151976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30027
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 6742

runsolver used 24.2763 second user time and 57.5193 second system time

The end

Launcher Data 

Begin job on node129 at 2011-06-01 15:58:47
IDJOB=3439568
IDBENCH=85802
IDSOLVER=1933
FILE ID=node129/3439568-1306936727
RUNJOBID= node129-1306926723-31511
PBS_JOBID= 13488566
Free space on /tmp= 73752 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sorge05/QG7a/gensys-ukn006.shuffled-as.sat05-3846.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439568-1306936727/watcher-3439568-1306936727 -o /tmp/evaluation-result-3439568-1306936727/solver-3439568-1306936727 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3439568-1306936727.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f38a91a0947f21d9ceeb8762ba4c5f93
RANDOM SEED=1771938272

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      29238076 kB
Buffers:        275044 kB
Cached:        2005440 kB
SwapCached:      49316 kB
Active:         214480 kB
Inactive:      3216300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      29238076 kB
SwapTotal:    67111528 kB
SwapFree:     57925096 kB
Dirty:             796 kB
Writeback:           0 kB
AnonPages:     1112444 kB
Mapped:          14492 kB
Slab:           153796 kB
PageTables:      59104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 147303384 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73748 MiB
End job on node129 at 2011-06-01 17:22:09