Trace number 3438563

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.07 4999.93

General information on the benchmark

NameCRAFTED/rbsat/crafted/forced/
rbsat-v760c43649gyes8.cnf
MD5SUMca42736a2fe4e8cf2cba6dd1668e0ad6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark30.53
Satisfiable
(Un)Satisfiability was proved
Number of variables760
Number of clauses43649
Sum of the clauses size87978
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 243609
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438563-1306925663/watcher-3438563-1306925663 -o /tmp/evaluation-result-3438563-1306925663/solver-3438563-1306925663 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438563-1306925663.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.94 1.03 1.29 2/516 9552
/proc/meminfo: memFree=21992784/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=13256 CPUtime=0 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 652 0 0 0 0 0 0 0 21 0 1 0 784981750 13574144 591 33554432000 4194304 4394578 140734123757456 18446744073709551615 228095111877 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 3314 591 247 49 0 455 0

[startup+0.0575391 s]
/proc/loadavg: 0.94 1.03 1.29 2/516 9552
/proc/meminfo: memFree=21992784/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=17160 CPUtime=0.04 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 1817 0 0 0 4 0 0 0 21 0 1 0 784981750 17571840 1583 33554432000 4194304 4394578 140734123757456 18446744073709551615 228095111877 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 4323 1591 258 49 0 1464 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 17160

[startup+0.100507 s]
/proc/loadavg: 0.94 1.03 1.29 2/516 9552
/proc/meminfo: memFree=21992784/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=18216 CPUtime=0.08 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 2069 0 0 0 8 0 0 0 21 0 1 0 784981750 18653184 1835 33554432000 4194304 4394578 140734123757456 18446744073709551615 228095111877 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 4554 1836 266 49 0 1695 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 18216

[startup+0.300482 s]
/proc/loadavg: 0.94 1.03 1.29 2/516 9552
/proc/meminfo: memFree=21992784/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=21120 CPUtime=0.28 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 2810 0 0 0 28 0 0 0 22 0 1 0 784981750 21626880 2576 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298358 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 5280 2576 266 49 0 2421 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 21120

[startup+0.700401 s]
/proc/loadavg: 0.94 1.03 1.29 2/516 9552
/proc/meminfo: memFree=21992784/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=24624 CPUtime=0.68 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 3682 0 0 0 68 0 0 0 23 0 1 0 784981750 25214976 3448 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298807 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 6156 3448 266 49 0 3297 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 24624

[startup+1.50023 s]
/proc/loadavg: 0.94 1.03 1.29 3/522 9561
/proc/meminfo: memFree=21961312/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=28328 CPUtime=1.48 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 4578 0 0 0 148 0 0 0 25 0 1 0 784981750 29007872 4344 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 7082 4344 266 49 0 4223 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 28328

[startup+3.10096 s]
/proc/loadavg: 0.94 1.03 1.29 3/522 9561
/proc/meminfo: memFree=21955252/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=30080 CPUtime=3.08 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 4984 0 0 0 308 0 0 0 25 0 1 0 784981750 30801920 4750 33554432000 4194304 4394578 140734123757456 18446744073709551615 4309146 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 7520 4750 266 49 0 4661 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 30080

[startup+6.30037 s]
/proc/loadavg: 1.02 1.05 1.29 3/522 9561
/proc/meminfo: memFree=21947924/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=33260 CPUtime=6.28 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 5732 0 0 0 628 0 0 0 25 0 1 0 784981750 34058240 5498 33554432000 4194304 4394578 140734123757456 18446744073709551615 4292774 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 8315 5498 266 49 0 5456 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 33260

[startup+12.7002 s]
/proc/loadavg: 1.10 1.06 1.29 3/522 9561
/proc/meminfo: memFree=21936736/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=37620 CPUtime=12.69 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 6763 0 0 0 1268 1 0 0 25 0 1 0 784981750 38522880 6529 33554432000 4194304 4394578 140734123757456 18446744073709551615 4296777 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 9405 6529 266 49 0 6546 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 37620

[startup+25.5008 s]
/proc/loadavg: 1.30 1.11 1.31 3/522 9561
/proc/meminfo: memFree=21923740/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=44816 CPUtime=25.48 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 8336 0 0 0 2547 1 0 0 25 0 1 0 784981750 45891584 8102 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298993 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 11204 8102 266 49 0 8345 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 44816

[startup+51.1012 s]
/proc/loadavg: 1.54 1.18 1.32 3/522 9562
/proc/meminfo: memFree=21911280/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=52356 CPUtime=51.08 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 9961 0 0 0 5107 1 0 0 25 0 1 0 784981750 53612544 9727 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 13089 9727 266 49 0 10230 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 52356

[startup+102.32 s]
/proc/loadavg: 1.80 1.30 1.36 3/522 9563
/proc/meminfo: memFree=21887556/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=67236 CPUtime=102.31 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 13190 0 0 0 10229 2 0 0 25 0 1 0 784981750 68849664 12956 33554432000 4194304 4394578 140734123757456 18446744073709551615 4335330 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 16809 12956 266 49 0 13950 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 67236

[startup+162.301 s]
/proc/loadavg: 2.08 1.46 1.40 3/522 9565
/proc/meminfo: memFree=21869552/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=77540 CPUtime=162.28 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 15182 0 0 0 16226 2 0 0 25 0 1 0 784981750 79400960 14948 33554432000 4194304 4394578 140734123757456 18446744073709551615 4295572 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 19385 14948 266 49 0 16526 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 77540

[startup+222.301 s]
/proc/loadavg: 2.10 1.57 1.44 3/522 9567
/proc/meminfo: memFree=21863076/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=80516 CPUtime=222.29 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 15847 0 0 0 22227 2 0 0 25 0 1 0 784981750 82448384 15613 33554432000 4194304 4394578 140734123757456 18446744073709551615 4292637 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 20129 15613 266 49 0 17270 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 80516

[startup+282.301 s]
/proc/loadavg: 2.04 1.65 1.48 3/522 9568
/proc/meminfo: memFree=21852132/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=86752 CPUtime=282.29 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 17096 0 0 0 28226 3 0 0 25 0 1 0 784981750 88834048 16862 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 21688 16862 266 49 0 18829 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 86752

[startup+342.301 s]
/proc/loadavg: 2.01 1.71 1.50 3/522 9570
/proc/meminfo: memFree=21839324/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=96004 CPUtime=342.29 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 18892 0 0 0 34226 3 0 0 25 0 1 0 784981750 98308096 18658 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 24001 18658 266 49 0 21142 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 96004

[startup+402.301 s]
/proc/loadavg: 2.16 1.79 1.54 3/522 9580
/proc/meminfo: memFree=21828368/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=100996 CPUtime=402.29 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 19967 0 0 0 40226 3 0 0 25 0 1 0 784981750 103419904 19733 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 25249 19733 266 49 0 22390 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 100996

[startup+462.301 s]
/proc/loadavg: 2.20 1.86 1.58 3/522 9582
/proc/meminfo: memFree=21823168/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=105488 CPUtime=462.3 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 20929 0 0 0 46226 4 0 0 25 0 1 0 784981750 108019712 20695 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298693 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 26372 20695 266 49 0 23513 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 105488

[startup+522.301 s]
/proc/loadavg: 2.07 1.88 1.60 3/522 9583
/proc/meminfo: memFree=21816948/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=109660 CPUtime=522.3 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 21815 0 0 0 52226 4 0 0 25 0 1 0 784981750 112291840 21581 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298721 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 27415 21581 266 49 0 24556 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 109660

[startup+582.301 s]
/proc/loadavg: 2.02 1.90 1.63 3/522 9585
/proc/meminfo: memFree=21802788/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=118900 CPUtime=582.3 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 23920 0 0 0 58226 4 0 0 25 0 1 0 784981750 121753600 23686 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 29725 23686 266 49 0 26866 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 118900

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.08 2.05 2.01 3/522 9697
/proc/meminfo: memFree=21662412/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=205288 CPUtime=4062.43 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 40875 0 0 0 406230 13 0 0 25 0 1 0 784981750 210214912 40641 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 51322 40641 266 49 0 48463 0
Current children cumulated CPU time (s) 4062.43
Current children cumulated vsize (KiB) 205288

[startup+4122.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/522 9698
/proc/meminfo: memFree=21661876/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=205544 CPUtime=4122.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 40947 0 0 0 412228 13 0 0 25 0 1 0 784981750 210477056 40713 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 51386 40713 266 49 0 48527 0
Current children cumulated CPU time (s) 4122.41
Current children cumulated vsize (KiB) 205544

[startup+4182.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/522 9700
/proc/meminfo: memFree=21659848/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=206532 CPUtime=4182.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 41154 0 0 0 418228 13 0 0 25 0 1 0 784981750 211488768 40920 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 51633 40920 266 49 0 48774 0
Current children cumulated CPU time (s) 4182.41
Current children cumulated vsize (KiB) 206532

[startup+4242.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/522 9702
/proc/meminfo: memFree=21656212/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=209732 CPUtime=4242.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 41748 0 0 0 424228 13 0 0 25 0 1 0 784981750 214765568 41514 33554432000 4194304 4394578 140734123757456 18446744073709551615 4296311 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 52433 41514 266 49 0 49574 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 209732

[startup+4302.3 s]
/proc/loadavg: 2.09 2.05 2.01 3/522 9703
/proc/meminfo: memFree=21652456/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=213832 CPUtime=4302.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 42444 0 0 0 430228 13 0 0 25 0 1 0 784981750 218963968 42210 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 53458 42210 266 49 0 50599 0
Current children cumulated CPU time (s) 4302.41
Current children cumulated vsize (KiB) 213832

[startup+4362.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/522 9705
/proc/meminfo: memFree=21650304/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=216392 CPUtime=4362.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 42933 0 0 0 436228 13 0 0 25 0 1 0 784981750 221585408 42699 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 54098 42699 266 49 0 51239 0
Current children cumulated CPU time (s) 4362.41
Current children cumulated vsize (KiB) 216392

[startup+4422.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/522 9706
/proc/meminfo: memFree=21646548/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=217928 CPUtime=4422.41 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 43227 0 0 0 442228 13 0 0 25 0 1 0 784981750 223158272 42993 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 54482 42993 266 49 0 51623 0
Current children cumulated CPU time (s) 4422.41
Current children cumulated vsize (KiB) 217928

[startup+4482.3 s]
/proc/loadavg: 2.15 2.05 2.01 3/522 9708
/proc/meminfo: memFree=21644780/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=218440 CPUtime=4482.42 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 43377 0 0 0 448229 13 0 0 25 0 1 0 784981750 223682560 43143 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298724 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 54610 43143 266 49 0 51751 0
Current children cumulated CPU time (s) 4482.42
Current children cumulated vsize (KiB) 218440

[startup+4542.3 s]
/proc/loadavg: 2.12 2.06 2.01 3/522 9710
/proc/meminfo: memFree=21643128/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=220488 CPUtime=4542.42 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 43696 0 0 0 454229 13 0 0 25 0 1 0 784981750 225779712 43462 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298807 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 55122 43462 266 49 0 52263 0
Current children cumulated CPU time (s) 4542.42
Current children cumulated vsize (KiB) 220488

[startup+4602.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/522 9711
/proc/meminfo: memFree=21639740/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=222536 CPUtime=4602.44 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 44087 0 0 0 460230 14 0 0 25 0 1 0 784981750 227876864 43853 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298832 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 55634 43853 266 49 0 52775 0
Current children cumulated CPU time (s) 4602.44
Current children cumulated vsize (KiB) 222536

[startup+4662.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/522 9714
/proc/meminfo: memFree=21635856/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=224328 CPUtime=4662.43 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 44380 0 0 0 466229 14 0 0 25 0 1 0 784981750 229711872 44146 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 56082 44146 266 49 0 53223 0
Current children cumulated CPU time (s) 4662.43
Current children cumulated vsize (KiB) 224328

[startup+4722.32 s]
/proc/loadavg: 2.00 2.03 2.00 3/522 9716
/proc/meminfo: memFree=21634328/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=226632 CPUtime=4722.45 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 44799 0 0 0 472231 14 0 0 25 0 1 0 784981750 232071168 44565 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 56658 44565 266 49 0 53799 0
Current children cumulated CPU time (s) 4722.45
Current children cumulated vsize (KiB) 226632

[startup+4782.3 s]
/proc/loadavg: 2.13 2.05 2.01 3/522 9717
/proc/meminfo: memFree=21632436/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=228168 CPUtime=4782.43 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45131 0 0 0 478229 14 0 0 25 0 1 0 784981750 233644032 44897 33554432000 4194304 4394578 140734123757456 18446744073709551615 4299384 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57042 44897 266 49 0 54183 0
Current children cumulated CPU time (s) 4782.43
Current children cumulated vsize (KiB) 228168

[startup+4842.3 s]
/proc/loadavg: 2.11 2.06 2.01 3/522 9719
/proc/meminfo: memFree=21632024/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=228168 CPUtime=4842.44 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45145 0 0 0 484230 14 0 0 25 0 1 0 784981750 233644032 44911 33554432000 4194304 4394578 140734123757456 18446744073709551615 4313533 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57042 44911 266 49 0 54183 0
Current children cumulated CPU time (s) 4842.44
Current children cumulated vsize (KiB) 228168

[startup+4902.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/522 9721
/proc/meminfo: memFree=21631368/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=229448 CPUtime=4902.44 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45383 0 0 0 490230 14 0 0 25 0 1 0 784981750 234954752 45149 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57362 45149 266 49 0 54503 0
Current children cumulated CPU time (s) 4902.44
Current children cumulated vsize (KiB) 229448

[startup+4962.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/522 9723
/proc/meminfo: memFree=21629468/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=230984 CPUtime=4962.44 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45711 0 0 0 496230 14 0 0 25 0 1 0 784981750 236527616 45477 33554432000 4194304 4394578 140734123757456 18446744073709551615 4298364 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57746 45477 266 49 0 54887 0
Current children cumulated CPU time (s) 4962.44
Current children cumulated vsize (KiB) 230984



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.00 2.03 2.00 3/522 9724
/proc/meminfo: memFree=21629324/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=230984 CPUtime=5000.05 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45711 0 0 0 499991 14 0 0 25 0 1 0 784981750 236527616 45477 33554432000 4194304 4394578 140734123757456 18446744073709551615 228095113684 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57746 45477 266 49 0 54887 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 230984

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.00 2.03 2.00 3/522 9724
/proc/meminfo: memFree=21629324/32951124 swapFree=58800704/67111528
[pid=9552] ppid=9550 vsize=230984 CPUtime=5000.05 cores=0,2,4,6
/proc/9552/stat : 9552 (SApperloT2010) R 9550 9552 8575 0 -1 4202496 45711 0 0 0 499991 14 0 0 25 0 1 0 784981750 236527616 45477 33554432000 4194304 4394578 140734123757456 18446744073709551615 228095113684 0 0 4096 6 0 0 0 17 4 0 0 0
/proc/9552/statm: 57746 45477 266 49 0 54887 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 230984

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.93
CPU time (s): 5000.07
CPU user time (s): 4999.93
CPU system time (s): 0.149977
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 230984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.92
system time used= 0.149977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 45711
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 6703

runsolver used 27.6428 second user time and 58.7321 second system time

The end

Launcher Data 

Begin job on node142 at 2011-06-01 12:54:23
IDJOB=3438563
IDBENCH=71572
IDSOLVER=1933
FILE ID=node142/3438563-1306925663
RUNJOBID= node142-1306925663-9540
PBS_JOBID= 13488478
Free space on /tmp= 73856 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v760c43649gyes8.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438563-1306925663/watcher-3438563-1306925663 -o /tmp/evaluation-result-3438563-1306925663/solver-3438563-1306925663 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438563-1306925663.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca42736a2fe4e8cf2cba6dd1668e0ad6
RANDOM SEED=1318918128

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21993072 kB
Buffers:        116340 kB
Cached:         178280 kB
SwapCached:      11420 kB
Active:        9072236 kB
Inactive:      1633956 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21993072 kB
SwapTotal:    67111528 kB
SwapFree:     58800704 kB
Dirty:             820 kB
Writeback:           0 kB
AnonPages:    10409160 kB
Mapped:          31340 kB
Slab:           106208 kB
PageTables:      75580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145380928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73856 MiB
End job on node142 at 2011-06-01 14:17:45