Trace number 3379987

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 1300.04 1300.06

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/11pipe_11_ooo.cnf
MD5SUMf603f11fbfe855df381282b7bce010ea
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables88289
Number of clauses4187694
Sum of the clauses size12410354
Maximum clause length341
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23770000
Number of clauses of size 3347602
Number of clauses of size 41622
Number of clauses of size 51351
Number of clauses of size over 567118

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3379987-1305461053/watcher-3379987-1305461053 -o /tmp/evaluation-result-3379987-1305461053/solver-3379987-1305461053 -C 2400 -W 1300 -M 7680 SApperloT2010 HOME/instance-3379987-1305461053.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.38 2.72 3.39 2/351 28701
/proc/meminfo: memFree=24761644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=11796 CPUtime=0 cores=0,2
/proc/28701/stat : 28701 (runsolver) S 28699 28701 27741 0 -1 4202560 40 0 0 0 0 0 0 0 18 0 1 0 657706032 12079104 50 33554432000 4194304 5432360 140734761468848 18446744073709551615 4881623 0 2147483391 4096 24578 18446744071699960631 0 0 17 0 0 0 0
/proc/28701/statm: 2949 50 30 303 0 2643 0

[startup+0.0928039 s]
/proc/loadavg: 1.38 2.72 3.39 2/351 28701
/proc/meminfo: memFree=24761644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=58884 CPUtime=0.05 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 3811 0 0 0 5 0 0 0 20 0 1 0 657706032 60297216 3752 33554432000 4194304 4394578 140736866393520 18446744073709551615 230808826565 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 14721 3753 248 49 0 11862 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 58884

[startup+0.100853 s]
/proc/loadavg: 1.38 2.72 3.39 2/351 28701
/proc/meminfo: memFree=24761644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=59808 CPUtime=0.06 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 4053 0 0 0 6 0 0 0 20 0 1 0 657706032 61243392 3994 33554432000 4194304 4394578 140736866393520 18446744073709551615 230809165568 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 14952 3994 248 49 0 12093 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 59808

[startup+0.300814 s]
/proc/loadavg: 1.38 2.72 3.39 2/351 28701
/proc/meminfo: memFree=24761644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=82692 CPUtime=0.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 9467 0 0 0 25 1 0 0 20 0 1 0 657706032 84676608 9342 33554432000 4194304 4394578 140736866393520 18446744073709551615 230809165568 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 20673 9342 248 49 0 17814 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 82692

[startup+0.700732 s]
/proc/loadavg: 1.38 2.72 3.39 2/351 28701
/proc/meminfo: memFree=24761644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=129744 CPUtime=0.66 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 20584 0 0 0 62 4 0 0 21 0 1 0 657706032 132857856 20197 33554432000 4194304 4394578 140736866393520 18446744073709551615 230809165568 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 32436 20198 248 49 0 29577 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 129744

[startup+1.5006 s]
/proc/loadavg: 1.38 2.72 3.39 4/352 28703
/proc/meminfo: memFree=24369372/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=215960 CPUtime=1.46 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 41091 0 0 0 137 9 0 0 25 0 1 0 657706032 221143040 40639 33554432000 4194304 4394578 140736866393520 18446744073709551615 230808826565 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 53990 40639 248 49 0 51131 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 215960

[startup+3.10026 s]
/proc/loadavg: 1.38 2.72 3.39 5/350 28703
/proc/meminfo: memFree=24020856/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=293240 CPUtime=3.06 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 60471 0 0 0 294 12 0 0 25 0 1 0 657706032 300277760 59953 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 73310 59953 264 49 0 70451 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 293240

[startup+6.30068 s]
/proc/loadavg: 1.83 2.79 3.41 5/360 28715
/proc/meminfo: memFree=23066276/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=303260 CPUtime=6.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 62818 0 0 0 613 13 0 0 25 0 1 0 657706032 310538240 62300 33554432000 4194304 4394578 140736866393520 18446744073709551615 4292825 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 75815 62300 264 49 0 72956 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 303260

[startup+12.7005 s]
/proc/loadavg: 2.25 2.86 3.42 5/360 28715
/proc/meminfo: memFree=22728020/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=317840 CPUtime=12.66 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 66433 0 0 0 1252 14 0 0 25 0 1 0 657706032 325468160 65915 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298298 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 79460 65915 264 49 0 76601 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 317840

[startup+25.5132 s]
/proc/loadavg: 2.63 2.92 3.43 5/360 28715
/proc/meminfo: memFree=22676064/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=343328 CPUtime=25.47 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 72675 0 0 0 2531 16 0 0 25 0 1 0 657706032 351567872 72157 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 85832 72157 264 49 0 82973 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 343328

[startup+51.1005 s]
/proc/loadavg: 3.10 3.00 3.45 5/360 28716
/proc/meminfo: memFree=22550744/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=405516 CPUtime=51.03 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 88166 0 0 0 5082 21 0 0 25 0 1 0 657706032 415248384 87519 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298989 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 101379 87519 264 49 0 98520 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 405516

[startup+102.301 s]
/proc/loadavg: 3.61 3.16 3.47 5/360 28717
/proc/meminfo: memFree=22343156/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=509504 CPUtime=102.23 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 113718 0 0 0 10196 27 0 0 25 0 1 0 657706032 521732096 112620 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298272 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 127376 112621 264 49 0 124517 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 509504

[startup+162.301 s]
/proc/loadavg: 3.92 3.32 3.51 5/360 28719
/proc/meminfo: memFree=22062384/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=661520 CPUtime=162.24 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 149063 0 0 0 16187 37 0 0 25 0 1 0 657706032 677396480 147323 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 165380 147323 264 49 0 162521 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 661520

[startup+222.3 s]
/proc/loadavg: 4.03 3.47 3.55 5/360 28720
/proc/meminfo: memFree=21776260/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=787340 CPUtime=222.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 178462 0 0 0 22182 43 0 0 25 0 1 0 657706032 806236160 176593 33554432000 4194304 4394578 140736866393520 18446744073709551615 4346323 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 196835 176593 264 49 0 193976 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 787340

[startup+282.3 s]
/proc/loadavg: 4.01 3.56 3.57 5/360 28722
/proc/meminfo: memFree=21540760/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=866984 CPUtime=282.24 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 197398 0 0 0 28176 48 0 0 25 0 1 0 657706032 887791616 195271 33554432000 4194304 4394578 140736866393520 18446744073709551615 4292210 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 216746 195271 264 49 0 213887 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 866984

[startup+342.313 s]
/proc/loadavg: 4.00 3.64 3.60 5/360 28724
/proc/meminfo: memFree=21312572/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=975304 CPUtime=342.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 223057 0 0 0 34172 54 0 0 25 0 1 0 657706032 998711296 220930 33554432000 4194304 4394578 140736866393520 18446744073709551615 4346131 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 243826 220930 264 49 0 240967 0
Current children cumulated CPU time (s) 342.26
Current children cumulated vsize (KiB) 975304

[startup+402.3 s]
/proc/loadavg: 4.04 3.72 3.62 5/360 28725
/proc/meminfo: memFree=21145144/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1011396 CPUtime=402.24 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 231787 0 0 0 40168 56 0 0 25 0 1 0 657706032 1035669504 228635 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298979 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 252849 228635 264 49 0 249990 0
Current children cumulated CPU time (s) 402.24
Current children cumulated vsize (KiB) 1011396

[startup+462.3 s]
/proc/loadavg: 4.12 3.80 3.65 5/360 28727
/proc/meminfo: memFree=20990116/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1011396 CPUtime=462.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 231892 0 0 0 46168 57 0 0 25 0 1 0 657706032 1035669504 228740 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 252849 228740 264 49 0 249990 0
Current children cumulated CPU time (s) 462.25
Current children cumulated vsize (KiB) 1011396

[startup+522.3 s]
/proc/loadavg: 4.04 3.83 3.67 5/360 28728
/proc/meminfo: memFree=20900804/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1011396 CPUtime=522.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 232100 0 0 0 52168 57 0 0 25 0 1 0 657706032 1035669504 228948 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 252849 228948 264 49 0 249990 0
Current children cumulated CPU time (s) 522.25
Current children cumulated vsize (KiB) 1011396

[startup+582.3 s]
/proc/loadavg: 4.01 3.86 3.69 5/360 28730
/proc/meminfo: memFree=20795992/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1012492 CPUtime=582.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 232580 0 0 0 58168 57 0 0 25 0 1 0 657706032 1036791808 229428 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 253123 229428 264 49 0 250264 0
Current children cumulated CPU time (s) 582.25
Current children cumulated vsize (KiB) 1012492

[startup+642.301 s]
/proc/loadavg: 4.00 3.88 3.71 5/360 28732
/proc/meminfo: memFree=20635132/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1097548 CPUtime=642.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 253241 0 0 0 64162 63 0 0 25 0 1 0 657706032 1123889152 250089 33554432000 4194304 4394578 140736866393520 18446744073709551615 4287937 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 274387 250089 264 49 0 271528 0
Current children cumulated CPU time (s) 642.25
Current children cumulated vsize (KiB) 1097548

[startup+702.301 s]
/proc/loadavg: 4.00 3.90 3.72 5/360 28733
/proc/meminfo: memFree=20570500/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1102000 CPUtime=702.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 254291 0 0 0 70162 63 0 0 25 0 1 0 657706032 1128448000 251139 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298698 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 275500 251139 264 49 0 272641 0
Current children cumulated CPU time (s) 702.25
Current children cumulated vsize (KiB) 1102000

[startup+762.301 s]
/proc/loadavg: 4.07 3.94 3.75 5/360 28735
/proc/meminfo: memFree=20473388/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1103536 CPUtime=762.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 254772 0 0 0 76161 64 0 0 25 0 1 0 657706032 1130020864 251620 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 275884 251620 264 49 0 273025 0
Current children cumulated CPU time (s) 762.25
Current children cumulated vsize (KiB) 1103536

[startup+822.301 s]
/proc/loadavg: 4.03 3.95 3.76 5/360 28736
/proc/meminfo: memFree=20362744/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1106864 CPUtime=822.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 255554 0 0 0 82161 65 0 0 25 0 1 0 657706032 1133428736 252402 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298302 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 276716 252402 264 49 0 273857 0
Current children cumulated CPU time (s) 822.26
Current children cumulated vsize (KiB) 1106864

[startup+882.301 s]
/proc/loadavg: 4.01 3.96 3.77 5/360 28738
/proc/meminfo: memFree=20235492/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1153664 CPUtime=882.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 266918 0 0 0 88158 68 0 0 25 0 1 0 657706032 1181351936 263766 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298896 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 288416 263766 264 49 0 285557 0
Current children cumulated CPU time (s) 882.26
Current children cumulated vsize (KiB) 1153664

[startup+942.301 s]
/proc/loadavg: 4.11 3.99 3.79 5/360 28740
/proc/meminfo: memFree=20162056/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1154324 CPUtime=942.25 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 267130 0 0 0 94157 68 0 0 25 0 1 0 657706032 1182027776 263978 33554432000 4194304 4394578 140736866393520 18446744073709551615 4287965 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 288581 263978 264 49 0 285722 0
Current children cumulated CPU time (s) 942.25
Current children cumulated vsize (KiB) 1154324

[startup+1002.31 s]
/proc/loadavg: 4.12 4.02 3.82 5/360 28741
/proc/meminfo: memFree=20091840/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1154324 CPUtime=1002.27 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 267177 0 0 0 100159 68 0 0 25 0 1 0 657706032 1182027776 264025 33554432000 4194304 4394578 140736866393520 18446744073709551615 4296745 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 288581 264025 264 49 0 285722 0
Current children cumulated CPU time (s) 1002.27
Current children cumulated vsize (KiB) 1154324

[startup+1062.3 s]
/proc/loadavg: 4.08 4.03 3.83 5/360 28743
/proc/meminfo: memFree=20004260/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1156400 CPUtime=1062.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 267639 0 0 0 106158 68 0 0 25 0 1 0 657706032 1184153600 264487 33554432000 4194304 4394578 140736866393520 18446744073709551615 4296777 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 289100 264487 264 49 0 286241 0
Current children cumulated CPU time (s) 1062.26
Current children cumulated vsize (KiB) 1156400

[startup+1122.3 s]
/proc/loadavg: 4.03 4.02 3.83 5/360 28744
/proc/meminfo: memFree=19932060/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1162032 CPUtime=1122.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 268926 0 0 0 112157 69 0 0 25 0 1 0 657706032 1189920768 265774 33554432000 4194304 4394578 140736866393520 18446744073709551615 4287550 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 290508 265774 264 49 0 287649 0
Current children cumulated CPU time (s) 1122.26
Current children cumulated vsize (KiB) 1162032

[startup+1182.3 s]
/proc/loadavg: 4.01 4.02 3.84 5/360 28746
/proc/meminfo: memFree=19840644/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1217728 CPUtime=1182.26 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 281712 0 0 0 118154 72 0 0 25 0 1 0 657706032 1246953472 278560 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298837 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 304432 278560 264 49 0 301573 0
Current children cumulated CPU time (s) 1182.26
Current children cumulated vsize (KiB) 1217728

[startup+1242.3 s]
/proc/loadavg: 4.05 4.03 3.85 5/360 28748
/proc/meminfo: memFree=19793988/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1226760 CPUtime=1242.27 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 283932 0 0 0 124154 73 0 0 25 0 1 0 657706032 1256202240 280780 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298298 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 306690 280780 264 49 0 303831 0
Current children cumulated CPU time (s) 1242.27
Current children cumulated vsize (KiB) 1226760



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.04 4.03 3.86 4/358 28750
/proc/meminfo: memFree=20700288/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1228328 CPUtime=1299.98 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 284256 0 0 0 129925 73 0 0 25 0 1 0 657706032 1257807872 281104 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 307082 281104 264 49 0 304223 0
Current children cumulated CPU time (s) 1299.98
Current children cumulated vsize (KiB) 1228328

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.04 4.03 3.86 4/358 28750
/proc/meminfo: memFree=20700288/32951124 swapFree=40554400/67111528
[pid=28701] ppid=28699 vsize=1228328 CPUtime=1299.98 cores=0,2
/proc/28701/stat : 28701 (SApperloT2010) R 28699 28701 27741 0 -1 4202496 284256 0 0 0 129925 73 0 0 25 0 1 0 657706032 1257807872 281104 33554432000 4194304 4394578 140736866393520 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/28701/statm: 307082 281104 264 49 0 304223 0
Current children cumulated CPU time (s) 1299.98
Current children cumulated vsize (KiB) 1228328

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 1300.04
CPU user time (s): 1299.26
CPU system time (s): 0.777881
CPU usage (%): 99.9982
Max. virtual memory (cumulated for all children) (KiB): 1228328

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.26
system time used= 0.777881
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 284256
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 2053

runsolver used 4.64129 second user time and 9.57954 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-15 14:04:16
IDJOB=3379987
IDBENCH=88163
IDSOLVER=1862
FILE ID=node104/3379987-1305461053
RUNJOBID= node104-1305461053-28675
PBS_JOBID= 13324887
Free space on /tmp= 73068 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/11pipe_11_ooo.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3379987-1305461053/watcher-3379987-1305461053 -o /tmp/evaluation-result-3379987-1305461053/solver-3379987-1305461053 -C 2400 -W 1300 -M 7680  SApperloT2010 HOME/instance-3379987-1305461053.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= f603f11fbfe855df381282b7bce010ea
RANDOM SEED=1316141860

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24766332 kB
Buffers:        315080 kB
Cached:        3158672 kB
SwapCached:     122128 kB
Active:        1513540 kB
Inactive:      6381412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24766332 kB
SwapTotal:    67111528 kB
SwapFree:     40554400 kB
Dirty:          370808 kB
Writeback:           0 kB
AnonPages:     4311560 kB
Mapped:          10924 kB
Slab:           140440 kB
PageTables:      85328 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75090556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72940 MiB
End job on node104 at 2011-05-15 14:25:58