Trace number 3438758

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.32 5000.21

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x14.cnf
MD5SUMf76302f2442dfc7cabc2315e61e55fea
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1176
Number of clauses78498
Sum of the clauses size310464
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21764
Number of clauses of size 30
Number of clauses of size 476734
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438758-1306896002/watcher-3438758-1306896002 -o /tmp/evaluation-result-3438758-1306896002/solver-3438758-1306896002 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438758-1306896002.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.02 2.00 3/473 9430
/proc/meminfo: memFree=4034296/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=14080 CPUtime=0 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 769 0 0 0 0 0 0 0 25 0 1 0 801199864 14417920 709 33554432000 4194304 4394578 140737251972512 18446744073709551615 274473628357 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 3520 710 247 49 0 661 0

[startup+0.0726009 s]
/proc/loadavg: 2.00 2.02 2.00 3/473 9430
/proc/meminfo: memFree=4034296/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=23584 CPUtime=0.06 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 3171 0 0 0 6 0 0 0 25 0 1 0 801199864 24150016 3110 33554432000 4194304 4394578 140737251972512 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 5896 3110 255 49 0 3037 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 23584

[startup+0.10059 s]
/proc/loadavg: 2.00 2.02 2.00 3/473 9430
/proc/meminfo: memFree=4034296/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=23584 CPUtime=0.09 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 3171 0 0 0 9 0 0 0 25 0 1 0 801199864 24150016 3110 33554432000 4194304 4394578 140737251972512 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 5896 3110 255 49 0 3037 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23584

[startup+0.30056 s]
/proc/loadavg: 2.00 2.02 2.00 3/473 9430
/proc/meminfo: memFree=4034296/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=34248 CPUtime=0.29 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 6289 0 0 0 28 1 0 0 25 0 1 0 801199864 35069952 5920 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298698 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 8562 5920 266 49 0 5703 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 34248

[startup+0.700489 s]
/proc/loadavg: 2.00 2.02 2.00 3/473 9430
/proc/meminfo: memFree=4034296/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=38760 CPUtime=0.69 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 7417 0 0 0 68 1 0 0 25 0 1 0 801199864 39690240 7048 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298302 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 9690 7048 266 49 0 6831 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 38760

[startup+1.50035 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9431
/proc/meminfo: memFree=4002676/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=47392 CPUtime=1.49 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 9533 0 0 0 148 1 0 0 25 0 1 0 801199864 48529408 9164 33554432000 4194304 4394578 140737251972512 18446744073709551615 4285392 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 11848 9164 266 49 0 8989 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 47392

[startup+3.10107 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9431
/proc/meminfo: memFree=3993448/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=55532 CPUtime=3.09 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 11543 0 0 0 308 1 0 0 25 0 1 0 801199864 56864768 11174 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 13883 11174 266 49 0 11024 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 55532

[startup+6.30051 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9431
/proc/meminfo: memFree=3978728/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=63956 CPUtime=6.29 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 13549 0 0 0 627 2 0 0 25 0 1 0 801199864 65490944 13180 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 15989 13180 266 49 0 13130 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 63956

[startup+12.7004 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9431
/proc/meminfo: memFree=3953188/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=81056 CPUtime=12.69 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 17670 0 0 0 1266 3 0 0 25 0 1 0 801199864 83001344 17301 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298358 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 20264 17301 266 49 0 17405 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 81056

[startup+25.5011 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9431
/proc/meminfo: memFree=3924928/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=99928 CPUtime=25.49 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 22135 0 0 0 2545 4 0 0 25 0 1 0 801199864 102326272 21766 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298338 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 24982 21766 266 49 0 22123 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 99928

[startup+51.1006 s]
/proc/loadavg: 2.00 2.02 2.00 3/474 9432
/proc/meminfo: memFree=3859516/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=145856 CPUtime=51.09 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 33130 0 0 0 5103 6 0 0 25 0 1 0 801199864 149356544 32761 33554432000 4194304 4394578 140737251972512 18446744073709551615 4296280 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 36464 32761 266 49 0 33605 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 145856

[startup+102.318 s]
/proc/loadavg: 2.00 2.01 2.00 3/474 9433
/proc/meminfo: memFree=3702496/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=262548 CPUtime=102.31 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 61786 0 0 0 10219 12 0 0 25 0 1 0 801199864 268849152 61417 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298891 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 65637 61417 266 49 0 62778 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 262548

[startup+162.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/474 9441
/proc/meminfo: memFree=3575520/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=338820 CPUtime=162.29 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 79992 0 0 0 16213 16 0 0 25 0 1 0 801199864 346951680 79623 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 84705 79623 266 49 0 81846 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 338820

[startup+222.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/474 9442
/proc/meminfo: memFree=3428800/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=456112 CPUtime=222.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 108533 0 0 0 22207 23 0 0 25 0 1 0 801199864 467058688 108164 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 114028 108164 266 49 0 111169 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 456112

[startup+282.301 s]
/proc/loadavg: 2.02 2.01 2.00 3/474 9444
/proc/meminfo: memFree=3279084/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=554256 CPUtime=282.29 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 132276 0 0 0 28202 27 0 0 25 0 1 0 801199864 567558144 131907 33554432000 4194304 4394578 140737251972512 18446744073709551615 4288008 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 138564 131907 266 49 0 135705 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 554256

[startup+342.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/474 9446
/proc/meminfo: memFree=3220392/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=568592 CPUtime=342.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 135191 0 0 0 34202 28 0 0 25 0 1 0 801199864 582238208 134822 33554432000 4194304 4394578 140737251972512 18446744073709551615 4346330 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 142148 134822 266 49 0 139289 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 568592

[startup+402.301 s]
/proc/loadavg: 2.10 2.03 2.01 3/474 9447
/proc/meminfo: memFree=3029380/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=722628 CPUtime=402.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 173231 0 0 0 40196 34 0 0 25 0 1 0 801199864 739971072 172862 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 180657 172862 266 49 0 177798 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 722628

[startup+462.3 s]
/proc/loadavg: 2.08 2.04 2.01 3/474 9449
/proc/meminfo: memFree=2918236/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=833912 CPUtime=462.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 200400 0 0 0 46190 40 0 0 25 0 1 0 801199864 853925888 200031 33554432000 4194304 4394578 140737251972512 18446744073709551615 4291898 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 208478 200031 266 49 0 205619 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 833912

[startup+522.301 s]
/proc/loadavg: 2.03 2.03 2.00 3/474 9450
/proc/meminfo: memFree=2845644/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=907528 CPUtime=522.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 218458 0 0 0 52186 44 0 0 25 0 1 0 801199864 929308672 218089 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298985 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 226882 218089 266 49 0 224023 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 907528

[startup+582.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/474 9452
/proc/meminfo: memFree=2782496/32950928 swapFree=62386516/67111528
[pid=9430] ppid=9428 vsize=971632 CPUtime=582.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 234177 0 0 0 58182 48 0 0 25 0 1 0 801199864 994951168 233808 33554432000 4194304 4394578 140737251972512 18446744073709551615 4287949 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 242908 233808 266 49 0 240049 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 971632

[startup+642.301 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 1.00 1.19 1.56 2/468 9575
/proc/meminfo: memFree=3188872/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3446428 CPUtime=4062.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 838378 0 0 0 406064 175 0 0 25 0 1 0 801199864 3529142272 836901 33554432000 4194304 4394578 140737251972512 18446744073709551615 4299008 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 861607 836901 267 49 0 858748 0
Current children cumulated CPU time (s) 4062.39
Current children cumulated vsize (KiB) 3446428

[startup+4122.3 s]
/proc/loadavg: 1.00 1.15 1.52 2/468 9576
/proc/meminfo: memFree=3120000/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3515920 CPUtime=4122.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 855611 0 0 0 412059 179 0 0 25 0 1 0 801199864 3600302080 854134 33554432000 4194304 4394578 140737251972512 18446744073709551615 4327678 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 878980 854134 267 49 0 876121 0
Current children cumulated CPU time (s) 4122.38
Current children cumulated vsize (KiB) 3515920

[startup+4182.3 s]
/proc/loadavg: 1.00 1.12 1.49 2/468 9578
/proc/meminfo: memFree=3040968/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3595208 CPUtime=4182.37 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 875340 0 0 0 418055 182 0 0 25 0 1 0 801199864 3681492992 873863 33554432000 4194304 4394578 140737251972512 18446744073709551615 4346169 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 898802 873863 267 49 0 895943 0
Current children cumulated CPU time (s) 4182.37
Current children cumulated vsize (KiB) 3595208

[startup+4242.3 s]
/proc/loadavg: 1.00 1.10 1.45 2/468 9580
/proc/meminfo: memFree=3001260/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3637240 CPUtime=4242.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 885660 0 0 0 424053 185 0 0 25 0 1 0 801199864 3724533760 884183 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298767 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 909310 884183 267 49 0 906451 0
Current children cumulated CPU time (s) 4242.38
Current children cumulated vsize (KiB) 3637240

[startup+4302.3 s]
/proc/loadavg: 1.00 1.08 1.42 2/468 9581
/proc/meminfo: memFree=2864692/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3773980 CPUtime=4302.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 919652 0 0 0 430047 191 0 0 25 0 1 0 801199864 3864555520 918175 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298724 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 943495 918175 267 49 0 940636 0
Current children cumulated CPU time (s) 4302.38
Current children cumulated vsize (KiB) 3773980

[startup+4362.3 s]
/proc/loadavg: 1.12 1.09 1.41 2/468 9583
/proc/meminfo: memFree=2735584/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3902384 CPUtime=4362.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 951650 0 0 0 436041 197 0 0 25 0 1 0 801199864 3996041216 950173 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 975596 950173 267 49 0 972737 0
Current children cumulated CPU time (s) 4362.38
Current children cumulated vsize (KiB) 3902384

[startup+4422.3 s]
/proc/loadavg: 1.10 1.09 1.38 2/468 9584
/proc/meminfo: memFree=2727612/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=3911428 CPUtime=4422.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 953674 0 0 0 442041 197 0 0 25 0 1 0 801199864 4005302272 952197 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298812 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 977857 952197 267 49 0 974998 0
Current children cumulated CPU time (s) 4422.38
Current children cumulated vsize (KiB) 3911428

[startup+4482.3 s]
/proc/loadavg: 1.04 1.07 1.35 2/468 9586
/proc/meminfo: memFree=2603984/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4034904 CPUtime=4482.38 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 984394 0 0 0 448033 205 0 0 25 0 1 0 801199864 4131741696 982917 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1008726 982917 267 49 0 1005867 0
Current children cumulated CPU time (s) 4482.38
Current children cumulated vsize (KiB) 4034904

[startup+4542.3 s]
/proc/loadavg: 1.01 1.05 1.33 2/468 9588
/proc/meminfo: memFree=2515676/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4126164 CPUtime=4542.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1007012 0 0 0 454026 213 0 0 25 0 1 0 801199864 4225191936 1005535 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1031541 1005535 267 49 0 1028682 0
Current children cumulated CPU time (s) 4542.39
Current children cumulated vsize (KiB) 4126164

[startup+4602.3 s]
/proc/loadavg: 1.00 1.04 1.31 2/468 9589
/proc/meminfo: memFree=2470484/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4169632 CPUtime=4602.4 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1017607 0 0 0 460024 216 0 0 25 0 1 0 801199864 4269703168 1016130 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1042408 1016130 267 49 0 1039549 0
Current children cumulated CPU time (s) 4602.4
Current children cumulated vsize (KiB) 4169632

[startup+4662.3 s]
/proc/loadavg: 1.00 1.03 1.28 2/468 9591
/proc/meminfo: memFree=2362852/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4281788 CPUtime=4662.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1045568 0 0 0 466015 224 0 0 25 0 1 0 801199864 4384550912 1044091 33554432000 4194304 4394578 140737251972512 18446744073709551615 274473628357 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1070447 1044091 267 49 0 1067588 0
Current children cumulated CPU time (s) 4662.39
Current children cumulated vsize (KiB) 4281788

[startup+4722.32 s]
/proc/loadavg: 1.00 1.02 1.26 2/468 9592
/proc/meminfo: memFree=2279396/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4362112 CPUtime=4722.41 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1065355 0 0 0 472011 230 0 0 25 0 1 0 801199864 4466802688 1063878 33554432000 4194304 4394578 140737251972512 18446744073709551615 4327612 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1090528 1063878 267 49 0 1087669 0
Current children cumulated CPU time (s) 4722.41
Current children cumulated vsize (KiB) 4362112

[startup+4782.3 s]
/proc/loadavg: 1.00 1.02 1.25 2/468 9594
/proc/meminfo: memFree=2274116/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4369280 CPUtime=4782.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1066715 0 0 0 478009 230 0 0 25 0 1 0 801199864 4474142720 1065238 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1092320 1065238 267 49 0 1089461 0
Current children cumulated CPU time (s) 4782.39
Current children cumulated vsize (KiB) 4369280

[startup+4842.3 s]
/proc/loadavg: 1.00 1.01 1.23 2/468 9596
/proc/meminfo: memFree=2269560/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4373632 CPUtime=4842.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1067624 0 0 0 484009 230 0 0 25 0 1 0 801199864 4478599168 1066147 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1093408 1066147 267 49 0 1090549 0
Current children cumulated CPU time (s) 4842.39
Current children cumulated vsize (KiB) 4373632

[startup+4902.3 s]
/proc/loadavg: 1.00 1.01 1.21 2/468 9606
/proc/meminfo: memFree=2194388/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4450728 CPUtime=4902.39 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1086925 0 0 0 490004 235 0 0 25 0 1 0 801199864 4557545472 1085448 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298326 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1112682 1085448 267 49 0 1109823 0
Current children cumulated CPU time (s) 4902.39
Current children cumulated vsize (KiB) 4450728

[startup+4962.3 s]
/proc/loadavg: 1.08 1.02 1.20 2/468 9608
/proc/meminfo: memFree=2069968/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4574560 CPUtime=4962.4 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1117719 0 0 0 495998 242 0 0 25 0 1 0 801199864 4684349440 1116242 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298826 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1143640 1116242 267 49 0 1140781 0
Current children cumulated CPU time (s) 4962.4
Current children cumulated vsize (KiB) 4574560



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 1.04 1.01 1.19 2/468 9609
/proc/meminfo: memFree=2051760/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=4593148 CPUtime=5000.1 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4202496 1122123 0 0 0 499768 242 0 0 25 0 1 0 801199864 4703383552 1120646 33554432000 4194304 4394578 140737251972512 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/9430/statm: 1148287 1120646 267 49 0 1145428 0
Current children cumulated CPU time (s) 5000.1
Current children cumulated vsize (KiB) 4593148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.2 s]
/proc/loadavg: 1.04 1.01 1.19 2/468 9609
/proc/meminfo: memFree=2051760/32950928 swapFree=61858088/67111528
[pid=9430] ppid=9428 vsize=0 CPUtime=5000.3 cores=1,3,5,7
/proc/9430/stat : 9430 (SApperloT2010) R 9428 9430 8442 0 -1 4203524 1122123 0 0 0 499769 261 0 0 25 0 1 0 801199864 0 0 33554432000 0 0 0 0 0 0 0 4096 6 18446744073709551615 0 0 17 1 0 0 0
/proc/9430/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.21
CPU time (s): 5000.32
CPU user time (s): 4997.69
CPU system time (s): 2.6226
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 4593148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4997.69
system time used= 2.6226
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1122123
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 5937

runsolver used 21.6117 second user time and 55.6395 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-01 04:40:02
IDJOB=3438758
IDBENCH=83167
IDSOLVER=1933
FILE ID=node125/3438758-1306896002
RUNJOBID= node125-1306884535-8461
PBS_JOBID= 13488451
Free space on /tmp= 59004 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x14.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438758-1306896002/watcher-3438758-1306896002 -o /tmp/evaluation-result-3438758-1306896002/solver-3438758-1306896002 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438758-1306896002.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f76302f2442dfc7cabc2315e61e55fea
RANDOM SEED=817847303

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       4034576 kB
Buffers:        313992 kB
Cached:       18017708 kB
SwapCached:       6896 kB
Active:       16261260 kB
Inactive:     11985556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       4034576 kB
SwapTotal:    67111528 kB
SwapFree:     62386516 kB
Dirty:            1604 kB
Writeback:           0 kB
AnonPages:     9909312 kB
Mapped:          34276 kB
Slab:           537208 kB
PageTables:      63720 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 131038520 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 59004 MiB
End job on node125 at 2011-06-01 06:03:24