Trace number 3188497

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-03-01? (TO) 1299.95 1300.03

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v25000-c105000-S30704505-092-UNKNOWN.cnf
MD5SUM15b86e0c1384321ea7bbac2466a811a7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark318.072
Satisfiable
(Un)Satisfiability was proved
Number of variables25000
Number of clauses105000
Sum of the clauses size315000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3105000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Set FPU double precision.
0.09/0.13	c Parse Cnf success: #var: 25000 #clause: 105000
0.09/0.13	c Find Units :          0
0.09/0.13	c Find Invs  :          0
0.09/0.13	c Find Ands  :          0 AvgFaninNum: nan
0.09/0.14	c Find Xors  :          0 AvgFaninNum: nan
0.09/0.15	c Find Ite   :          0
0.19/0.20	c UnDirect variable: 0
0.19/0.20	c UnDirect to Direct Gate: 0
0.19/0.20	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
0.19/0.20	c Break Cycle : 0
0.19/0.20	c Total Root : 0 Undef Var: 25000
0.19/0.20	c After covering, Total Root: 0 Leaf: 0
0.19/0.20	c Variable( cover/uncovered/unused ): 0 25000 0
0.19/0.20	c Unit Clauses: 0
0.19/0.20	c Binary Clauses( cover/uncovered ): 0 0
0.19/0.20	c Clauses( cover/uncovered ): 0 105000
0.19/0.20	c Total Clauses( cover/uncovered ): 0 105000 0%
0.19/0.20	c Covered Ands: 0 Invs: 0 Xors: 0 Ites: 0
0.29/0.30	c Uncover Clauses avg size: 3 max size: 3
0.29/0.30	c Final circuit: i/l/o/s   25000       0  105000    209992
0.29/0.30	c CnfToAig: Time: 0.3 s
0.39/0.46	c TmMap: Set choices finish.
0.48/0.54	c TmMap: Set big and: 105000
0.48/0.54	c TmMap: Origin: 234993 ClauseNum: 629976 --> New: 130001 ClauseNum: 420000
0.48/0.54	c TmMap: Time: 0.11
0.48/0.57	c Try to Add: #clause: 210000 #xorclause: 0
0.59/0.62	c #var: 25000 #clauses: 105001 Solving... 
1299.91/1300.00	c Time Out !!
1299.91/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3188497-1302281585/watcher-3188497-1302281585 -o /tmp/evaluation-result-3188497-1302281585/solver-3188497-1302281585 -C 2400 -W 1300 -M 7680 qutersat_release HOME/instance-3188497-1302281585.cnf 961200063 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.97 4.73 4/190 11651
/proc/meminfo: memFree=10882100/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=33388 CPUtime=0 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 1985 0 0 0 0 0 0 0 25 0 1 0 339756702 34189312 1918 33554432000 4194304 6016207 140737183906384 18446744073709551615 4796955 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 8347 1918 379 445 0 1891 0

[startup+0.038829 s]
/proc/loadavg: 3.68 3.97 4.73 4/190 11651
/proc/meminfo: memFree=10882100/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=41580 CPUtime=0.03 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 4078 0 0 0 3 0 0 0 25 0 1 0 339756702 42577920 4011 33554432000 4194304 6016207 140737183906384 18446744073709551615 4779602 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 10395 4012 379 445 0 3939 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 41580

[startup+0.10083 s]
/proc/loadavg: 3.68 3.97 4.73 4/190 11651
/proc/meminfo: memFree=10882100/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=60140 CPUtime=0.09 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 8662 0 0 0 9 0 0 0 25 0 1 0 339756702 61583360 8595 33554432000 4194304 6016207 140737183906384 18446744073709551615 4305236 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 15035 8595 379 445 0 8579 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 60140

[startup+0.300795 s]
/proc/loadavg: 3.68 3.97 4.73 4/190 11651
/proc/meminfo: memFree=10882100/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=66284 CPUtime=0.29 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 10461 0 0 0 28 1 0 0 25 0 1 0 339756702 67874816 10394 33554432000 4194304 6016207 140737183906384 18446744073709551615 4268367 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 16571 10394 400 445 0 10115 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 66284

[startup+0.700734 s]
/proc/loadavg: 3.68 3.97 4.73 4/190 11651
/proc/meminfo: memFree=10882100/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=108288 CPUtime=0.69 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 21255 0 0 0 67 2 0 0 25 0 1 0 339756702 110886912 21188 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425075 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 27072 21188 694 445 0 20616 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 108288

[startup+1.50058 s]
/proc/loadavg: 3.68 3.97 4.73 5/194 11659
/proc/meminfo: memFree=10680952/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=108288 CPUtime=1.49 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 21281 0 0 0 147 2 0 0 25 0 1 0 339756702 110886912 21214 33554432000 4194304 6016207 140737183906384 18446744073709551615 4378010 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 27072 21214 719 445 0 20616 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 108288

[startup+3.10024 s]
/proc/loadavg: 3.68 3.97 4.73 5/194 11659
/proc/meminfo: memFree=10674504/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=141104 CPUtime=3.09 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 21745 0 0 0 307 2 0 0 25 0 1 0 339756702 144490496 21678 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425261 0 0 4096 16386 0 0 0 17 6 0 0 0
/proc/11651/statm: 35276 21678 719 445 0 28820 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 141104

[startup+6.30073 s]
/proc/loadavg: 3.71 3.97 4.72 5/194 11659
/proc/meminfo: memFree=10634204/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=141104 CPUtime=6.28 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 24298 0 0 0 626 2 0 0 25 0 1 0 339756702 144490496 24232 33554432000 4194304 6016207 140737183906384 18446744073709551615 4378517 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 35276 24232 719 445 0 28820 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 141104

[startup+12.7006 s]
/proc/loadavg: 3.73 3.97 4.72 5/194 11659
/proc/meminfo: memFree=10508364/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=223712 CPUtime=12.68 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 38743 0 0 0 1264 4 0 0 25 0 1 0 339756702 229081088 38676 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425860 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 55928 38676 727 445 0 49472 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 223712

[startup+25.5003 s]
/proc/loadavg: 3.79 3.97 4.71 5/194 11659
/proc/meminfo: memFree=10407804/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=355504 CPUtime=25.46 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 46229 0 0 0 2541 5 0 0 25 0 1 0 339756702 364036096 46162 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425254 0 0 4096 16386 0 0 0 17 6 0 0 0
/proc/11651/statm: 88876 46162 727 445 0 82420 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 355504

[startup+51.1008 s]
/proc/loadavg: 3.86 3.97 4.69 5/194 11660
/proc/meminfo: memFree=10235248/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=355760 CPUtime=51.03 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 65824 0 0 0 5096 7 0 0 25 0 1 0 339756702 364298240 65741 33554432000 4194304 6016207 140737183906384 18446744073709551615 4378526 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 88940 65741 727 445 0 82484 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 355760

[startup+102.307 s]
/proc/loadavg: 4.02 3.99 4.65 5/194 11661
/proc/meminfo: memFree=10046148/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=388168 CPUtime=102.18 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 80992 0 0 0 10209 9 0 0 25 0 1 0 339756702 397484032 80757 33554432000 4194304 6016207 140737183906384 18446744073709551615 4380376 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 97042 80757 727 445 0 90586 0
Current children cumulated CPU time (s) 102.18
Current children cumulated vsize (KiB) 388168

[startup+162.301 s]
/proc/loadavg: 4.06 4.00 4.61 5/194 11663
/proc/meminfo: memFree=9985752/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=457148 CPUtime=162.18 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 88853 0 0 0 16207 11 0 0 25 0 1 0 339756702 468119552 87092 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425392 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 114287 87092 727 445 0 107831 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 457148

[startup+222.3 s]
/proc/loadavg: 4.09 4.02 4.58 5/194 11664
/proc/meminfo: memFree=9887752/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=513008 CPUtime=222.18 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 98958 0 0 0 22205 13 0 0 25 0 1 0 339756702 525320192 97197 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425742 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 128252 97197 727 445 0 121796 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 513008

[startup+282.301 s]
/proc/loadavg: 4.06 4.03 4.54 5/194 11666
/proc/meminfo: memFree=9806768/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=513008 CPUtime=282.18 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 99840 0 0 0 28205 13 0 0 25 0 1 0 339756702 525320192 98079 33554432000 4194304 6016207 140737183906384 18446744073709551615 4426512 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 128252 98079 727 445 0 121796 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 513008

[startup+342.301 s]
/proc/loadavg: 4.10 4.04 4.51 5/194 11667
/proc/meminfo: memFree=9796700/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=513008 CPUtime=342.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 101086 0 0 0 34205 14 0 0 25 0 1 0 339756702 525320192 99325 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425088 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 128252 99325 727 445 0 121796 0
Current children cumulated CPU time (s) 342.19
Current children cumulated vsize (KiB) 513008

[startup+402.3 s]
/proc/loadavg: 4.04 4.03 4.48 5/194 11669
/proc/meminfo: memFree=9675916/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=569592 CPUtime=402.18 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 114413 0 0 0 40201 17 0 0 25 0 1 0 339756702 583262208 112652 33554432000 4194304 6016207 140737183906384 18446744073709551615 4424136 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 142398 112652 727 445 0 135942 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 569592

[startup+462.301 s]
/proc/loadavg: 4.01 4.02 4.44 5/194 11671
/proc/meminfo: memFree=9634128/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=462.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 122643 0 0 0 46201 18 0 0 25 0 1 0 339756702 641421312 120882 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425840 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 120882 727 445 0 150141 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 626388

[startup+522.301 s]
/proc/loadavg: 4.00 4.02 4.42 5/194 11681
/proc/meminfo: memFree=9555872/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=522.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 123451 0 0 0 52201 18 0 0 25 0 1 0 339756702 641421312 121690 33554432000 4194304 6016207 140737183906384 18446744073709551615 4380992 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 121690 727 445 0 150141 0
Current children cumulated CPU time (s) 522.19
Current children cumulated vsize (KiB) 626388

[startup+582.301 s]
/proc/loadavg: 4.00 4.01 4.39 5/194 11683
/proc/meminfo: memFree=9466456/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=582.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 124096 0 0 0 58201 18 0 0 25 0 1 0 339756702 641421312 122335 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425530 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 122335 727 445 0 150141 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 626388

[startup+642.301 s]
/proc/loadavg: 4.00 4.00 4.36 5/194 11684
/proc/meminfo: memFree=9431596/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=642.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 127393 0 0 0 64201 18 0 0 25 0 1 0 339756702 641421312 125632 33554432000 4194304 6016207 140737183906384 18446744073709551615 4377997 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 125632 727 445 0 150141 0
Current children cumulated CPU time (s) 642.19
Current children cumulated vsize (KiB) 626388

[startup+702.3 s]
/proc/loadavg: 4.08 4.02 4.34 5/194 11689
/proc/meminfo: memFree=9426204/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=702.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 127859 0 0 0 70200 19 0 0 25 0 1 0 339756702 641421312 126098 33554432000 4194304 6016207 140737183906384 18446744073709551615 4385057 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 126098 727 445 0 150141 0
Current children cumulated CPU time (s) 702.19
Current children cumulated vsize (KiB) 626388

[startup+762.307 s]
/proc/loadavg: 4.03 4.01 4.32 5/194 11691
/proc/meminfo: memFree=9381712/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=762.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 128287 0 0 0 76201 19 0 0 25 0 1 0 339756702 641421312 126526 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 126526 727 445 0 150141 0
Current children cumulated CPU time (s) 762.2
Current children cumulated vsize (KiB) 626388

[startup+822.301 s]
/proc/loadavg: 4.05 4.02 4.30 5/194 11692
/proc/meminfo: memFree=9350580/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=626388 CPUtime=822.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 129095 0 0 0 82200 19 0 0 25 0 1 0 339756702 641421312 127334 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425742 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 156597 127334 727 445 0 150141 0
Current children cumulated CPU time (s) 822.19
Current children cumulated vsize (KiB) 626388

[startup+882.3 s]
/proc/loadavg: 4.02 4.02 4.27 5/194 11694
/proc/meminfo: memFree=9227556/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=686296 CPUtime=882.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 153908 0 0 0 88195 25 0 0 25 0 1 0 339756702 702767104 152031 33554432000 4194304 6016207 140737183906384 18446744073709551615 4424313 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 171574 152031 727 445 0 165118 0
Current children cumulated CPU time (s) 882.2
Current children cumulated vsize (KiB) 686296

[startup+942.301 s]
/proc/loadavg: 4.07 4.03 4.26 5/194 11695
/proc/meminfo: memFree=9216268/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=746576 CPUtime=942.19 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 155639 0 0 0 94194 25 0 0 25 0 1 0 339756702 764493824 153762 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 186644 153762 727 445 0 180188 0
Current children cumulated CPU time (s) 942.19
Current children cumulated vsize (KiB) 746576

[startup+1002.3 s]
/proc/loadavg: 4.02 4.02 4.24 5/194 11697
/proc/meminfo: memFree=9156860/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=746576 CPUtime=1002.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 156275 0 0 0 100194 26 0 0 25 0 1 0 339756702 764493824 154398 33554432000 4194304 6016207 140737183906384 18446744073709551615 4373888 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 186644 154398 727 445 0 180188 0
Current children cumulated CPU time (s) 1002.2
Current children cumulated vsize (KiB) 746576

[startup+1062.3 s]
/proc/loadavg: 4.07 4.04 4.24 5/194 11699
/proc/meminfo: memFree=9110852/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=746576 CPUtime=1062.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 156728 0 0 0 106194 26 0 0 25 0 1 0 339756702 764493824 154851 33554432000 4194304 6016207 140737183906384 18446744073709551615 4424309 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 186644 154851 727 445 0 180188 0
Current children cumulated CPU time (s) 1062.2
Current children cumulated vsize (KiB) 746576

[startup+1122.3 s]
/proc/loadavg: 4.02 4.03 4.22 5/194 11700
/proc/meminfo: memFree=9071664/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=989512 CPUtime=1122.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 160504 0 0 0 112194 26 0 0 25 0 1 0 339756702 1013260288 158626 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 247378 158626 727 445 0 240922 0
Current children cumulated CPU time (s) 1122.2
Current children cumulated vsize (KiB) 989512

[startup+1182.3 s]
/proc/loadavg: 4.04 4.04 4.21 5/194 11702
/proc/meminfo: memFree=9052560/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=1233236 CPUtime=1182.2 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 161008 0 0 0 118194 26 0 0 25 0 1 0 339756702 1262833664 159060 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 308309 159060 727 445 0 301853 0
Current children cumulated CPU time (s) 1182.2
Current children cumulated vsize (KiB) 1233236

[startup+1242.3 s]
/proc/loadavg: 4.01 4.03 4.19 5/194 11703
/proc/meminfo: memFree=9101408/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=1233236 CPUtime=1242.21 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 161480 0 0 0 124194 27 0 0 25 0 1 0 339756702 1262833664 146122 33554432000 4194304 6016207 140737183906384 18446744073709551615 4425254 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 308309 146122 727 445 0 301853 0
Current children cumulated CPU time (s) 1242.21
Current children cumulated vsize (KiB) 1233236



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.09 4.05 4.18 3/191 11707
/proc/meminfo: memFree=9798184/32951124 swapFree=67111528/67111528
[pid=11651] ppid=11649 vsize=1233364 CPUtime=1299.91 cores=4,6
/proc/11651/stat : 11651 (qutersat_releas) R 11649 11651 11451 0 -1 4202496 178146 0 0 0 129963 28 0 0 25 0 1 0 339756702 1262964736 162788 33554432000 4194304 6016207 140737183906384 18446744073709551615 4567822 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11651/statm: 308341 162788 727 445 0 301885 0
Current children cumulated CPU time (s) 1299.91
Current children cumulated vsize (KiB) 1233364

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 1
Real time (s): 1300.03
CPU time (s): 1299.95
CPU user time (s): 1299.63
CPU system time (s): 0.312952
CPU usage (%): 99.9935
Max. virtual memory (cumulated for all children) (KiB): 1233364

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.63
system time used= 0.312952
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 178151
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 14142

runsolver used 2.20066 second user time and 4.90425 second system time

The end

Launcher Data 

Begin job on node132 at 2011-04-08 18:53:05
IDJOB=3188497
IDBENCH=82628
IDSOLVER=1607
FILE ID=node132/3188497-1302281585
RUNJOBID= node132-1302280283-11470
PBS_JOBID= 12919067
Free space on /tmp= 71280 MiB

SOLVER NAME= QuteRSat 2011-03-01
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v25000-c105000-S30704505-092-UNKNOWN.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3188497-1302281585/watcher-3188497-1302281585 -o /tmp/evaluation-result-3188497-1302281585/solver-3188497-1302281585 -C 2400 -W 1300 -M 7680  qutersat_release HOME/instance-3188497-1302281585.cnf 961200063

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 15b86e0c1384321ea7bbac2466a811a7
RANDOM SEED=961200063

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10882512 kB
Buffers:        512380 kB
Cached:       21016004 kB
SwapCached:          0 kB
Active:       10328456 kB
Inactive:     11322256 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10882512 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            8600 kB
Writeback:           0 kB
AnonPages:      122604 kB
Mapped:          17028 kB
Slab:           353996 kB
PageTables:       4876 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   287876 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71276 MiB
End job on node132 at 2011-04-08 19:14:47