Trace number 1779673

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 528.96 303.562

General information on the benchmark

NameAPPLICATIONS/aprove09/
AProVE09-05.cnf
MD5SUMaf775a2959a121dbdf88d251c7971506
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.9
Satisfiable
(Un)Satisfiability was proved
Number of variables14685
Number of clauses49510
Sum of the clauses size127630
Maximum clause length38
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 222578
Number of clauses of size 325464
Number of clauses of size 41414
Number of clauses of size 515
Number of clauses of size over 538

Solver Data 

0.00/0.11	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779673-1243679567.cnf 
0.00/0.11	c Using SATTIMEOUT of 10000
0.00/0.11	c Using SATRAM of 2047
0.00/0.11	c Size of subset node = 16
0.00/0.11	c Variables = 14685
0.00/0.11	c Clauses = 49510
0.00/0.11	c Literals = 127630
0.00/0.11	c Reduced size:
0.00/0.11	c Variables = 14685
0.00/0.11	c Clauses = 49029
0.00/0.11	c Literals = 126227
0.00/0.11	c a2
0.00/0.19	c a1
2.43/4.15	c Independent sub-problems = 1
2.43/4.15	c Sub-problem with 14639 variables and 49029 clauses
2.43/4.15	c using permutation method 4
2.43/4.15	c count = 1
2.43/4.15	c Ordering finished 2.440 seconds
2.43/4.15	c mapped 2.470 seconds
2.43/4.15	c permuted 2.470 seconds
2.43/4.15	c about to sort
2.43/4.16	c sorted
2.80/4.88	c clauses now 49029
2.80/4.88	c init finished 2.570 seconds
2.80/4.88	c tree built 2.800 seconds
2.80/4.88	c 
2.80/4.88	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
2.80/4.88	c ---------------------------------|----------------------------------|------------------------------------------------------
2.80/4.88	c ................................ | ..........                       |                        2.8           0.0             
2.80/4.88	c ................................ | ..........                     1 |                        2.8           0.4             
2.80/4.88	c ................................ | ..........                     2 |                        2.8           0.7             
2.80/4.88	c ................................ | ..........                     3 |                        2.8           1.1             
2.80/4.88	c ................................ | ..........                     4 |                        2.8           1.4             
2.80/4.88	c ................................ | ..........                     5 |                        2.8           1.8             
2.80/4.88	c ................................ | ..........                  1000 | 21                     2.8         357.1          541
200.04/118.28	c ................................ | ..........               2301000 | 225020               200.1       11497.5     51314918
399.90/230.26	c ................................ | ..........               4013000 | 379396               400.0       10032.2     95924808

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779673-1243679567/watcher-1779673-1243679567 -o /tmp/evaluation-result-1779673-1243679567/solver-1779673-1243679567 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779673-1243679567.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 8.68 8.61 7.78 6/113 6767
/proc/meminfo: memFree=2169528/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=1140 CPUtime=0
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 170 0 0 0 0 0 0 0 18 0 1 0 1122094027 1167360 126 4294967295 134512640 135237372 3214816560 3214815084 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 285 127 74 177 0 107 0

[startup+0.213068 s]
/proc/loadavg: 8.68 8.61 7.78 6/113 6767
/proc/meminfo: memFree=2169528/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=8364 CPUtime=0.2
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 1950 0 0 0 20 0 0 0 18 0 1 0 1122094027 8564736 1905 4294967295 134512640 135237372 3214816560 3214816064 134540092 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2091 1905 76 177 0 1913 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 8364

[startup+0.313063 s]
/proc/loadavg: 8.68 8.61 7.78 6/113 6767
/proc/meminfo: memFree=2169528/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=10008 CPUtime=0.3
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 2463 0 0 0 30 0 0 0 18 0 1 0 1122094027 10248192 2321 4294967295 134512640 135237372 3214816560 3214815888 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2502 2321 77 177 0 2324 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 10008

[startup+0.413053 s]
/proc/loadavg: 8.68 8.61 7.78 6/113 6767
/proc/meminfo: memFree=2169528/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=10008 CPUtime=0.4
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 2473 0 0 0 40 0 0 0 18 0 1 0 1122094027 10248192 2331 4294967295 134512640 135237372 3214816560 3214815888 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2502 2331 77 177 0 2324 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 10008

[startup+0.713028 s]
/proc/loadavg: 8.68 8.61 7.78 6/113 6767
/proc/meminfo: memFree=2169528/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=10008 CPUtime=0.7
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 2487 0 0 0 70 0 0 0 18 0 1 0 1122094027 10248192 2345 4294967295 134512640 135237372 3214816560 3214815888 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2502 2345 77 177 0 2324 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 10008

[startup+1.51297 s]
/proc/loadavg: 8.38 8.55 7.76 7/114 6768
/proc/meminfo: memFree=2161036/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=10340 CPUtime=1.13
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 2529 0 0 0 113 0 0 0 19 0 1 0 1122094027 10588160 2387 4294967295 134512640 135237372 3214816560 3214815888 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2585 2387 77 177 0 2407 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 10340

[startup+3.11284 s]
/proc/loadavg: 8.38 8.55 7.76 8/115 6789
/proc/meminfo: memFree=2160096/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=10628 CPUtime=1.93
/proc/6767/stat : 6767 (ttsth-5-0) R 6765 6767 14986 0 -1 4202496 2631 0 0 0 193 0 0 0 21 0 1 0 1122094027 10883072 2489 4294967295 134512640 135237372 3214816560 3214815888 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/6767/statm: 2657 2489 77 177 0 2479 0
Current children cumulated CPU time (s) 1.93
Current children cumulated vsize (KiB) 10628
heavy processes:
  %CPU=86 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=86 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=87 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+6.31259 s]
/proc/loadavg: 8.38 8.55 7.76 12/119 6875
/proc/meminfo: memFree=2104060/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=105716 CPUtime=4.23
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 18441 0 0 0 417 6 0 0 24 0 5 0 1122094027 108253184 18203 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 26429 18203 95 177 0 26251 0
[pid=6767/tid=6831] ppid=6765 vsize=105716 CPUtime=0.41
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 574 0 0 0 40 1 0 0 25 0 5 0 1122094506 108253184 18203 4294967295 134512640 135237372 3214816560 3084714896 134680737 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=105716 CPUtime=0.35
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 806 0 0 0 35 0 0 0 24 0 5 0 1122094517 108253184 18203 4294967295 134512640 135237372 3214816560 3076491968 134550994 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=105716 CPUtime=0.33
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 870 0 0 0 33 0 0 0 25 0 5 0 1122094517 108253184 18203 4294967295 134512640 135237372 3214816560 3068086576 134590267 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=105716 CPUtime=0.34
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 697 0 0 0 33 1 0 0 25 0 5 0 1122094517 108253184 18203 4294967295 134512640 135237372 3214816560 3059764312 134636382 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.23
Current children cumulated vsize (KiB) 105716
heavy processes:
  %CPU=86 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=85 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=86 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=87 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+12.7121 s]
/proc/loadavg: 8.55 8.58 7.78 10/118 6955
/proc/meminfo: memFree=2032176/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=179924 CPUtime=15.35
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 35899 0 0 0 1519 16 0 0 24 0 5 0 1122094027 184242176 35661 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 44981 35661 95 177 0 44803 0
[pid=6767/tid=6831] ppid=6765 vsize=179924 CPUtime=3.41
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 4421 0 0 0 335 6 0 0 25 0 5 0 1122094506 184242176 35661 4294967295 134512640 135237372 3214816560 3084653088 134680226 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=179924 CPUtime=3.05
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 5830 0 0 0 302 3 0 0 25 0 5 0 1122094517 184242176 35661 4294967295 134512640 135237372 3214816560 3076542224 134562328 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=179924 CPUtime=2.95
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 4810 0 0 0 295 0 0 0 25 0 5 0 1122094517 184242176 35661 4294967295 134512640 135237372 3214816560 3067914688 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=179924 CPUtime=3.14
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 5344 0 0 0 311 3 0 0 25 0 5 0 1122094517 184242176 35661 4294967295 134512640 135237372 3214816560 3059763680 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 15.35
Current children cumulated vsize (KiB) 179924

[startup+25.5211 s]
/proc/loadavg: 8.62 8.59 7.79 9/118 6955
/proc/meminfo: memFree=1922680/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=288744 CPUtime=37.13
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 62171 0 0 0 3686 27 0 0 24 0 5 0 1122094027 295673856 61933 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 72186 61933 95 177 0 72008 0
[pid=6767/tid=6831] ppid=6765 vsize=288744 CPUtime=8.85
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 11845 0 0 0 877 8 0 0 25 0 5 0 1122094506 295673856 61933 4294967295 134512640 135237372 3214816560 3084576480 134751534 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=288744 CPUtime=8.35
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 11495 0 0 0 830 5 0 0 25 0 5 0 1122094517 295673856 61933 4294967295 134512640 135237372 3214816560 3076324012 134749365 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=288744 CPUtime=8.45
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 10774 0 0 0 842 3 0 0 25 0 5 0 1122094517 295673856 61933 4294967295 134512640 135237372 3214816560 3067846532 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=288744 CPUtime=8.68
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 12563 0 0 0 861 7 0 0 25 0 5 0 1122094517 295673856 61933 4294967295 134512640 135237372 3214816560 3059721328 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.13
Current children cumulated vsize (KiB) 288744

[startup+51.1091 s]
/proc/loadavg: 8.75 8.62 7.82 9/118 6957
/proc/meminfo: memFree=1741140/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=480412 CPUtime=82.59
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 107888 0 0 0 8218 41 0 0 24 0 5 0 1122094027 491941888 107650 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 120103 107650 95 177 0 119925 0
[pid=6767/tid=6831] ppid=6765 vsize=480412 CPUtime=20.39
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 24365 0 0 0 2027 12 0 0 25 0 5 0 1122094506 491941888 107650 4294967295 134512640 135237372 3214816560 3084581408 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=480412 CPUtime=19.65
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 18472 0 0 0 1955 10 0 0 25 0 5 0 1122094517 491941888 107650 4294967295 134512640 135237372 3214816560 3076330704 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=480412 CPUtime=19.83
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 25908 0 0 0 1978 5 0 0 25 0 5 0 1122094517 491941888 107650 4294967295 134512640 135237372 3214816560 3067924336 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=480412 CPUtime=19.93
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 23649 0 0 0 1983 10 0 0 25 0 5 0 1122094517 491941888 107650 4294967295 134512640 135237372 3214816560 3059765200 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 82.59
Current children cumulated vsize (KiB) 480412

[startup+102.305 s]
/proc/loadavg: 8.75 8.64 7.87 9/118 7144
/proc/meminfo: memFree=1402624/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=839072 CPUtime=170.87
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 192899 0 0 0 17012 75 0 0 24 0 5 0 1122094027 859209728 192661 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 209768 192661 95 177 0 209590 0
[pid=6767/tid=6831] ppid=6765 vsize=839072 CPUtime=42.51
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 46485 0 0 0 4235 16 0 0 25 0 5 0 1122094506 859209728 192661 4294967295 134512640 135237372 3214816560 3084596992 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=839072 CPUtime=41.48
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 37319 0 0 0 4130 18 0 0 25 0 5 0 1122094517 859209728 192661 4294967295 134512640 135237372 3214816560 3076280048 134680503 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=839072 CPUtime=41.57
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 52150 0 0 0 4140 17 0 0 24 0 5 0 1122094517 859209728 192661 4294967295 134512640 135237372 3214816560 3067936704 134562380 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=839072 CPUtime=42.51
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 41451 0 0 0 4231 20 0 0 25 0 5 0 1122094517 859209728 192661 4294967295 134512640 135237372 3214816560 3059762480 134562341 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 170.87
Current children cumulated vsize (KiB) 839072

[startup+162.31 s]
/proc/loadavg: 8.71 8.63 7.92 9/118 7333
/proc/meminfo: memFree=1025716/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=1234368 CPUtime=277.66
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 286034 0 0 0 27638 128 0 0 24 0 5 0 1122094027 1263992832 285796 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 308592 285796 95 177 0 308414 0
[pid=6767/tid=6831] ppid=6765 vsize=1234368 CPUtime=69.17
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 70214 0 0 0 6893 24 0 0 25 0 5 0 1122094506 1263992832 285796 4294967295 134512640 135237372 3214816560 3084743024 134546026 0 0 0 0 3223098951 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=1234368 CPUtime=68.45
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 57899 0 0 0 6814 31 0 0 25 0 5 0 1122094517 1263992832 285796 4294967295 134512640 135237372 3214816560 3076300752 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=1234368 CPUtime=67.93
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 82279 0 0 0 6756 37 0 0 25 0 5 0 1122094517 1263992832 285796 4294967295 134512640 135237372 3214816560 3067878680 134758929 0 0 0 0 3223098951 0 0 -1 1 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=1234368 CPUtime=69.31
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 60148 0 0 0 6899 32 0 0 25 0 5 0 1122094517 1263992832 285796 4294967295 134512640 135237372 3214816560 3059750864 134546026 0 0 0 0 3223098951 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 277.66
Current children cumulated vsize (KiB) 1234368

[startup+222.306 s]
/proc/loadavg: 8.66 8.63 7.96 9/118 7522
/proc/meminfo: memFree=635252/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=1641968 CPUtime=386.42
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 382737 0 0 0 38473 169 0 0 24 0 5 0 1122094027 1681375232 382499 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 410492 382500 95 177 0 410314 0
[pid=6767/tid=6831] ppid=6765 vsize=1641968 CPUtime=95.21
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 95050 0 0 0 9484 37 0 0 25 0 5 0 1122094506 1681375232 382500 4294967295 134512640 135237372 3214816560 3084634656 134751534 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=1641968 CPUtime=95.36
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 80137 0 0 0 9500 36 0 0 25 0 5 0 1122094517 1681375232 382501 4294967295 134512640 135237372 3214816560 3076264512 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=1641968 CPUtime=97.44
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 117309 0 0 0 9691 53 0 0 25 0 5 0 1122094517 1681375232 382501 4294967295 134512640 135237372 3214816560 3067934992 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=1641968 CPUtime=95.61
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 74749 0 0 0 9522 39 0 0 25 0 5 0 1122094517 1681375232 382501 4294967295 134512640 135237372 3214816560 3059727792 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 386.42
Current children cumulated vsize (KiB) 1641968

[startup+282.311 s]
/proc/loadavg: 9.08 8.76 8.04 9/118 7709
/proc/meminfo: memFree=304548/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=1995276 CPUtime=490.71
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 465863 0 0 0 48867 204 0 0 24 0 5 0 1122094027 2043162624 465625 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 498819 465625 95 177 0 498641 0
[pid=6767/tid=6831] ppid=6765 vsize=1995276 CPUtime=120.71
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 117399 0 0 0 12024 47 0 0 25 0 5 0 1122094506 2043162624 465625 4294967295 134512640 135237372 3214816560 3084608912 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=1995276 CPUtime=122.57
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 99089 0 0 0 12209 48 0 0 25 0 5 0 1122094517 2043162624 465625 4294967295 134512640 135237372 3214816560 3076299160 134758929 0 0 0 0 3223098951 0 0 -1 3 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=1995276 CPUtime=122.53
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 144237 0 0 0 12193 60 0 0 25 0 5 0 1122094517 2043162624 465625 4294967295 134512640 135237372 3214816560 3067900288 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=1995276 CPUtime=122.1
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 89644 0 0 0 12165 45 0 0 25 0 5 0 1122094517 2043162624 465625 4294967295 134512640 135237372 3214816560 3059539952 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 490.71
Current children cumulated vsize (KiB) 1995276



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+303.209 s]
/proc/loadavg: 8.98 8.76 8.06 9/119 7724
/proc/meminfo: memFree=203688/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=2096912 CPUtime=528.85
/proc/6767/stat : 6767 (ttsth-5-0) S 6765 6767 14986 0 -1 4202496 490094 0 0 0 52670 215 0 0 24 0 5 0 1122094027 2147237888 489856 4294967295 134512640 135237372 3214816560 3214816156 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 524228 489856 95 177 0 524050 0
[pid=6767/tid=6831] ppid=6765 vsize=2096912 CPUtime=130.45
/proc/6767/task/6831/stat : 6831 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 125649 0 0 0 12992 53 0 0 25 0 5 0 1122094506 2147237888 489856 4294967295 134512640 135237372 3214816560 3084572328 134758929 0 0 0 0 3223098951 0 0 -1 1 0 0 0
[pid=6767/tid=6833] ppid=6765 vsize=2096912 CPUtime=132.11
/proc/6767/task/6833/stat : 6833 (ttsth-5-0) D 6765 6767 14986 0 -1 4202560 103359 0 0 0 13163 48 0 0 25 0 5 0 1122094517 2147237888 489856 4294967295 134512640 135237372 3214816560 3076280544 134546034 0 0 0 0 3223098951 0 0 -1 3 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=2096912 CPUtime=132.08
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 152034 0 0 0 13147 61 0 0 25 0 5 0 1122094517 2147237888 489856 4294967295 134512640 135237372 3214816560 3067916608 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6767/tid=6835] ppid=6765 vsize=2096912 CPUtime=131.41
/proc/6767/task/6835/stat : 6835 (ttsth-5-0) R 6765 6767 14986 0 -1 4202560 93558 0 0 0 13092 49 0 0 25 0 5 0 1122094517 2147237888 489856 4294967295 134512640 135237372 3214816560 3059543680 134749351 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 528.85
Current children cumulated vsize (KiB) 2096912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+303.409 s]
/proc/loadavg: 8.98 8.76 8.06 9/119 7724
/proc/meminfo: memFree=203688/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=0 CPUtime=528.9
/proc/6767/stat : 6767 (ttsth-5-0) Z 6765 6767 14986 0 -1 4203524 490096 0 0 0 52670 220 0 0 18 0 2 0 1122094027 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 0 0 0 0 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=0 CPUtime=132.13
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4203588 152035 0 0 0 13147 66 0 0 25 0 2 0 1122094517 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 528.9
Current children cumulated vsize (KiB) 0

[startup+303.509 s]
/proc/loadavg: 8.98 8.76 8.06 9/119 7724
/proc/meminfo: memFree=203688/3368532 swapFree=1953000/1959888
[pid=6767] ppid=6765 vsize=0 CPUtime=528.91
/proc/6767/stat : 6767 (ttsth-5-0) Z 6765 6767 14986 0 -1 4203524 490096 0 0 0 52670 221 0 0 18 0 2 0 1122094027 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/6767/statm: 0 0 0 0 0 0 0
[pid=6767/tid=6834] ppid=6765 vsize=0 CPUtime=132.14
/proc/6767/task/6834/stat : 6834 (ttsth-5-0) R 6765 6767 14986 0 -1 4203588 152035 0 0 0 13147 67 0 0 25 0 2 0 1122094517 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 528.91
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 303.562
CPU time (s): 528.96
CPU user time (s): 526.7
CPU system time (s): 2.26
CPU usage (%): 174.251
Max. virtual memory (cumulated for all children) (KiB): 2096912

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 526.7
system time used= 2.26
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 490096
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2276
involuntary context switches= 13278

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi45 at 2009-05-30 12:32:47
IDJOB=1779673
IDBENCH=70888
IDSOLVER=632
FILE ID=tipi45/1779673-1243679567
PBS_JOBID=
Free space on /tmp= 15501 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/aprove09/AProVE09-05.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779673-1243679567/watcher-1779673-1243679567 -o /tmp/evaluation-result-1779673-1243679567/solver-1779673-1243679567 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779673-1243679567.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= af775a2959a121dbdf88d251c7971506
RANDOM SEED= 162904815

Linux tipi45 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2169528 kB
Buffers:         32052 kB
Cached:         621460 kB
SwapCached:       1892 kB
Active:         579636 kB
Inactive:       539644 kB
HighTotal:     2489216 kB
HighFree:      1415308 kB
LowTotal:       879316 kB
LowFree:        754220 kB
SwapTotal:     1959888 kB
SwapFree:      1953000 kB
Dirty:            2816 kB
Writeback:           0 kB
AnonPages:      465264 kB
Mapped:           6600 kB
Slab:            67432 kB
SReclaimable:    55760 kB
SUnreclaim:      11672 kB
PageTables:       1108 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   553204 kB
VmallocTotal:   114680 kB
VmallocUsed:     17900 kB
VmallocChunk:    96244 kB

Free space on /tmp at the end= 15501 MiB
End job on tipi45 at 2009-05-30 12:37:53