Trace number 293143

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
TTS 4.0? (TO) 1200.12 1200.99

General information on the benchmark

Namerandom/OnTreshold/5SAT/v120/
unif-k5-r21.3-v120-c2556-S340864765-13.SAT.shuffled.cnf
MD5SUM1a2d4f656ef1a93a804e74aaef307a73
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.527919
Satisfiable
(Un)Satisfiability was proved
Number of variables120
Number of clauses2556
Sum of the clauses size12780
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52556
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node35/watcher-293143-1171765610 -o ROOT/results/node35/solver-293143-1171765610 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/293143-1171765610/tts-4-0 /tmp/evaluation/293143-1171765610/instance-293143-1171765610.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 5774
/proc/meminfo: memFree=697704/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=796 CPUtime=0
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 116 0 0 0 0 0 0 0 18 0 1 0 170324747 815104 101 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134627035 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 199 101 57 113 0 83 0

[startup+0.10674 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 5774
/proc/meminfo: memFree=697704/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=4372 CPUtime=0.1
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 992 0 0 0 10 0 0 0 18 0 1 0 170324747 4476928 975 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134591687 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 1093 975 66 113 0 977 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 4372

[startup+0.514823 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 5774
/proc/meminfo: memFree=697704/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=4372 CPUtime=0.51
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 1036 0 0 0 51 0 0 0 22 0 1 0 170324747 4476928 1019 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134535843 0 0 4096 0 0 0 0 17 1 0 0
/proc/5774/statm: 1093 1019 66 113 0 977 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 4372

[startup+1.33598 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=693536/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=4820 CPUtime=1.32
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 1138 0 0 0 132 0 0 0 25 0 1 0 170324747 4935680 1121 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534364 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 1205 1121 66 113 0 1089 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 4820

[startup+2.9733 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=692640/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=5764 CPUtime=2.96
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 1388 0 0 0 296 0 0 0 25 0 1 0 170324747 5902336 1371 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134641326 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 1441 1371 66 113 0 1325 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5764

[startup+6.25195 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=690848/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=7656 CPUtime=6.24
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 1826 0 0 0 624 0 0 0 25 0 1 0 170324747 7839744 1809 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134591895 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 1914 1809 66 113 0 1798 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 7656

[startup+12.7062 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=687328/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=10952 CPUtime=12.69
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 2659 0 0 0 1269 0 0 0 25 0 1 0 170324747 11214848 2642 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534433 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 2738 2642 66 113 0 2622 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 10952

[startup+25.5137 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=681376/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=17048 CPUtime=25.48
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 4202 0 0 0 2547 1 0 0 25 0 1 0 170324747 17457152 4185 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134591986 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 4262 4185 66 113 0 4146 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 17048

[startup+51.1278 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=670112/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=28068 CPUtime=51.07
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 6956 0 0 0 5105 2 0 0 25 0 1 0 170324747 28741632 6939 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 7017 6939 66 113 0 6901 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 28068

[startup+102.352 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=649632/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=48700 CPUtime=102.26
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 12077 0 0 0 10221 5 0 0 25 0 1 0 170324747 49868800 12060 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534117 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 12175 12060 66 113 0 12059 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 48700

[startup+162.395 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=628320/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=69560 CPUtime=162.24
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 17328 0 0 0 16216 8 0 0 25 0 1 0 170324747 71229440 17311 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534709 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 17390 17311 66 113 0 17274 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 69560

[startup+222.432 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=611360/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=86684 CPUtime=222.24
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 21573 0 0 0 22214 10 0 0 25 0 1 0 170324747 88764416 21556 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134535181 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 21671 21556 66 113 0 21555 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 86684

[startup+282.469 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=595296/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=102624 CPUtime=282.24
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 25584 0 0 0 28210 14 0 0 25 0 1 0 170324747 105086976 25567 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 25656 25567 66 113 0 25540 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 102624

[startup+342.502 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=584672/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=113408 CPUtime=342.22
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 28259 0 0 0 34206 16 0 0 25 0 1 0 170324747 116129792 28242 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/5774/statm: 28352 28242 66 113 0 28236 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 113408

[startup+402.545 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=575072/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=122796 CPUtime=402.23
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 30610 0 0 0 40205 18 0 0 25 0 1 0 170324747 125743104 30593 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134543324 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 30699 30593 66 113 0 30583 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 122796

[startup+462.583 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=564768/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=133108 CPUtime=462.21
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 33192 0 0 0 46202 19 0 0 25 0 1 0 170324747 136302592 33175 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534119 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 33277 33175 66 113 0 33161 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 133108

[startup+522.622 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=554400/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=143420 CPUtime=522.22
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 35792 0 0 0 52200 22 0 0 25 0 1 0 170324747 146862080 35775 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134641336 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 35855 35775 66 113 0 35739 0
Current children cumulated CPU time (s) 522.22
Current children cumulated vsize (KiB) 143420

[startup+582.658 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=543968/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=153736 CPUtime=582.22
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 38380 0 0 0 58198 24 0 0 25 0 1 0 170324747 157425664 38363 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534709 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 38434 38363 66 113 0 38318 0
Current children cumulated CPU time (s) 582.22
Current children cumulated vsize (KiB) 153736

[startup+642.692 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=526112/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=171552 CPUtime=642.2
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 42836 0 0 0 64193 27 0 0 25 0 1 0 170324747 175669248 42819 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 42888 42819 66 113 0 42772 0
Current children cumulated CPU time (s) 642.2
Current children cumulated vsize (KiB) 171552

[startup+702.726 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=512032/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=185848 CPUtime=702.2
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 46363 0 0 0 70189 31 0 0 25 0 1 0 170324747 190308352 46346 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534130 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 46462 46346 66 113 0 46346 0
Current children cumulated CPU time (s) 702.2
Current children cumulated vsize (KiB) 185848

[startup+762.761 s]
/proc/loadavg: 1.03 1.01 1.00 2/65 5775
/proc/meminfo: memFree=498272/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=199676 CPUtime=762.18
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 49827 0 0 0 76185 33 0 0 25 0 1 0 170324747 204468224 49810 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534130 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 49919 49810 66 113 0 49803 0
Current children cumulated CPU time (s) 762.18
Current children cumulated vsize (KiB) 199676

[startup+822.801 s]
/proc/loadavg: 1.01 1.01 1.00 2/65 5775
/proc/meminfo: memFree=484512/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=213272 CPUtime=822.18
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 53219 0 0 0 82182 36 0 0 25 0 1 0 170324747 218390528 53202 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534117 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 53318 53202 66 113 0 53202 0
Current children cumulated CPU time (s) 822.18
Current children cumulated vsize (KiB) 213272

[startup+882.835 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=473888/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=223820 CPUtime=882.18
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 55861 0 0 0 88179 39 0 0 25 0 1 0 170324747 229191680 55844 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534117 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 55955 55844 66 113 0 55839 0
Current children cumulated CPU time (s) 882.18
Current children cumulated vsize (KiB) 223820

[startup+942.869 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=464544/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=233196 CPUtime=942.17
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 58212 0 0 0 94176 41 0 0 25 0 1 0 170324747 238792704 58195 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534192 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 58299 58195 66 113 0 58183 0
Current children cumulated CPU time (s) 942.17
Current children cumulated vsize (KiB) 233196

[startup+1002.9 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=453280/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=244444 CPUtime=1002.15
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 61039 0 0 0 100172 43 0 0 25 0 1 0 170324747 250310656 61022 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534364 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 61111 61022 66 113 0 60995 0
Current children cumulated CPU time (s) 1002.15
Current children cumulated vsize (KiB) 244444

[startup+1062.94 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=444064/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=253588 CPUtime=1062.15
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 63300 0 0 0 106169 46 0 0 25 0 1 0 170324747 259674112 63283 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 63397 63283 66 113 0 63281 0
Current children cumulated CPU time (s) 1062.15
Current children cumulated vsize (KiB) 253588

[startup+1122.98 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=436832/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=260620 CPUtime=1122.15
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 65106 0 0 0 112167 48 0 0 25 0 1 0 170324747 266874880 65089 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 65155 65089 66 113 0 65039 0
Current children cumulated CPU time (s) 1122.15
Current children cumulated vsize (KiB) 260620

[startup+1183.02 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=429856/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=267884 CPUtime=1182.15
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 66874 0 0 0 118165 50 0 0 25 0 1 0 170324747 274313216 66857 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534120 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 66971 66857 66 113 0 66855 0
Current children cumulated CPU time (s) 1182.15
Current children cumulated vsize (KiB) 267884



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.95 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=428128/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=269292 CPUtime=1200.07
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 67254 0 0 0 119957 50 0 0 25 0 1 0 170324747 275755008 67237 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 67323 67237 66 113 0 67207 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 269292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.95 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 5775
/proc/meminfo: memFree=428128/2055920 swapFree=4183700/4192956
[pid=5774] ppid=5772 vsize=269292 CPUtime=1200.07
/proc/5774/stat : 5774 (tts-4-0) R 5772 5774 4706 0 -1 4194304 67254 0 0 0 119957 50 0 0 25 0 1 0 170324747 275755008 67237 18446744073709551615 134512640 134976056 4294956640 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 0 0 0
/proc/5774/statm: 67323 67237 66 113 0 67207 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 269292

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.99
CPU time (s): 1200.12
CPU user time (s): 1199.57
CPU system time (s): 0.546916
CPU usage (%): 99.9275
Max. virtual memory (cumulated for all children) (KiB): 269292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.57
system time used= 0.546916
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 67254
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 5078

runsolver used 1.00785 second user time and 3.2635 second system time

The end

Launcher Data (download as text)

Begin job on node35 on Sun Feb 18 02:26:50 UTC 2007

IDJOB= 293143
IDBENCH= 19857
IDSOLVER= 98
FILE ID= node35/293143-1171765610

PBS_JOBID= 3839495

Free space on /tmp= 66564 MiB

SOLVER NAME= TTS 4.0
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/5SAT/v120/unif-k5-r21.3-v120-c2556-S340864765-13.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/293143-1171765610/tts-4-0 /tmp/evaluation/293143-1171765610/instance-293143-1171765610.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node35/watcher-293143-1171765610 -o ROOT/results/node35/solver-293143-1171765610 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/293143-1171765610/tts-4-0 /tmp/evaluation/293143-1171765610/instance-293143-1171765610.cnf            

META MD5SUM SOLVER= 73a7a27d0c2e86f9b1191433fde766ff
MD5SUM BENCH=  1a2d4f656ef1a93a804e74aaef307a73

RANDOM SEED= 13468614

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node35.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.263
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.263
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        698112 kB
Buffers:         41076 kB
Cached:        1216208 kB
SwapCached:       3776 kB
Active:         798920 kB
Inactive:       469016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        698112 kB
SwapTotal:     4192956 kB
SwapFree:      4183700 kB
Dirty:             584 kB
Writeback:           0 kB
Mapped:          15880 kB
Slab:            75908 kB
Committed_AS:   650024 kB
PageTables:       1416 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66564 MiB

End job on node35 on Sun Feb 18 02:46:53 UTC 2007