Trace number 293266

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
TTS 4.0? (TO) 1200.08 1200.53

General information on the benchmark

Namerandom/OnTreshold/5SAT/v120/
unif-k5-r21.3-v120-c2556-S1147406493-20.UNSAT.shuffled.cnf
MD5SUM91d6f081ceab153c3d465e1ffcfa62c2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables120
Number of clauses2556
Sum of the clauses size12780
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52556
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node5/watcher-293266-1171767427 -o ROOT/results/node5/solver-293266-1171767427 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/293266-1171767427/tts-4-0 /tmp/evaluation/293266-1171767427/instance-293266-1171767427.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7741
/proc/meminfo: memFree=1079904/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=796 CPUtime=0
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 114 0 0 0 0 0 0 0 18 0 1 0 196697510 815104 99 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134647773 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 199 99 57 113 0 83 0

[startup+0.10775 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7741
/proc/meminfo: memFree=1079904/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=4240 CPUtime=0.1
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 988 0 0 0 10 0 0 0 18 0 1 0 196697510 4341760 971 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134591869 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 1060 971 66 113 0 944 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 4240

[startup+0.515796 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7741
/proc/meminfo: memFree=1079904/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=4580 CPUtime=0.5
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 1044 0 0 0 50 0 0 0 21 0 1 0 196697510 4689920 1027 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134552285 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 1145 1027 66 113 0 1029 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 4580

[startup+1.33789 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1075800/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=4960 CPUtime=1.33
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 1141 0 0 0 133 0 0 0 25 0 1 0 196697510 5079040 1124 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134536404 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 1240 1124 66 113 0 1124 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 4960

[startup+2.98008 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1075032/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=5908 CPUtime=2.96
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 1381 0 0 0 296 0 0 0 25 0 1 0 196697510 6049792 1364 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134513469 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 1477 1364 66 113 0 1361 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5908

[startup+6.25645 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1073304/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=7344 CPUtime=6.24
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 1744 0 0 0 624 0 0 0 25 0 1 0 196697510 7520256 1727 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134535187 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 1836 1727 66 113 0 1720 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 7344

[startup+12.7122 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1069784/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=10636 CPUtime=12.7
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 2576 0 0 0 1269 1 0 0 25 0 1 0 196697510 10891264 2559 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134641336 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 2659 2559 66 113 0 2543 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 10636

[startup+25.5126 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1063320/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=17204 CPUtime=25.49
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 4236 0 0 0 2547 2 0 0 25 0 1 0 196697510 17616896 4219 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534120 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 4301 4219 66 113 0 4185 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 17204

[startup+51.1265 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1048984/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=31508 CPUtime=51.1
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 7800 0 0 0 5107 3 0 0 25 0 1 0 196697510 32264192 7783 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134537402 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 7877 7783 66 113 0 7761 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 31508

[startup+102.345 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=1017304/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=63388 CPUtime=102.31
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 15747 0 0 0 10223 8 0 0 25 0 1 0 196697510 64909312 15730 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534420 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 15847 15730 66 113 0 15731 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 63388

[startup+162.374 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7742
/proc/meminfo: memFree=988184/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=91992 CPUtime=162.32
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 22904 0 0 0 16220 12 0 0 25 0 1 0 196697510 94199808 22887 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134543324 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 22998 22887 66 113 0 22882 0
Current children cumulated CPU time (s) 162.32
Current children cumulated vsize (KiB) 91992

[startup+222.436 s]
/proc/loadavg: 1.03 1.00 1.00 2/78 7742
/proc/meminfo: memFree=964120/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=115900 CPUtime=222.36
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 28929 0 0 0 22221 15 0 0 25 0 1 0 196697510 118681600 28912 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 28975 28912 66 113 0 28859 0
Current children cumulated CPU time (s) 222.36
Current children cumulated vsize (KiB) 115900

[startup+282.484 s]
/proc/loadavg: 1.01 1.00 1.00 2/84 7858
/proc/meminfo: memFree=938536/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=140512 CPUtime=282.34
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 35041 0 0 0 28214 20 0 0 25 0 1 0 196697510 143884288 35024 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534117 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 35128 35024 66 113 0 35012 0
Current children cumulated CPU time (s) 282.34
Current children cumulated vsize (KiB) 140512

[startup+342.546 s]
/proc/loadavg: 1.04 1.01 1.00 2/78 10012
/proc/meminfo: memFree=920600/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=159032 CPUtime=342.31
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 39670 0 0 0 34205 26 0 0 25 0 1 0 196697510 162848768 39653 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534049 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 39758 39653 66 113 0 39642 0
Current children cumulated CPU time (s) 342.31
Current children cumulated vsize (KiB) 159032

[startup+402.575 s]
/proc/loadavg: 1.01 1.01 1.00 2/78 10012
/proc/meminfo: memFree=896984/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=182472 CPUtime=402.32
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 45550 0 0 0 40202 30 0 0 25 0 1 0 196697510 186851328 45533 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 45618 45533 66 113 0 45502 0
Current children cumulated CPU time (s) 402.32
Current children cumulated vsize (KiB) 182472

[startup+462.603 s]
/proc/loadavg: 1.07 1.02 1.00 2/78 10012
/proc/meminfo: memFree=880472/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=199112 CPUtime=462.33
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 49683 0 0 0 46201 32 0 0 25 0 1 0 196697510 203890688 49666 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134591895 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 49778 49666 66 113 0 49662 0
Current children cumulated CPU time (s) 462.33
Current children cumulated vsize (KiB) 199112

[startup+522.633 s]
/proc/loadavg: 1.02 1.01 1.00 2/78 10012
/proc/meminfo: memFree=864024/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=215520 CPUtime=522.35
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 53795 0 0 0 52199 36 0 0 25 0 1 0 196697510 220692480 53778 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 53880 53778 66 113 0 53764 0
Current children cumulated CPU time (s) 522.35
Current children cumulated vsize (KiB) 215520

[startup+582.659 s]
/proc/loadavg: 1.01 1.01 1.00 2/78 10012
/proc/meminfo: memFree=849368/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=230052 CPUtime=582.36
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 57443 0 0 0 58197 39 0 0 25 0 1 0 196697510 235573248 57426 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134591653 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 57513 57426 66 113 0 57397 0
Current children cumulated CPU time (s) 582.36
Current children cumulated vsize (KiB) 230052

[startup+642.691 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=825048/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=254428 CPUtime=642.37
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 63529 0 0 0 64195 42 0 0 25 0 1 0 196697510 260534272 63512 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 63607 63512 66 113 0 63491 0
Current children cumulated CPU time (s) 642.37
Current children cumulated vsize (KiB) 254428

[startup+702.719 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=805784/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=273656 CPUtime=702.39
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 68367 0 0 0 70192 47 0 0 25 0 1 0 196697510 280223744 68350 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 68414 68350 66 113 0 68298 0
Current children cumulated CPU time (s) 702.39
Current children cumulated vsize (KiB) 273656

[startup+762.746 s]
/proc/loadavg: 1.06 1.02 1.00 2/78 10012
/proc/meminfo: memFree=786264/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=293344 CPUtime=762.4
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 73242 0 0 0 76189 51 0 0 25 0 1 0 196697510 300384256 73225 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 73336 73225 66 113 0 73220 0
Current children cumulated CPU time (s) 762.4
Current children cumulated vsize (KiB) 293344

[startup+822.777 s]
/proc/loadavg: 1.02 1.01 1.00 2/78 10012
/proc/meminfo: memFree=767832/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=311636 CPUtime=822.41
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 77823 0 0 0 82188 53 0 0 25 0 1 0 196697510 319115264 77806 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534130 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 77909 77806 66 113 0 77793 0
Current children cumulated CPU time (s) 822.41
Current children cumulated vsize (KiB) 311636

[startup+882.806 s]
/proc/loadavg: 1.01 1.00 1.00 2/78 10012
/proc/meminfo: memFree=751128/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=328276 CPUtime=882.42
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 82023 0 0 0 88185 57 0 0 25 0 1 0 196697510 336154624 82006 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 82069 82006 66 113 0 81953 0
Current children cumulated CPU time (s) 882.42
Current children cumulated vsize (KiB) 328276

[startup+942.835 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=735128/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=344684 CPUtime=942.44
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 86071 0 0 0 94184 60 0 0 25 0 1 0 196697510 352956416 86054 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134535187 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 86171 86054 66 113 0 86055 0
Current children cumulated CPU time (s) 942.44
Current children cumulated vsize (KiB) 344684

[startup+1002.86 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=718872/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=360624 CPUtime=1002.44
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 90110 0 0 0 100182 62 0 0 25 0 1 0 196697510 369278976 90093 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534130 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 90156 90093 66 113 0 90040 0
Current children cumulated CPU time (s) 1002.44
Current children cumulated vsize (KiB) 360624

[startup+1062.89 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=705176/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=374220 CPUtime=1062.46
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 93461 0 0 0 106180 66 0 0 25 0 1 0 196697510 383201280 93444 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 93555 93444 66 113 0 93439 0
Current children cumulated CPU time (s) 1062.46
Current children cumulated vsize (KiB) 374220

[startup+1122.92 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=692760/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=386644 CPUtime=1122.48
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 96561 0 0 0 112179 69 0 0 25 0 1 0 196697510 395923456 96544 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534063 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 96661 96544 66 113 0 96545 0
Current children cumulated CPU time (s) 1122.48
Current children cumulated vsize (KiB) 386644

[startup+1182.94 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=677528/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=401880 CPUtime=1182.48
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 100374 0 0 0 118176 72 0 0 25 0 1 0 196697510 411525120 100357 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534154 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 100470 100357 66 113 0 100354 0
Current children cumulated CPU time (s) 1182.48
Current children cumulated vsize (KiB) 401880



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.46 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=673560/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=405632 CPUtime=1200
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 101325 0 0 0 119927 73 0 0 25 0 1 0 196697510 415367168 101308 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534120 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 101408 101308 66 113 0 101292 0
Current children cumulated CPU time (s) 1200
Current children cumulated vsize (KiB) 405632

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.46 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 10012
/proc/meminfo: memFree=673560/2055920 swapFree=4192812/4192956
[pid=7741] ppid=7739 vsize=405632 CPUtime=1200
/proc/7741/stat : 7741 (tts-4-0) R 7739 7741 6936 0 -1 4194304 101325 0 0 0 119927 73 0 0 25 0 1 0 196697510 415367168 101308 18446744073709551615 134512640 134976056 4294956624 18446744073709551615 134534120 0 0 4096 0 0 0 0 17 1 0 0
/proc/7741/statm: 101408 101308 66 113 0 101292 0
Current children cumulated CPU time (s) 1200
Current children cumulated vsize (KiB) 405632

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.53
CPU time (s): 1200.08
CPU user time (s): 1199.28
CPU system time (s): 0.800878
CPU usage (%): 99.9619
Max. virtual memory (cumulated for all children) (KiB): 405632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.28
system time used= 0.800878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 101325
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 2384

runsolver used 1.24381 second user time and 2.70259 second system time

The end

Launcher Data (download as text)

Begin job on node5 on Sun Feb 18 02:57:07 UTC 2007

IDJOB= 293266
IDBENCH= 19860
IDSOLVER= 98
FILE ID= node5/293266-1171767427

PBS_JOBID= 3839282

Free space on /tmp= 66551 MiB

SOLVER NAME= TTS 4.0
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/5SAT/v120/unif-k5-r21.3-v120-c2556-S1147406493-20.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/293266-1171767427/tts-4-0 /tmp/evaluation/293266-1171767427/instance-293266-1171767427.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node5/watcher-293266-1171767427 -o ROOT/results/node5/solver-293266-1171767427 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/293266-1171767427/tts-4-0 /tmp/evaluation/293266-1171767427/instance-293266-1171767427.cnf            

META MD5SUM SOLVER= 73a7a27d0c2e86f9b1191433fde766ff
MD5SUM BENCH=  91d6f081ceab153c3d465e1ffcfa62c2

RANDOM SEED= 830901878

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node5.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.224
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.224
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1080376 kB
Buffers:         55980 kB
Cached:         800140 kB
SwapCached:          0 kB
Active:         504720 kB
Inactive:       395424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1080376 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:             600 kB
Writeback:           0 kB
Mapped:          62876 kB
Slab:            61012 kB
Committed_AS:   667952 kB
PageTables:       1692 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66551 MiB

End job on node5 on Sun Feb 18 03:17:10 UTC 2007