Trace number 303598

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
TTS 4.0? (TO) 1200.05 1200.39

General information on the benchmark

Namerandom/LargeSize/7SAT/v200/
unif-k7-r85-v200-c17000-S938354044-16.cnf
MD5SUM90b34cbcd18a30548d336749c40e7348
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data (download as text)



Verifier Data (download as text)




ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 



Watcher Data (download as text)




runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node67/watcher-303598-1172039199 -o ROOT/results/node67/solver-303598-1172039199 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/303598-1172039199/tts-4-0 /tmp/evaluation/303598-1172039199/instance-303598-1172039199.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 12637
/proc/meminfo: memFree=1640616/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=796 CPUtime=0
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 108 0 0 0 0 0 0 0 18 0 1 0 223877496 815104 93 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134627035 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 199 94 57 113 0 83 0

[startup+0.106686 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 12637
/proc/meminfo: memFree=1640616/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=2512 CPUtime=0.1
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 541 0 0 0 10 0 0 0 18 0 1 0 223877496 2572288 526 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134538287 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 628 526 59 113 0 512 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2512

[startup+0.514727 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 12637
/proc/meminfo: memFree=1640616/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=5764 CPUtime=0.5
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 1337 0 0 0 50 0 0 0 21 0 1 0 223877496 5902336 1322 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134538256 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 1441 1322 62 113 0 1325 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 5764

[startup+1.33481 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1614432/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=32212 CPUtime=1.33
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 8000 0 0 0 130 3 0 0 25 0 1 0 223877496 32985088 7950 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134627035 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 8053 7950 65 113 0 7937 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 32212

[startup+2.97098 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1605664/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=35480 CPUtime=2.96
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 8803 0 0 0 293 3 0 0 25 0 1 0 223877496 36331520 8753 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134641336 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 8870 8753 66 113 0 8754 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 35480

[startup+6.24732 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1605296/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=35760 CPUtime=6.24
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 8911 0 0 0 621 3 0 0 25 0 1 0 223877496 36618240 8861 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134535872 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 8940 8861 66 113 0 8824 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 35760

[startup+12.702 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1604080/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=36964 CPUtime=12.69
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 9190 0 0 0 1266 3 0 0 25 0 1 0 223877496 37851136 9140 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134543553 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 9241 9140 66 113 0 9125 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 36964

[startup+25.5073 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1601840/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=39320 CPUtime=25.48
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 9758 0 0 0 2545 3 0 0 25 0 1 0 223877496 40263680 9708 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134591882 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 9830 9708 66 113 0 9714 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 39320

[startup+51.112 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1597104/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=43792 CPUtime=51.08
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 10921 0 0 0 5104 4 0 0 25 0 1 0 223877496 44843008 10871 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134591700 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 10948 10871 66 113 0 10832 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 43792

[startup+102.319 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1589296/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=51912 CPUtime=102.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 12908 0 0 0 10222 6 0 0 25 0 1 0 223877496 53157888 12858 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134513482 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 12978 12858 66 113 0 12862 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 51912

[startup+162.34 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1581232/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=59672 CPUtime=162.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 14862 0 0 0 16221 7 0 0 25 0 1 0 223877496 61104128 14812 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134591656 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 14918 14812 66 113 0 14802 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 59672

[startup+222.358 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1574064/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=66736 CPUtime=222.29
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 16666 0 0 0 22220 9 0 0 25 0 1 0 223877496 68337664 16616 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134591882 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 16684 16616 66 113 0 16568 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 66736

[startup+282.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1567408/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=73532 CPUtime=282.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 18330 0 0 0 28219 9 0 0 25 0 1 0 223877496 75296768 18280 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134543324 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 18383 18280 66 113 0 18267 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 73532

[startup+342.387 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1559600/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=81276 CPUtime=342.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 20276 0 0 0 34217 11 0 0 25 0 1 0 223877496 83226624 20226 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534117 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 20319 20226 66 113 0 20203 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 81276

[startup+402.405 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1551984/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=88668 CPUtime=402.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 22137 0 0 0 40216 12 0 0 25 0 1 0 223877496 90796032 22087 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134591882 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 22167 22087 66 113 0 22051 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 88668

[startup+462.42 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1545328/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=95464 CPUtime=462.27
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 23815 0 0 0 46213 14 0 0 25 0 1 0 223877496 97755136 23765 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134537405 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 23866 23765 66 113 0 23750 0
Current children cumulated CPU time (s) 462.27
Current children cumulated vsize (KiB) 95464

[startup+522.434 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1538224/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=102500 CPUtime=522.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 25588 0 0 0 52212 16 0 0 25 0 1 0 223877496 104960000 25538 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534054 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 25625 25538 66 113 0 25509 0
Current children cumulated CPU time (s) 522.28
Current children cumulated vsize (KiB) 102500

[startup+582.45 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1529904/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=110704 CPUtime=582.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 27651 0 0 0 58211 17 0 0 25 0 1 0 223877496 113360896 27601 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 27676 27601 66 113 0 27560 0
Current children cumulated CPU time (s) 582.28
Current children cumulated vsize (KiB) 110704

[startup+642.471 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1524848/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=115868 CPUtime=642.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 28907 0 0 0 64210 18 0 0 25 0 1 0 223877496 118648832 28857 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 28967 28857 66 113 0 28851 0
Current children cumulated CPU time (s) 642.28
Current children cumulated vsize (KiB) 115868

[startup+702.49 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1518704/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=121960 CPUtime=702.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 30459 0 0 0 70209 19 0 0 25 0 1 0 223877496 124887040 30409 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534114 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 30490 30409 66 113 0 30374 0
Current children cumulated CPU time (s) 702.28
Current children cumulated vsize (KiB) 121960

[startup+762.507 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12638
/proc/meminfo: memFree=1513520/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=127116 CPUtime=762.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 31747 0 0 0 76209 19 0 0 25 0 1 0 223877496 130166784 31697 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534120 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 31779 31697 66 113 0 31663 0
Current children cumulated CPU time (s) 762.28
Current children cumulated vsize (KiB) 127116

[startup+822.529 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1508976/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=131572 CPUtime=822.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 32878 0 0 0 82208 20 0 0 25 0 1 0 223877496 134729728 32828 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534049 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 32893 32828 66 113 0 32777 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 131572

[startup+882.548 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1504048/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=136728 CPUtime=882.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 34116 0 0 0 88207 21 0 0 25 0 1 0 223877496 140009472 34066 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534110 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 34182 34066 66 113 0 34066 0
Current children cumulated CPU time (s) 882.28
Current children cumulated vsize (KiB) 136728

[startup+942.565 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1497584/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=143056 CPUtime=942.28
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 35718 0 0 0 94205 23 0 0 25 0 1 0 223877496 146489344 35668 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534119 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 35764 35668 66 113 0 35648 0
Current children cumulated CPU time (s) 942.28
Current children cumulated vsize (KiB) 143056

[startup+1002.58 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1492336/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=148212 CPUtime=1002.29
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 37026 0 0 0 100204 25 0 0 25 0 1 0 223877496 151769088 36976 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134542438 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 37053 36976 66 113 0 36937 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 148212

[startup+1062.6 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1486192/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=154540 CPUtime=1062.29
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 38566 0 0 0 106203 26 0 0 25 0 1 0 223877496 158248960 38516 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134543308 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 38635 38516 66 113 0 38519 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 154540

[startup+1122.62 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 12640
/proc/meminfo: memFree=1479280/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=161344 CPUtime=1122.29
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 40295 0 0 0 112201 28 0 0 25 0 1 0 223877496 165216256 40245 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134641336 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 40336 40245 66 113 0 40220 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 161344

[startup+1182.64 s]
/proc/loadavg: 1.05 1.01 1.00 2/65 12640
/proc/meminfo: memFree=1471664/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=168844 CPUtime=1182.3
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 42188 0 0 0 118200 30 0 0 25 0 1 0 223877496 172896256 42138 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134641336 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 42211 42138 66 113 0 42095 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 168844



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.36 s]
/proc/loadavg: 1.04 1.01 1.00 2/65 12640
/proc/meminfo: memFree=1470512/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=170016 CPUtime=1200.01
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 42457 0 0 0 119971 30 0 0 25 0 1 0 223877496 174096384 42407 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534108 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 42504 42407 66 113 0 42388 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 170016

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.36 s]
/proc/loadavg: 1.04 1.01 1.00 2/65 12640
/proc/meminfo: memFree=1470512/2055920 swapFree=4175972/4192956
[pid=12637] ppid=12635 vsize=170016 CPUtime=1200.01
/proc/12637/stat : 12637 (tts-4-0) R 12635 12637 11554 0 -1 4194304 42457 0 0 0 119971 30 0 0 25 0 1 0 223877496 174096384 42407 18446744073709551615 134512640 134976056 4294956704 18446744073709551615 134534108 0 0 4096 0 0 0 0 17 1 0 0
/proc/12637/statm: 42504 42407 66 113 0 42388 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 170016

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.39
CPU time (s): 1200.05
CPU user time (s): 1199.71
CPU system time (s): 0.334949
CPU usage (%): 99.9717
Max. virtual memory (cumulated for all children) (KiB): 170016

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.71
system time used= 0.334949
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 42457
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 3333

runsolver used 0.78388 second user time and 2.42663 second system time

The end



Launcher Data (download as text)




Begin job on node67 on Wed Feb 21 06:26:39 UTC 2007

IDJOB= 303598
IDBENCH= 20112
IDSOLVER= 98
FILE ID= node67/303598-1172039199

PBS_JOBID= 3892719

Free space on /tmp= 66561 MiB

SOLVER NAME= TTS 4.0
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/7SAT/v200/unif-k7-r85-v200-c17000-S938354044-16.cnf
COMMAND LINE= /tmp/evaluation/303598-1172039199/tts-4-0 /tmp/evaluation/303598-1172039199/instance-303598-1172039199.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node67/watcher-303598-1172039199 -o ROOT/results/node67/solver-303598-1172039199 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/303598-1172039199/tts-4-0 /tmp/evaluation/303598-1172039199/instance-303598-1172039199.cnf            

META MD5SUM SOLVER= 73a7a27d0c2e86f9b1191433fde766ff
MD5SUM BENCH=  90b34cbcd18a30548d336749c40e7348

RANDOM SEED= 266958179

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node67.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1641088 kB
Buffers:         34540 kB
Cached:         318540 kB
SwapCached:      11332 kB
Active:         267780 kB
Inactive:       103372 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1641088 kB
SwapTotal:     4192956 kB
SwapFree:      4175972 kB
Dirty:            1024 kB
Writeback:           0 kB
Mapped:          15428 kB
Slab:            29664 kB
Committed_AS:   707628 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node67 on Wed Feb 21 06:46:41 UTC 2007