Trace number 338062

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.03 1200.51

General information on the benchmark

Namecrafted/Difficult/contest05/QG/
QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf
MD5SUM92c8b4fc23a7c22313979a2d9b3b5a58
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark224.011
Satisfiable
(Un)Satisfiability was proved
Number of variables1691
Number of clauses9177
Sum of the clauses size77698
Maximum clause length16
Minimum clause length1
Number of clauses of size 133
Number of clauses of size 2289
Number of clauses of size 31389
Number of clauses of size 4171
Number of clauses of size 5960
Number of clauses of size over 56335

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.02	c ==============================================================================
0.00/0.02	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.02	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.02	c ==============================================================================
0.00/0.02	c |         0 |    8918    76263 |    2675       0        0     nan |  0.000 % |
0.03/0.07	c |         0 |    7397    64229 |      --       0       --      -- |     --   | -633/-7045
0.03/0.07	c ==============================================================================
0.03/0.07	c Result  :   #vars: 1505   #clauses: 7397   #literals: 64229
0.03/0.07	c CPU time:   0.070989 s
0.03/0.07	c ==============================================================================
0.09/0.10	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node6/watcher-338062-1173679706 -o ROOT/results/node6/solver-338062-1173679706 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/338062-1173679706/rsat.sh /tmp/evaluation/338062-1173679706/instance-338062-1173679706.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.23 1.29 3/77 3608
/proc/meminfo: memFree=1649024/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0
/proc/3608/stat : 3608 (rsat.sh) R 3606 3608 1815 0 -1 4194304 264 0 0 0 0 0 0 0 18 0 1 0 387925359 5480448 231 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582840991 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/3608/statm: 1338 231 194 169 0 49 0
[pid=3609] ppid=3608 vsize=1172 CPUtime=0
/proc/3609/stat : 3609 (SatElite) R 3608 3608 1815 0 -1 4194304 171 0 0 0 0 0 0 0 18 0 1 0 387925359 1200128 153 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/3609/statm: 293 153 50 128 0 162 0

[startup+0.043802 s]
/proc/loadavg: 1.00 1.23 1.29 3/77 3608
/proc/meminfo: memFree=1649024/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 387925359 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 232 195 169 0 49 0
[pid=3609] ppid=3608 vsize=2320 CPUtime=0.03
/proc/3609/stat : 3609 (SatElite) R 3608 3608 1815 0 -1 4194304 460 0 0 0 3 0 0 0 19 0 1 0 387925359 2375680 442 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134543878 0 0 4096 3 0 0 0 17 1 0 0
/proc/3609/statm: 580 442 67 128 0 449 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 7672

[startup+0.101814 s]
/proc/loadavg: 1.00 1.23 1.29 3/77 3608
/proc/meminfo: memFree=1649024/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 387925359 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 232 195 169 0 49 0
[pid=3609] ppid=3608 vsize=0 CPUtime=0.09
/proc/3609/stat : 3609 (SatElite) D 3608 3608 1815 0 -1 4194308 482 0 0 0 9 0 0 0 15 0 1 0 387925359 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 3 18446744072100051646 0 0 17 1 0 0
/proc/3609/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5352

[startup+0.301852 s]
/proc/loadavg: 1.00 1.23 1.29 3/77 3608
/proc/meminfo: memFree=1649024/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5352

[startup+0.701931 s]
/proc/loadavg: 1.00 1.23 1.29 3/77 3608
/proc/meminfo: memFree=1649024/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5352

[startup+1.50209 s]
/proc/loadavg: 1.00 1.22 1.28 2/79 3611
/proc/meminfo: memFree=1645552/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=3756 CPUtime=1.39
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 865 0 0 0 139 0 0 0 25 0 1 0 387925369 3846144 771 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 939 771 86 211 0 725 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 9108

[startup+3.10141 s]
/proc/loadavg: 1.00 1.22 1.28 2/79 3611
/proc/meminfo: memFree=1644592/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=5200 CPUtime=2.98
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 1244 0 0 0 298 0 0 0 25 0 1 0 387925369 5324800 1085 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 1300 1085 86 211 0 1086 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 10552

[startup+6.30203 s]
/proc/loadavg: 1.00 1.22 1.28 2/79 3611
/proc/meminfo: memFree=1643312/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=6660 CPUtime=6.19
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 1813 0 0 0 618 1 0 0 25 0 1 0 387925369 6819840 1458 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 1665 1458 86 211 0 1451 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 12012

[startup+12.7013 s]
/proc/loadavg: 1.00 1.22 1.28 2/79 3611
/proc/meminfo: memFree=1641264/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=7692 CPUtime=12.58
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 2292 0 0 0 1257 1 0 0 25 0 1 0 387925369 7876608 1741 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 1923 1741 86 211 0 1709 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 13044

[startup+25.5018 s]
/proc/loadavg: 1.00 1.21 1.28 2/79 3611
/proc/meminfo: memFree=1638448/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=10772 CPUtime=25.38
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 3480 0 0 0 2536 2 0 0 25 0 1 0 387925369 11030528 2443 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523235 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 2693 2443 86 211 0 2479 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 16124

[startup+51.1019 s]
/proc/loadavg: 1.00 1.19 1.27 2/79 3611
/proc/meminfo: memFree=1634288/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=15064 CPUtime=50.97
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 4589 0 0 0 5093 4 0 0 25 0 1 0 387925369 15425536 3552 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523307 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 3766 3552 86 211 0 3552 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 20416

[startup+102.306 s]
/proc/loadavg: 1.00 1.16 1.25 2/79 3611
/proc/meminfo: memFree=1631280/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=18584 CPUtime=102.15
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 5897 0 0 0 10210 5 0 0 25 0 1 0 387925369 19030016 4278 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 4646 4278 86 211 0 4432 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 23936

[startup+162.302 s]
/proc/loadavg: 1.00 1.12 1.23 2/79 3611
/proc/meminfo: memFree=1627184/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=22348 CPUtime=162.13
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 7686 0 0 0 16206 7 0 0 25 0 1 0 387925369 22884352 5278 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 5587 5278 86 211 0 5373 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 27700

[startup+222.302 s]
/proc/loadavg: 1.00 1.10 1.22 2/79 3611
/proc/meminfo: memFree=1625776/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=24120 CPUtime=222.1
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 8090 0 0 0 22203 7 0 0 25 0 1 0 387925369 24698880 5682 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 6030 5682 86 211 0 5816 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 29472

[startup+282.301 s]
/proc/loadavg: 1.00 1.08 1.20 2/79 3611
/proc/meminfo: memFree=1620464/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=29484 CPUtime=282.08
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 9458 0 0 0 28199 9 0 0 25 0 1 0 387925369 30191616 7017 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 7371 7017 86 211 0 7157 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 34836

[startup+342.301 s]
/proc/loadavg: 1.00 1.06 1.18 2/79 3611
/proc/meminfo: memFree=1618544/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=31944 CPUtime=342.05
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 12058 0 0 0 34195 10 0 0 25 0 1 0 387925369 32710656 7419 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 7986 7419 86 211 0 7772 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 37296

[startup+402.302 s]
/proc/loadavg: 1.00 1.05 1.17 2/79 3611
/proc/meminfo: memFree=1618608/2055924 swapFree=4156844/4192956

################
# More data... #
################

[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=42292 CPUtime=581.97
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 14680 0 0 0 58183 14 0 0 25 0 1 0 387925369 43307008 10041 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 10573 10041 86 211 0 10359 0
Current children cumulated CPU time (s) 582.06
Current children cumulated vsize (KiB) 47644

[startup+642.301 s]
/proc/loadavg: 1.00 1.02 1.12 2/79 3611
/proc/meminfo: memFree=1603952/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=46340 CPUtime=641.95
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 15754 0 0 0 64179 16 0 0 25 0 1 0 387925369 47452160 11115 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11585 11115 86 211 0 11371 0
Current children cumulated CPU time (s) 642.04
Current children cumulated vsize (KiB) 51692

[startup+702.302 s]
/proc/loadavg: 1.00 1.01 1.11 2/79 3611
/proc/meminfo: memFree=1603888/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=45580 CPUtime=701.92
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 17589 0 0 0 70175 17 0 0 25 0 1 0 387925369 46673920 11097 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522955 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11395 11097 86 211 0 11181 0
Current children cumulated CPU time (s) 702.01
Current children cumulated vsize (KiB) 50932

[startup+762.305 s]
/proc/loadavg: 1.00 1.00 1.10 2/79 3611
/proc/meminfo: memFree=1603952/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=45712 CPUtime=761.9
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 17608 0 0 0 76173 17 0 0 25 0 1 0 387925369 46809088 11116 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11428 11116 86 211 0 11214 0
Current children cumulated CPU time (s) 761.99
Current children cumulated vsize (KiB) 51064

[startup+822.302 s]
/proc/loadavg: 1.00 1.00 1.09 2/79 3611
/proc/meminfo: memFree=1603824/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=45976 CPUtime=821.88
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 17646 0 0 0 82170 18 0 0 25 0 1 0 387925369 47079424 11154 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522822 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11494 11154 86 211 0 11280 0
Current children cumulated CPU time (s) 821.97
Current children cumulated vsize (KiB) 51328

[startup+882.302 s]
/proc/loadavg: 1.00 1.00 1.08 2/79 3611
/proc/meminfo: memFree=1602864/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=47424 CPUtime=881.85
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 17864 0 0 0 88167 18 0 0 25 0 1 0 387925369 48562176 11372 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11856 11372 86 211 0 11642 0
Current children cumulated CPU time (s) 881.94
Current children cumulated vsize (KiB) 52776

[startup+942.302 s]
/proc/loadavg: 1.00 1.00 1.08 2/79 3611
/proc/meminfo: memFree=1602416/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=47948 CPUtime=941.84
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 17979 0 0 0 94165 19 0 0 25 0 1 0 387925369 49098752 11487 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 11987 11487 86 211 0 11773 0
Current children cumulated CPU time (s) 941.93
Current children cumulated vsize (KiB) 53300

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.07 2/79 3611
/proc/meminfo: memFree=1602096/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=48272 CPUtime=1001.81
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 18060 0 0 0 100162 19 0 0 25 0 1 0 387925369 49430528 11568 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 12068 11568 86 211 0 11854 0
Current children cumulated CPU time (s) 1001.9
Current children cumulated vsize (KiB) 53624

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.07 2/79 3611
/proc/meminfo: memFree=1601584/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=49052 CPUtime=1061.79
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 18216 0 0 0 106159 20 0 0 25 0 1 0 387925369 50229248 11691 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 12263 11691 86 211 0 12049 0
Current children cumulated CPU time (s) 1061.88
Current children cumulated vsize (KiB) 54404

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.06 2/79 3611
/proc/meminfo: memFree=1598128/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=52992 CPUtime=1121.77
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 19148 0 0 0 112156 21 0 0 25 0 1 0 387925369 54263808 12557 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 13248 12557 86 211 0 13034 0
Current children cumulated CPU time (s) 1121.86
Current children cumulated vsize (KiB) 58344

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.05 2/79 3611
/proc/meminfo: memFree=1595056/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=56076 CPUtime=1181.75
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 19937 0 0 0 118153 22 0 0 25 0 1 0 387925369 57421824 13346 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 14019 13346 86 211 0 13805 0
Current children cumulated CPU time (s) 1181.84
Current children cumulated vsize (KiB) 61428



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.05 2/79 3611
/proc/meminfo: memFree=1594160/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=56980 CPUtime=1199.94
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 20206 0 0 0 119972 22 0 0 25 0 1 0 387925369 58347520 13549 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 14245 13549 86 211 0 14031 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 62332

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.05 2/79 3611
/proc/meminfo: memFree=1594160/2055924 swapFree=4156844/4192956
[pid=3608] ppid=3606 vsize=5352 CPUtime=0.09
/proc/3608/stat : 3608 (rsat.sh) S 3606 3608 1815 0 -1 4194304 305 482 0 0 0 0 9 0 15 0 1 0 387925359 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3608/statm: 1338 234 195 169 0 49 0
[pid=3611] ppid=3608 vsize=56980 CPUtime=1199.94
/proc/3611/stat : 3611 (rsat) R 3608 3608 1815 0 -1 4194304 20206 0 0 0 119972 22 0 0 25 0 1 0 387925369 58347520 13549 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3611/statm: 14245 13549 86 211 0 14031 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 62332

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 3608 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=94985 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=5999
CPU time returned by wait4() is 0.100984
while last known CPU time is 1200.03

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.03
CPU user time (s): 1199.81
CPU system time (s): 0.22
CPU usage (%): 99.9598
Max. virtual memory (cumulated for all children) (KiB): 62332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.094985
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 787
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 4

runsolver used 1.20282 second user time and 3.17252 second system time

The end

Launcher Data (download as text)

Begin job on node6 on Mon Mar 12 06:08:26 UTC 2007

IDJOB= 338062
IDBENCH= 24714
IDSOLVER= 104
FILE ID= node6/338062-1173679706

PBS_JOBID= 4101472

Free space on /tmp= 66431 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/crafted/Difficult/contest05/QG/QG6-gensys-ukn003.sat05-2726.reshuffled-07.cnf
COMMAND LINE= /tmp/evaluation/338062-1173679706/rsat.sh /tmp/evaluation/338062-1173679706/instance-338062-1173679706.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node6/watcher-338062-1173679706 -o ROOT/results/node6/solver-338062-1173679706 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/338062-1173679706/rsat.sh /tmp/evaluation/338062-1173679706/instance-338062-1173679706.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  92c8b4fc23a7c22313979a2d9b3b5a58

RANDOM SEED= 499228709

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node6.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.277
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.277
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1649496 kB
Buffers:         40916 kB
Cached:         274520 kB
SwapCached:       2192 kB
Active:         150232 kB
Inactive:       187848 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1649496 kB
SwapTotal:     4192956 kB
SwapFree:      4156844 kB
Dirty:            2088 kB
Writeback:           0 kB
Mapped:          30760 kB
Slab:            54052 kB
Committed_AS:  1382160 kB
PageTables:       1744 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66431 MiB

End job on node6 on Mon Mar 12 06:28:29 UTC 2007