Trace number 291919

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.01 1200.42

General information on the benchmark

Namerandom/OnTreshold/5SAT/v70/
unif-k5-r21.3-v70-c1491-S1474234583-11.UNSAT.shuffled.cnf
MD5SUMfb662fcb2216f5e012e97644773420f6
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark7.66783
Satisfiable
(Un)Satisfiability was proved
Number of variables70
Number of clauses1491
Sum of the clauses size7455
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 51491
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    1491     7455 |     447       0        0     nan |  0.000 % |
0.00/0.00	c ==============================================================================
0.00/0.00	c Result  :   #vars: 70   #clauses: 1491   #literals: 7455
0.00/0.00	c CPU time:   0 s
0.00/0.00	c ==============================================================================
0.00/0.01	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node3/watcher-291919-1171748564 -o ROOT/results/node3/solver-291919-1171748564 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/291919-1171748564/rsat.sh /tmp/evaluation/291919-1171748564/instance-291919-1171748564.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.93 3/77 14906
/proc/meminfo: memFree=797032/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 194811272 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 234 195 169 0 50 0
[pid=14907] ppid=14906 vsize=820 CPUtime=0
/proc/14907/stat : 14907 (SatElite) R 14906 14906 14419 0 -1 4194304 125 0 0 0 0 0 0 0 19 0 1 0 194811272 839680 107 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134577808 0 0 4096 3 0 0 0 17 1 0 0
/proc/14907/statm: 205 108 66 128 0 74 0

[startup+0.106851 s]
/proc/loadavg: 0.92 0.98 0.93 3/77 14906
/proc/meminfo: memFree=797032/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.514891 s]
/proc/loadavg: 0.92 0.98 0.93 3/77 14906
/proc/meminfo: memFree=797032/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.33495 s]
/proc/loadavg: 0.92 0.98 0.93 2/79 14909
/proc/meminfo: memFree=794584/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=2792 CPUtime=1.31
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 702 0 0 0 131 0 0 0 25 0 1 0 194811273 2859008 543 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 698 543 86 211 0 484 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 8148

[startup+2.97108 s]
/proc/loadavg: 0.92 0.98 0.93 2/79 14909
/proc/meminfo: memFree=793880/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=3704 CPUtime=2.94
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 1078 0 0 0 294 0 0 0 25 0 1 0 194811273 3792896 723 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522826 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 926 723 86 211 0 712 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 9060

[startup+6.25935 s]
/proc/loadavg: 0.93 0.98 0.93 2/79 14909
/proc/meminfo: memFree=792600/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=4776 CPUtime=6.23
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 1553 0 0 0 623 0 0 0 25 0 1 0 194811273 4890624 1002 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 1194 1002 86 211 0 980 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 10132

[startup+12.7099 s]
/proc/loadavg: 0.93 0.98 0.93 2/79 14909
/proc/meminfo: memFree=791000/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=6524 CPUtime=12.69
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 2417 0 0 0 1268 1 0 0 25 0 1 0 194811273 6680576 1380 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523251 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 1631 1380 86 211 0 1417 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 11880

[startup+25.5299 s]
/proc/loadavg: 0.95 0.98 0.93 2/79 14909
/proc/meminfo: memFree=789592/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=8100 CPUtime=25.5
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 2859 0 0 0 2549 1 0 0 25 0 1 0 194811273 8294400 1822 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 2025 1822 86 211 0 1811 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 13456

[startup+51.156 s]
/proc/loadavg: 0.96 0.98 0.93 2/79 14909
/proc/meminfo: memFree=788120/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=9940 CPUtime=51.12
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 3752 0 0 0 5110 2 0 0 25 0 1 0 194811273 10178560 2115 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 2485 2115 86 211 0 2271 0
Current children cumulated CPU time (s) 51.12
Current children cumulated vsize (KiB) 15296

[startup+102.406 s]
/proc/loadavg: 0.98 0.98 0.93 2/79 14909
/proc/meminfo: memFree=784600/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=12908 CPUtime=102.36
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 5438 0 0 0 10232 4 0 0 25 0 1 0 194811273 13217792 2964 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 3227 2964 86 211 0 3013 0
Current children cumulated CPU time (s) 102.36
Current children cumulated vsize (KiB) 18264

[startup+162.482 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=780632/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=17052 CPUtime=162.42
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 6447 0 0 0 16237 5 0 0 25 0 1 0 194811273 17461248 3973 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 4263 3973 86 211 0 4049 0
Current children cumulated CPU time (s) 162.42
Current children cumulated vsize (KiB) 22408

[startup+222.554 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=779224/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=19384 CPUtime=222.48
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 8829 0 0 0 22242 6 0 0 25 0 1 0 194811273 19849216 4288 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 4846 4288 86 211 0 4632 0
Current children cumulated CPU time (s) 222.48
Current children cumulated vsize (KiB) 24740

[startup+282.623 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=778456/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=20360 CPUtime=282.54
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 9098 0 0 0 28247 7 0 0 25 0 1 0 194811273 20848640 4491 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 5090 4491 86 211 0 4876 0
Current children cumulated CPU time (s) 282.54
Current children cumulated vsize (KiB) 25716

[startup+342.692 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=775320/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=23660 CPUtime=342.59
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 10001 0 0 0 34251 8 0 0 25 0 1 0 194811273 24227840 5296 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522826 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 5915 5296 86 211 0 5701 0
Current children cumulated CPU time (s) 342.59
Current children cumulated vsize (KiB) 29016

[startup+402.765 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=772120/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=26940 CPUtime=402.65
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 10906 0 0 0 40256 9 0 0 25 0 1 0 194811273 27586560 6091 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 6735 6091 86 211 0 6521 0
Current children cumulated CPU time (s) 402.65
Current children cumulated vsize (KiB) 32296

[startup+462.833 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=772568/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=24920 CPUtime=462.7
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 12955 0 0 0 46259 11 0 0 25 0 1 0 194811273 25518080 5914 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 6230 5914 86 211 0 6016 0
Current children cumulated CPU time (s) 462.7
Current children cumulated vsize (KiB) 30276

[startup+522.902 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=772568/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0

################
# More data... #
################

[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=26744 CPUtime=582.82
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 13285 0 0 0 58270 12 0 0 25 0 1 0 194811273 27385856 6211 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 6686 6211 86 211 0 6472 0
Current children cumulated CPU time (s) 582.82
Current children cumulated vsize (KiB) 32100

[startup+643.04 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=770904/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=27652 CPUtime=642.86
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 13465 0 0 0 64274 12 0 0 25 0 1 0 194811273 28315648 6358 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 6913 6358 86 211 0 6699 0
Current children cumulated CPU time (s) 642.86
Current children cumulated vsize (KiB) 33008

[startup+703.107 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=770648/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=28104 CPUtime=702.91
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 13594 0 0 0 70279 12 0 0 25 0 1 0 194811273 28778496 6454 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 7026 6454 86 211 0 6812 0
Current children cumulated CPU time (s) 702.91
Current children cumulated vsize (KiB) 33460

[startup+763.175 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=767960/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=30740 CPUtime=762.97
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 14270 0 0 0 76284 13 0 0 25 0 1 0 194811273 31477760 7130 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 7685 7130 86 211 0 7471 0
Current children cumulated CPU time (s) 762.97
Current children cumulated vsize (KiB) 36096

[startup+823.247 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=765272/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=36664 CPUtime=823.03
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 15839 0 0 0 82288 15 0 0 25 0 1 0 194811273 37543936 7800 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9166 7800 86 211 0 8952 0
Current children cumulated CPU time (s) 823.03
Current children cumulated vsize (KiB) 42020

[startup+883.317 s]
/proc/loadavg: 0.99 0.98 0.93 3/79 14909
/proc/meminfo: memFree=762840/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=38880 CPUtime=883.09
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 16466 0 0 0 88293 16 0 0 25 0 1 0 194811273 39813120 8394 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9720 8394 86 211 0 9506 0
Current children cumulated CPU time (s) 883.09
Current children cumulated vsize (KiB) 44236

[startup+943.383 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=760664/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=40856 CPUtime=943.14
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 17023 0 0 0 94297 17 0 0 25 0 1 0 194811273 41836544 8951 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 10214 8951 86 211 0 10000 0
Current children cumulated CPU time (s) 943.14
Current children cumulated vsize (KiB) 46212

[startup+1003.45 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=762776/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=36584 CPUtime=1003.19
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 20659 0 0 0 100300 19 0 0 25 0 1 0 194811273 37462016 8360 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9146 8360 86 211 0 8932 0
Current children cumulated CPU time (s) 1003.19
Current children cumulated vsize (KiB) 41940

[startup+1063.52 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 14909
/proc/meminfo: memFree=762776/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=36844 CPUtime=1063.25
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 20701 0 0 0 106305 20 0 0 25 0 1 0 194811273 37728256 8402 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9211 8402 86 211 0 8997 0
Current children cumulated CPU time (s) 1063.25
Current children cumulated vsize (KiB) 42200

[startup+1123.6 s]
/proc/loadavg: 0.99 0.98 0.93 2/85 15011
/proc/meminfo: memFree=760808/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=38024 CPUtime=1123.27
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 20928 0 0 0 112307 20 0 0 25 0 1 0 194811273 38936576 8596 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9506 8596 86 211 0 9292 0
Current children cumulated CPU time (s) 1123.27
Current children cumulated vsize (KiB) 43380

[startup+1183.69 s]
/proc/loadavg: 0.99 0.98 0.93 2/85 15083
/proc/meminfo: memFree=760424/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=38548 CPUtime=1183.3
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 21052 0 0 0 118310 20 0 0 25 0 1 0 194811273 39473152 8687 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9637 8687 86 211 0 9423 0
Current children cumulated CPU time (s) 1183.3
Current children cumulated vsize (KiB) 43904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.41 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 15107
/proc/meminfo: memFree=761304/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=38548 CPUtime=1200.01
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 21060 0 0 0 119980 21 0 0 25 0 1 0 194811273 39473152 8695 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9637 8695 86 211 0 9423 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 43904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.41 s]
/proc/loadavg: 0.99 0.98 0.93 2/79 15107
/proc/meminfo: memFree=761304/2055920 swapFree=4192812/4192956
[pid=14906] ppid=14904 vsize=5356 CPUtime=0
/proc/14906/stat : 14906 (rsat.sh) S 14904 14906 14419 0 -1 4194304 307 128 0 0 0 0 0 0 18 0 1 0 194811272 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14906/statm: 1339 235 195 169 0 50 0
[pid=14909] ppid=14906 vsize=38548 CPUtime=1200.01
/proc/14909/stat : 14909 (rsat) R 14906 14906 14419 0 -1 4194304 21060 0 0 0 119980 21 0 0 25 0 1 0 194811273 39473152 8695 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14909/statm: 9637 8695 86 211 0 9423 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 43904

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 14906 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=3999 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=3999
CPU time returned by wait4() is 0.007998
while last known CPU time is 1200.01

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.42
CPU time (s): 1200.01
CPU user time (s): 1199.8
CPU system time (s): 0.21
CPU usage (%): 99.9659
Max. virtual memory (cumulated for all children) (KiB): 59804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.003999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 435
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 3

runsolver used 1.21182 second user time and 3.05454 second system time

The end

Launcher Data (download as text)

Begin job on node3 on Sat Feb 17 21:42:44 UTC 2007

IDJOB= 291919
IDBENCH= 19827
IDSOLVER= 104
FILE ID= node3/291919-1171748564

PBS_JOBID= 3839265

Free space on /tmp= 66552 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/5SAT/v70/unif-k5-r21.3-v70-c1491-S1474234583-11.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/291919-1171748564/rsat.sh /tmp/evaluation/291919-1171748564/instance-291919-1171748564.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node3/watcher-291919-1171748564 -o ROOT/results/node3/solver-291919-1171748564 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/291919-1171748564/rsat.sh /tmp/evaluation/291919-1171748564/instance-291919-1171748564.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  fb662fcb2216f5e012e97644773420f6

RANDOM SEED= 993663623

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node3.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        797376 kB
Buffers:         56456 kB
Cached:        1070508 kB
SwapCached:          0 kB
Active:         537116 kB
Inactive:       644456 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        797376 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            1740 kB
Writeback:           0 kB
Mapped:          73488 kB
Slab:            62584 kB
Committed_AS:   914140 kB
PageTables:       1656 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66552 MiB

End job on node3 on Sat Feb 17 22:02:47 UTC 2007