Trace number 302292

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.07 1200.98

General information on the benchmark

Namerandom/LargeSize/5SAT/v900/
unif-k5-r20-v900-c18000-S1517867865-16.cnf
MD5SUMf3afe0baf07d92ddf8b999932745fd0c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark140.778
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of clauses18000
Sum of the clauses size90000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 518000
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.02	c ==============================================================================
0.00/0.02	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.02	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.02	c ==============================================================================
0.00/0.02	c |         0 |   18000    90000 |    5399       0        0     nan |  0.000 % |
0.00/0.02	c ==============================================================================
0.00/0.02	c Result  :   #vars: 900   #clauses: 18000   #literals: 90000
0.00/0.02	c CPU time:   0.020996 s
0.00/0.02	c ==============================================================================
0.00/0.06	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node75/watcher-302292-1172008537 -o ROOT/results/node75/solver-302292-1172008537 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/302292-1172008537/rsat.sh /tmp/evaluation/302292-1172008537/instance-302292-1172008537.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.95 0.98 0.91 3/64 7943
/proc/meminfo: memFree=1525808/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 283 0 0 0 0 0 0 0 19 0 1 0 220819510 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7943/statm: 1338 232 195 169 0 49 0
[pid=7944] ppid=7943 vsize=1088 CPUtime=0
/proc/7944/stat : 7944 (SatElite) R 7943 7943 7104 0 -1 4194304 177 0 0 0 0 0 0 0 18 0 1 0 220819510 1114112 159 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 0 0 0
/proc/7944/statm: 272 160 49 128 0 141 0

[startup+0.110102 s]
/proc/loadavg: 0.95 0.98 0.91 3/64 7943
/proc/meminfo: memFree=1525808/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 5352

[startup+0.518151 s]
/proc/loadavg: 0.95 0.98 0.91 3/64 7943
/proc/meminfo: memFree=1525808/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 5352

[startup+1.33824 s]
/proc/loadavg: 0.95 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1519200/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=7900 CPUtime=1.26
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 1903 0 0 0 126 0 0 0 25 0 1 0 220819516 8089600 1809 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134519492 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 1975 1809 86 211 0 1761 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 13252

[startup+2.97443 s]
/proc/loadavg: 0.95 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1516256/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=10784 CPUtime=2.89
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 2698 0 0 0 289 0 0 0 25 0 1 0 220819516 11042816 2539 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526499 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 2696 2539 86 211 0 2482 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 16136

[startup+6.25782 s]
/proc/loadavg: 0.96 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1510816/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=16036 CPUtime=6.17
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 4187 0 0 0 615 2 0 0 25 0 1 0 220819516 16420864 3799 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523286 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 4009 3799 86 211 0 3795 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 21388

[startup+12.7096 s]
/proc/loadavg: 0.96 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1500960/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=25776 CPUtime=12.63
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 6884 0 0 0 1258 5 0 0 25 0 1 0 220819516 26394624 6202 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 6444 6202 86 211 0 6230 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 31128

[startup+25.5301 s]
/proc/loadavg: 0.97 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1489760/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=37448 CPUtime=25.42
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 10231 0 0 0 2535 7 0 0 25 0 1 0 220819516 38346752 9161 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 9362 9161 86 211 0 9148 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 42800

[startup+51.1542 s]
/proc/loadavg: 0.98 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1473568/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=53336 CPUtime=51.03
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 15060 0 0 0 5092 11 0 0 25 0 1 0 220819516 54616064 13024 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 13334 13024 86 211 0 13120 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 58688

[startup+102.395 s]
/proc/loadavg: 0.99 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1455648/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=71440 CPUtime=102.24
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 20441 0 0 0 10208 16 0 0 25 0 1 0 220819516 73154560 17633 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529599 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 17860 17633 86 211 0 17646 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 76792

[startup+162.454 s]
/proc/loadavg: 0.99 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1426912/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=99836 CPUtime=162.27
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 29202 0 0 0 16204 23 0 0 25 0 1 0 220819516 102232064 24468 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 24959 24468 86 211 0 24745 0
Current children cumulated CPU time (s) 162.32
Current children cumulated vsize (KiB) 105188

[startup+222.52 s]
/proc/loadavg: 0.99 0.98 0.91 2/66 7946
/proc/meminfo: memFree=1418784/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=108444 CPUtime=222.29
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 31345 0 0 0 22204 25 0 0 25 0 1 0 220819516 111046656 26611 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 27111 26611 86 211 0 26897 0
Current children cumulated CPU time (s) 222.34
Current children cumulated vsize (KiB) 113796

[startup+282.578 s]
/proc/loadavg: 1.10 1.02 0.93 2/66 7946
/proc/meminfo: memFree=1380896/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=145724 CPUtime=282.32
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 40834 0 0 0 28198 34 0 0 25 0 1 0 220819516 149221376 36100 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 36431 36100 86 211 0 36217 0
Current children cumulated CPU time (s) 282.37
Current children cumulated vsize (KiB) 151076

[startup+342.652 s]
/proc/loadavg: 1.04 1.01 0.93 2/72 8028
/proc/meminfo: memFree=1368232/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=156288 CPUtime=342.32
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 45103 0 0 0 34193 39 0 0 25 0 1 0 220819516 160038912 38810 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 39072 38810 86 211 0 38858 0
Current children cumulated CPU time (s) 342.37
Current children cumulated vsize (KiB) 161640

[startup+402.75 s]
/proc/loadavg: 1.01 1.00 0.93 2/72 8116
/proc/meminfo: memFree=1368224/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=156288 CPUtime=402.33
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 45104 0 0 0 40187 46 0 0 25 0 1 0 220819516 160038912 38811 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 39072 38811 86 211 0 38858 0
Current children cumulated CPU time (s) 402.38
Current children cumulated vsize (KiB) 161640

[startup+462.812 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1369184/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=156288 CPUtime=462.35
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 45123 0 0 0 46187 48 0 0 25 0 1 0 220819516 160038912 38830 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523307 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 39072 38830 86 211 0 38858 0
Current children cumulated CPU time (s) 462.4
Current children cumulated vsize (KiB) 161640

[startup+522.867 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1343968/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=184672 CPUtime=522.34
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 52341 0 0 0 52180 54 0 0 25 0 1 0 220819516 189104128 45278 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 46168 45278 86 211 0 45954 0
Current children cumulated CPU time (s) 522.39
Current children cumulated vsize (KiB) 190024

[startup+582.928 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1319904/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=208004 CPUtime=582.38
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 58287 0 0 0 58179 59 0 0 25 0 1 0 220819516 212996096 51224 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 52001 51224 86 211 0 51787 0
Current children cumulated CPU time (s) 582.43
Current children cumulated vsize (KiB) 213356

[startup+642.988 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1302176/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=642.4
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 64175 65 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 642.45
Current children cumulated vsize (KiB) 230576

[startup+703.05 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1302048/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=702.42
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 70177 65 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 702.47
Current children cumulated vsize (KiB) 230576

[startup+763.111 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1301984/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=762.44
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 76179 65 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 762.49
Current children cumulated vsize (KiB) 230576

[startup+823.171 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1301984/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=822.46
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 82181 65 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 822.51
Current children cumulated vsize (KiB) 230576

[startup+883.241 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1301984/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=882.5
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 88184 66 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 882.55
Current children cumulated vsize (KiB) 230576

[startup+943.307 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1302048/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=225224 CPUtime=942.52
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 65741 0 0 0 94186 66 0 0 25 0 1 0 220819516 230629376 55602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 56306 55602 86 211 0 56092 0
Current children cumulated CPU time (s) 942.57
Current children cumulated vsize (KiB) 230576

[startup+1003.37 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1298976/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=228740 CPUtime=1002.54
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 66622 0 0 0 100186 68 0 0 25 0 1 0 220819516 234229760 56483 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 57185 56484 86 211 0 56971 0
Current children cumulated CPU time (s) 1002.59
Current children cumulated vsize (KiB) 234092

[startup+1063.43 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1277472/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=249824 CPUtime=1062.56
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 71943 0 0 0 106183 73 0 0 25 0 1 0 220819516 255819776 61804 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522897 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 62456 61804 86 211 0 62242 0
Current children cumulated CPU time (s) 1062.61
Current children cumulated vsize (KiB) 255176

[startup+1123.49 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1258848/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=268100 CPUtime=1122.58
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 76610 0 0 0 112179 79 0 0 25 0 1 0 220819516 274534400 66471 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 67025 66471 86 211 0 66811 0
Current children cumulated CPU time (s) 1122.63
Current children cumulated vsize (KiB) 273452

[startup+1183.55 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1242208/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=284588 CPUtime=1182.6
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 80788 0 0 0 118177 83 0 0 25 0 1 0 220819516 291418112 70649 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 71147 70649 86 211 0 70933 0
Current children cumulated CPU time (s) 1182.65
Current children cumulated vsize (KiB) 289940



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.97 s]
/proc/loadavg: 1.00 1.00 0.93 2/66 8144
/proc/meminfo: memFree=1237536/2055920 swapFree=4183228/4192956
[pid=7943] ppid=7941 vsize=5352 CPUtime=0.05
/proc/7943/stat : 7943 (rsat.sh) S 7941 7943 7104 0 -1 4194304 305 475 0 0 0 0 5 0 17 0 1 0 220819510 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231882679108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7943/statm: 1338 234 195 169 0 49 0
[pid=7946] ppid=7943 vsize=288968 CPUtime=1200.02
/proc/7946/stat : 7946 (rsat) R 7943 7943 7104 0 -1 4194304 81904 0 0 0 119917 85 0 0 25 0 1 0 220819516 295903232 71765 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/7946/statm: 72242 71765 86 211 0 72028 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 294320

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 7943 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=52991 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=4999
CPU time returned by wait4() is 0.05799
while last known CPU time is 1200.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.98
CPU time (s): 1200.07
CPU user time (s): 1199.22
CPU system time (s): 0.85
CPU usage (%): 99.9239
Max. virtual memory (cumulated for all children) (KiB): 294320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.052991
system time used= 0.004999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 780
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 2

runsolver used 0.861868 second user time and 2.53062 second system time

The end

Launcher Data (download as text)

Begin job on node75 on Tue Feb 20 21:55:37 UTC 2007

IDJOB= 302292
IDBENCH= 20080
IDSOLVER= 104
FILE ID= node75/302292-1172008537

PBS_JOBID= 3892650

Free space on /tmp= 66561 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/5SAT/v900/unif-k5-r20-v900-c18000-S1517867865-16.cnf
COMMAND LINE= /tmp/evaluation/302292-1172008537/rsat.sh /tmp/evaluation/302292-1172008537/instance-302292-1172008537.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node75/watcher-302292-1172008537 -o ROOT/results/node75/solver-302292-1172008537 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/302292-1172008537/rsat.sh /tmp/evaluation/302292-1172008537/instance-302292-1172008537.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  f3afe0baf07d92ddf8b999932745fd0c

RANDOM SEED= 523520225

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node75.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1526152 kB
Buffers:         26340 kB
Cached:         420732 kB
SwapCached:       3700 kB
Active:          48356 kB
Inactive:       408284 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1526152 kB
SwapTotal:     4192956 kB
SwapFree:      4183228 kB
Dirty:            2092 kB
Writeback:           0 kB
Mapped:          15684 kB
Slab:            59056 kB
Committed_AS:   652032 kB
PageTables:       1432 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node75 on Tue Feb 20 22:15:40 UTC 2007