Trace number 306802

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.02 1200.5

General information on the benchmark

Namerandom/LargeSize/3SAT/v13000/
unif-k3-r4.2-v13000-c54600-S1416986890-04.cnf
MD5SUMfb3f2949b4db9208554e1bbbe827c1fe
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables13000
Number of clauses54600
Sum of the clauses size163800
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 354600
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.06	c ==============================================================================
0.00/0.06	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.06	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.06	c ==============================================================================
0.00/0.06	c |         0 |   54600   163800 |   16379       0        0     nan |  0.000 % |
0.09/0.19	c |         0 |   54240   164715 |      --       0       --      -- |     --   | -360/915
0.09/0.19	c ==============================================================================
0.09/0.19	c Result  :   #vars: 12675   #clauses: 54240   #literals: 164715
0.09/0.19	c CPU time:   0.179972 s
0.09/0.19	c ==============================================================================
0.19/0.26	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node78/watcher-306802-1172106699 -o ROOT/results/node78/solver-306802-1172106699 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/306802-1172106699/rsat.sh /tmp/evaluation/306802-1172106699/instance-306802-1172106699.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 12460
/proc/meminfo: memFree=1288328/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 283 0 0 0 0 0 0 0 19 0 1 0 5537226 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12460/statm: 1338 232 195 169 0 49 0
[pid=12461] ppid=12460 vsize=1556 CPUtime=0
/proc/12461/stat : 12461 (SatElite) R 12460 12460 11407 0 -1 4194304 286 0 0 0 0 0 0 0 20 0 1 0 5537227 1593344 268 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134548165 0 0 4096 3 0 0 0 17 0 0 0
/proc/12461/statm: 389 271 49 128 0 258 0

[startup+0.107699 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 12460
/proc/meminfo: memFree=1288328/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 283 0 0 0 0 0 0 0 19 0 1 0 5537226 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12460/statm: 1338 232 195 169 0 49 0
[pid=12461] ppid=12460 vsize=6800 CPUtime=0.09
/proc/12461/stat : 12461 (SatElite) R 12460 12460 11407 0 -1 4194304 1589 0 0 0 9 0 0 0 21 0 1 0 5537227 6963200 1571 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134571434 0 0 4096 3 0 0 0 17 1 0 0
/proc/12461/statm: 1700 1571 69 128 0 1569 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12152

[startup+0.516772 s]
/proc/loadavg: 1.00 1.00 1.00 3/65 12460
/proc/meminfo: memFree=1288328/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 5352

[startup+1.34192 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=1281976/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=7908 CPUtime=1.06
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 1808 0 0 0 105 1 0 0 25 0 1 0 5537253 8097792 1792 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522976 0 0 4096 1026 0 0 0 17 0 0 0
/proc/12463/statm: 1977 1792 86 211 0 1763 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 13260

[startup+2.98222 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=1278840/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=12364 CPUtime=2.7
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 2937 0 0 0 269 1 0 0 25 0 1 0 5537253 12660736 2921 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530122 0 0 4096 1026 0 0 0 17 0 0 0
/proc/12463/statm: 3091 2921 86 211 0 2877 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 17716

[startup+6.25882 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=1269560/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=21040 CPUtime=5.98
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 5087 0 0 0 595 3 0 0 25 0 1 0 5537253 21544960 5071 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 0 0 0
/proc/12463/statm: 5260 5071 86 211 0 5046 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 26392

[startup+12.721 s]
/proc/loadavg: 1.15 1.03 1.01 2/67 12463
/proc/meminfo: memFree=1260344/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=28556 CPUtime=12.43
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 7174 0 0 0 1239 4 0 0 25 0 1 0 5537253 29241344 6929 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530115 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 7139 6929 86 211 0 6925 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 33908

[startup+25.5292 s]
/proc/loadavg: 1.20 1.05 1.01 2/67 12463
/proc/meminfo: memFree=1245048/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=43656 CPUtime=25.23
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 11172 0 0 0 2515 8 0 0 25 0 1 0 5537253 44703744 10731 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522887 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 10914 10731 86 211 0 10700 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 49008

[startup+51.1569 s]
/proc/loadavg: 1.13 1.04 1.01 2/67 12463
/proc/meminfo: memFree=1229112/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=59872 CPUtime=50.85
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 15646 0 0 0 5074 11 0 0 25 0 1 0 5537253 61308928 14719 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522843 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 14968 14719 86 211 0 14754 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 65224

[startup+102.406 s]
/proc/loadavg: 1.06 1.03 1.01 2/67 12463
/proc/meminfo: memFree=1200632/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=88160 CPUtime=102.08
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 23159 0 0 0 10191 17 0 0 25 0 1 0 5537253 90275840 21844 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522902 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 22040 21844 86 211 0 21826 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 93512

[startup+162.476 s]
/proc/loadavg: 1.02 1.02 1.00 2/67 12463
/proc/meminfo: memFree=1156728/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=132268 CPUtime=162.13
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 35077 0 0 0 16188 25 0 0 25 0 1 0 5537253 135442432 32796 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 33067 32796 86 211 0 32853 0
Current children cumulated CPU time (s) 162.38
Current children cumulated vsize (KiB) 137620

[startup+222.538 s]
/proc/loadavg: 1.00 1.02 1.00 2/67 12463
/proc/meminfo: memFree=1109560/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=179708 CPUtime=222.17
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 47027 0 0 0 22183 34 0 0 25 0 1 0 5537253 184020992 44746 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 44927 44746 86 211 0 44713 0
Current children cumulated CPU time (s) 222.42
Current children cumulated vsize (KiB) 185060

[startup+282.6 s]
/proc/loadavg: 1.00 1.01 1.00 2/67 12463
/proc/meminfo: memFree=1090936/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=198872 CPUtime=282.21
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 53401 0 0 0 28184 37 0 0 25 0 1 0 5537253 203644928 49194 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 49718 49194 86 211 0 49504 0
Current children cumulated CPU time (s) 282.46
Current children cumulated vsize (KiB) 204224

[startup+342.663 s]
/proc/loadavg: 1.00 1.01 1.00 2/67 12463
/proc/meminfo: memFree=1083640/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=207728 CPUtime=342.25
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 55603 0 0 0 34186 39 0 0 25 0 1 0 5537253 212713472 51396 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 51932 51396 86 211 0 51718 0
Current children cumulated CPU time (s) 342.5
Current children cumulated vsize (KiB) 213080

[startup+402.725 s]
/proc/loadavg: 1.05 1.02 1.00 2/67 12463
/proc/meminfo: memFree=1010296/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=279104 CPUtime=402.29
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 73603 0 0 0 40173 56 0 0 25 0 1 0 5537253 285802496 69396 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 69776 69396 86 211 0 69562 0
Current children cumulated CPU time (s) 402.54
Current children cumulated vsize (KiB) 284456

[startup+462.794 s]
/proc/loadavg: 1.05 1.03 1.00 2/67 12463
/proc/meminfo: memFree=971768/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=316924 CPUtime=462.34
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 84652 0 0 0 46169 65 0 0 25 0 1 0 5537253 324530176 78904 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 79231 78904 86 211 0 79017 0
Current children cumulated CPU time (s) 462.59
Current children cumulated vsize (KiB) 322276

[startup+522.864 s]

################
# More data... #
################

[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=316924 CPUtime=582.43
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 84652 0 0 0 58178 65 0 0 25 0 1 0 5537253 324530176 78904 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 79231 78904 86 211 0 79017 0
Current children cumulated CPU time (s) 582.68
Current children cumulated vsize (KiB) 322276

[startup+642.997 s]
/proc/loadavg: 1.00 1.01 1.00 2/67 12463
/proc/meminfo: memFree=971768/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=316924 CPUtime=642.47
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 84707 0 0 0 64182 65 0 0 25 0 1 0 5537253 324530176 78959 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134525985 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 79231 78959 86 211 0 79017 0
Current children cumulated CPU time (s) 642.72
Current children cumulated vsize (KiB) 322276

[startup+703.056 s]
/proc/loadavg: 1.03 1.02 1.00 2/67 12463
/proc/meminfo: memFree=908472/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=382980 CPUtime=702.51
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 101351 0 0 0 70171 80 0 0 25 0 1 0 5537253 392171520 94832 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 95745 94832 86 211 0 95531 0
Current children cumulated CPU time (s) 702.76
Current children cumulated vsize (KiB) 388332

[startup+763.118 s]
/proc/loadavg: 1.01 1.01 1.00 2/67 12463
/proc/meminfo: memFree=860024/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=762.56
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 76163 93 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134983564 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 762.81
Current children cumulated vsize (KiB) 435684

[startup+823.186 s]
/proc/loadavg: 1.00 1.01 1.00 2/67 12463
/proc/meminfo: memFree=860152/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=822.6
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 82167 93 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 822.85
Current children cumulated vsize (KiB) 435684

[startup+883.25 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=860216/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=882.64
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 88171 93 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134525872 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 882.89
Current children cumulated vsize (KiB) 435684

[startup+943.316 s]
/proc/loadavg: 1.04 1.01 1.00 2/67 12463
/proc/meminfo: memFree=860216/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=942.68
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 94175 93 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 942.93
Current children cumulated vsize (KiB) 435684

[startup+1003.38 s]
/proc/loadavg: 1.01 1.01 1.00 2/67 12463
/proc/meminfo: memFree=860216/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=1002.74
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 100180 94 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 1002.99
Current children cumulated vsize (KiB) 435684

[startup+1063.45 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=860216/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=430332 CPUtime=1062.77
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 116358 0 0 0 106183 94 0 0 25 0 1 0 5537253 440659968 106763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529765 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 107583 106763 86 211 0 107369 0
Current children cumulated CPU time (s) 1063.02
Current children cumulated vsize (KiB) 435684

[startup+1123.51 s]
/proc/loadavg: 1.00 1.00 1.00 2/67 12463
/proc/meminfo: memFree=825464/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=465424 CPUtime=1122.82
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 125161 0 0 0 112179 103 0 0 25 0 1 0 5537253 476594176 115565 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 116356 115565 86 211 0 116142 0
Current children cumulated CPU time (s) 1123.07
Current children cumulated vsize (KiB) 470776

[startup+1183.58 s]
/proc/loadavg: 1.08 1.02 1.01 2/67 12463
/proc/meminfo: memFree=776056/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=514744 CPUtime=1182.86
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 137554 0 0 0 118168 118 0 0 25 0 1 0 5537253 527097856 127956 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 128686 127956 86 211 0 128472 0
Current children cumulated CPU time (s) 1183.11
Current children cumulated vsize (KiB) 520096



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.49 s]
/proc/loadavg: 1.06 1.02 1.00 2/67 12463
/proc/meminfo: memFree=763704/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=526292 CPUtime=1199.77
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 140438 0 0 0 119857 120 0 0 25 0 1 0 5537253 538923008 130839 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529231 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 131573 130839 86 211 0 131359 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 531644

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.49 s]
/proc/loadavg: 1.06 1.02 1.00 2/67 12463
/proc/meminfo: memFree=763704/2055920 swapFree=4192956/4192956
[pid=12460] ppid=12458 vsize=5352 CPUtime=0.25
/proc/12460/stat : 12460 (rsat.sh) S 12458 12460 11407 0 -1 4194304 305 1700 0 0 0 0 24 1 15 0 1 0 5537226 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246004900676 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12460/statm: 1338 234 195 169 0 49 0
[pid=12463] ppid=12460 vsize=526292 CPUtime=1199.77
/proc/12463/stat : 12463 (rsat) R 12460 12460 11407 0 -1 4194304 140438 0 0 0 119857 120 0 0 25 0 1 0 5537253 538923008 130839 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529231 0 0 4096 1026 0 0 0 17 1 0 0
/proc/12463/statm: 131573 130839 86 211 0 131359 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 531644

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 12460 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=244962 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=14997
CPU time returned by wait4() is 0.259959
while last known CPU time is 1200.02

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.5
CPU time (s): 1200.02
CPU user time (s): 1198.81
CPU system time (s): 1.21
CPU usage (%): 99.96
Max. virtual memory (cumulated for all children) (KiB): 531644

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.244962
system time used= 0.014997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2005
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 7

runsolver used 1.50777 second user time and 2.73858 second system time

The end

Launcher Data (download as text)

Begin job on node78 on Thu Feb 22 01:11:39 UTC 2007

IDJOB= 306802
IDBENCH= 20190
IDSOLVER= 104
FILE ID= node78/306802-1172106699

PBS_JOBID= 3892888

Free space on /tmp= 66561 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/3SAT/v13000/unif-k3-r4.2-v13000-c54600-S1416986890-04.cnf
COMMAND LINE= /tmp/evaluation/306802-1172106699/rsat.sh /tmp/evaluation/306802-1172106699/instance-306802-1172106699.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node78/watcher-306802-1172106699 -o ROOT/results/node78/solver-306802-1172106699 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/306802-1172106699/rsat.sh /tmp/evaluation/306802-1172106699/instance-306802-1172106699.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  fb3f2949b4db9208554e1bbbe827c1fe

RANDOM SEED= 550531807

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node78.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1288800 kB
Buffers:         40468 kB
Cached:         631508 kB
SwapCached:          0 kB
Active:         248980 kB
Inactive:       438180 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1288800 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            2688 kB
Writeback:           0 kB
Mapped:          25284 kB
Slab:            65972 kB
Committed_AS:    77500 kB
PageTables:       1464 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node78 on Thu Feb 22 01:31:41 UTC 2007