Trace number 338440

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.09 1200.61

General information on the benchmark

Namecrafted/Difficult/contest05/sabharwal/
grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf
MD5SUMe899c85929b7de69ebfb14f0dad93191
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.77373
Satisfiable
(Un)Satisfiability was proved
Number of variables90300
Number of clauses179701
Sum of the clauses size718198
Maximum clause length4
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2300
Number of clauses of size 30
Number of clauses of size 4179399
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.39/0.47	c ==============================================================================
0.39/0.47	c |           |     ORIGINAL     |              LEARNT              |          |
0.39/0.47	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.39/0.47	c ==============================================================================
0.39/0.47	c |         0 |  179699   718196 |   53909       0        0     nan |  0.000 % |
2.39/2.42	c |         0 |       0        0 |      --       0       --      -- |     --   | -179699/-718188
2.39/2.42	c ==============================================================================
2.39/2.42	c Result  :   #vars: 0   #clauses: 0   #literals: 0
2.39/2.42	c CPU time:   2.22566 s
2.39/2.42	c ==============================================================================
2.39/2.43	c Rsat version 2.00
2.39/2.43	c CNF stats: (0 vars, 0 clauses)
2.39/2.43	c Decisions: 0
2.39/2.43	c Conflicts: 0
2.39/2.43	c Time: 0.00000s

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node15/watcher-338440-1173685933 -o ROOT/results/node15/solver-338440-1173685933 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/338440-1173685933/rsat.sh /tmp/evaluation/338440-1173685933/instance-338440-1173685933.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 7321
/proc/meminfo: memFree=1349512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=1556 CPUtime=0
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 276 0 0 0 0 0 0 0 20 0 1 0 388547757 1593344 258 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134548172 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 389 260 49 128 0 258 0

[startup+0.0681201 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 7321
/proc/meminfo: memFree=1349512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=15884 CPUtime=0.05
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 3117 0 0 0 4 1 0 0 20 0 1 0 388547757 16265216 2952 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 3971 2953 49 128 0 3840 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 21236

[startup+0.102126 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 7321
/proc/meminfo: memFree=1349512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=18516 CPUtime=0.09
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 3772 0 0 0 7 2 0 0 20 0 1 0 388547757 18960384 3607 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 4629 3608 49 128 0 4498 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23868

[startup+0.301158 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 7321
/proc/meminfo: memFree=1349512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=28128 CPUtime=0.28
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 6093 0 0 0 25 3 0 0 20 0 1 0 388547757 28803072 5928 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 7032 5928 49 128 0 6901 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 33480

[startup+0.702228 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 7321
/proc/meminfo: memFree=1349512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=36372 CPUtime=0.69
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 8438 0 0 0 64 5 0 0 24 0 1 0 388547757 37244928 7793 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134571712 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 9093 7793 69 128 0 8962 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 41724

[startup+1.50137 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7323
/proc/meminfo: memFree=1318584/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=0
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 388547757 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/7321/statm: 1338 232 195 169 0 49 0
[pid=7322] ppid=7321 vsize=38276 CPUtime=1.48
/proc/7322/stat : 7322 (SatElite) R 7321 7321 5687 0 -1 4194304 19379 0 0 0 138 10 0 0 25 0 1 0 388547757 39194624 8175 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134543844 0 0 4096 3 0 0 0 17 1 0 0
/proc/7322/statm: 9569 8175 69 128 0 9438 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 43628

[startup+3.10164 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7323
/proc/meminfo: memFree=1316152/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 2.42
Current children cumulated vsize (KiB) 5352

[startup+6.30119 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1316728/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=33176 CPUtime=3.85
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 7352 0 0 0 381 4 0 0 25 0 1 0 388548000 33972224 7219 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 8294 7219 48 128 0 8163 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 38528

[startup+12.7013 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1313472/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=36368 CPUtime=10.25
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 8112 0 0 0 1021 4 0 0 25 0 1 0 388548000 37240832 7979 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553849 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 9092 7979 48 128 0 8961 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 41720

[startup+25.5015 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1303872/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=46056 CPUtime=23.05
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 10511 0 0 0 2299 6 0 0 25 0 1 0 388548000 47161344 10378 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134558206 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 11514 10378 48 128 0 11383 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 51408

[startup+51.1019 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1280512/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=70848 CPUtime=48.64
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 16420 0 0 0 4854 10 0 0 25 0 1 0 388548000 72548352 16287 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 17712 16287 48 128 0 17581 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 76200

[startup+102.307 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1256768/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=94128 CPUtime=99.83
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 22701 0 0 0 9969 14 0 0 25 0 1 0 388548000 96387072 22090 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553911 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 23532 22090 48 128 0 23401 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 99480

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1216896/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=137724 CPUtime=159.81
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 33218 0 0 0 15961 20 0 0 25 0 1 0 388548000 141029376 32027 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134557462 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 34431 32027 48 128 0 34300 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 143076

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1193920/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=162124 CPUtime=219.78
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 39045 0 0 0 21955 23 0 0 25 0 1 0 388548000 166014976 37854 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 40531 37854 48 128 0 40400 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 167476

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1181504/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=173628 CPUtime=279.76
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 42685 0 0 0 27951 25 0 0 25 0 1 0 388548000 177795072 40856 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134555572 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 43407 40856 48 128 0 43276 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 178980

[startup+342.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7325
/proc/meminfo: memFree=1162048/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=193048 CPUtime=339.74
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 48232 0 0 0 33946 28 0 0 25 0 1 0 388548000 197681152 45705 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 48262 45705 48 128 0 48131 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 198400


################
# More data... #
################

[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=199512 CPUtime=519.69
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 50041 0 0 0 51939 30 0 0 25 0 1 0 388548000 204300288 46815 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134554217 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 49878 46815 48 128 0 49747 0
Current children cumulated CPU time (s) 522.11
Current children cumulated vsize (KiB) 204864

[startup+582.302 s]
/proc/loadavg: 1.07 1.03 1.00 2/85 7481
/proc/meminfo: memFree=1135176/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=220884 CPUtime=579.59
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 56126 0 0 0 57924 35 0 0 25 0 1 0 388548000 226185216 52098 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 55221 52098 48 128 0 55090 0
Current children cumulated CPU time (s) 582.01
Current children cumulated vsize (KiB) 226236

[startup+642.301 s]
/proc/loadavg: 1.30 1.10 1.02 2/79 7523
/proc/meminfo: memFree=1111168/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=247112 CPUtime=639.55
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 62423 0 0 0 63913 42 0 0 25 0 1 0 388548000 253042688 58395 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 61778 58395 48 128 0 61647 0
Current children cumulated CPU time (s) 641.97
Current children cumulated vsize (KiB) 252464

[startup+702.302 s]
/proc/loadavg: 1.15 1.09 1.02 2/79 7523
/proc/meminfo: memFree=1058560/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=301308 CPUtime=699.53
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 75624 0 0 0 69897 56 0 0 25 0 1 0 388548000 308539392 71596 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134554090 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 75327 71596 48 128 0 75196 0
Current children cumulated CPU time (s) 701.95
Current children cumulated vsize (KiB) 306660

[startup+762.307 s]
/proc/loadavg: 1.05 1.07 1.02 2/79 7523
/proc/meminfo: memFree=1027648/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=332036 CPUtime=759.51
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 83270 0 0 0 75888 63 0 0 25 0 1 0 388548000 340004864 79242 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553913 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83009 79242 48 128 0 82878 0
Current children cumulated CPU time (s) 761.93
Current children cumulated vsize (KiB) 337388

[startup+822.301 s]
/proc/loadavg: 1.02 1.06 1.01 2/79 7523
/proc/meminfo: memFree=1023232/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=336288 CPUtime=819.49
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 85111 0 0 0 81884 65 0 0 25 0 1 0 388548000 344358912 80282 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 84072 80282 48 128 0 83941 0
Current children cumulated CPU time (s) 821.91
Current children cumulated vsize (KiB) 341640

[startup+882.302 s]
/proc/loadavg: 1.00 1.04 1.01 2/79 7523
/proc/meminfo: memFree=1023424/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=336288 CPUtime=879.47
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 85119 0 0 0 87881 66 0 0 25 0 1 0 388548000 344358912 80290 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134554217 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 84072 80290 48 128 0 83941 0
Current children cumulated CPU time (s) 881.89
Current children cumulated vsize (KiB) 341640

[startup+942.302 s]
/proc/loadavg: 1.00 1.03 1.00 2/79 7523
/proc/meminfo: memFree=1023808/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=335192 CPUtime=939.45
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 86121 0 0 0 93878 67 0 0 25 0 1 0 388548000 343236608 80170 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553987 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83798 80170 48 128 0 83667 0
Current children cumulated CPU time (s) 941.87
Current children cumulated vsize (KiB) 340544

[startup+1002.3 s]
/proc/loadavg: 1.00 1.02 1.00 2/79 7523
/proc/meminfo: memFree=1023872/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=335192 CPUtime=999.43
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 86130 0 0 0 99875 68 0 0 25 0 1 0 388548000 343236608 80179 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134558213 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83798 80179 48 128 0 83667 0
Current children cumulated CPU time (s) 1001.85
Current children cumulated vsize (KiB) 340544

[startup+1062.3 s]
/proc/loadavg: 1.00 1.02 1.00 2/79 7523
/proc/meminfo: memFree=1023872/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=335192 CPUtime=1059.42
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 86133 0 0 0 105873 69 0 0 25 0 1 0 388548000 343236608 80182 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134554058 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83798 80182 48 128 0 83667 0
Current children cumulated CPU time (s) 1061.84
Current children cumulated vsize (KiB) 340544

[startup+1122.3 s]
/proc/loadavg: 1.00 1.01 1.00 2/79 7523
/proc/meminfo: memFree=1023744/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=335192 CPUtime=1119.39
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 86995 0 0 0 111869 70 0 0 25 0 1 0 388548000 343236608 80194 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134554299 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83798 80194 48 128 0 83667 0
Current children cumulated CPU time (s) 1121.81
Current children cumulated vsize (KiB) 340544

[startup+1182.3 s]
/proc/loadavg: 1.00 1.01 1.00 2/79 7523
/proc/meminfo: memFree=1023744/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=335192 CPUtime=1179.37
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 86997 0 0 0 117867 70 0 0 25 0 1 0 388548000 343236608 80196 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134553866 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 83798 80196 48 128 0 83667 0
Current children cumulated CPU time (s) 1181.79
Current children cumulated vsize (KiB) 340544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 7523
/proc/meminfo: memFree=995840/2055920 swapFree=4152672/4192956
[pid=7321] ppid=7319 vsize=5352 CPUtime=2.42
/proc/7321/stat : 7321 (rsat.sh) S 7319 7321 5687 0 -1 4194304 327 34954 0 0 0 0 222 20 16 0 1 0 388547757 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 240472613700 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/7321/statm: 1338 234 195 169 0 49 0
[pid=7325] ppid=7321 vsize=364164 CPUtime=1197.67
/proc/7325/stat : 7325 (SatElite) R 7321 7321 5687 0 -1 4194304 93985 0 0 0 119693 74 0 0 25 0 1 0 388548000 372903936 87184 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134538538 0 0 4096 3 0 0 0 17 1 0 0
/proc/7325/statm: 91041 87184 48 128 0 90910 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 369516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 7321 and gives childrusage.ru_utime.tv_sec=2 childrusage.ru_utime.tv_usec=228661 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=201969
CPU time returned by wait4() is 2.43063
while last known CPU time is 1200.09

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.61
CPU time (s): 1200.09
CPU user time (s): 1199.15
CPU system time (s): 0.94
CPU usage (%): 99.9565
Max. virtual memory (cumulated for all children) (KiB): 369516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.22866
system time used= 0.201969
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35281
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 7

runsolver used 1.3038 second user time and 3.08053 second system time

The end

Launcher Data (download as text)

Begin job on node15 on Mon Mar 12 07:52:14 UTC 2007

IDJOB= 338440
IDBENCH= 24723
IDSOLVER= 104
FILE ID= node15/338440-1173685933

PBS_JOBID= 4101473

Free space on /tmp= 66526 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/crafted/Difficult/contest05/sabharwal/grid-pebbling-sat-grid-pbl-0300.sat05-1341.sat05-1341.reshuffled-07.cnf
COMMAND LINE= /tmp/evaluation/338440-1173685933/rsat.sh /tmp/evaluation/338440-1173685933/instance-338440-1173685933.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node15/watcher-338440-1173685933 -o ROOT/results/node15/solver-338440-1173685933 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/338440-1173685933/rsat.sh /tmp/evaluation/338440-1173685933/instance-338440-1173685933.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  e899c85929b7de69ebfb14f0dad93191

RANDOM SEED= 882826579

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node15.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1349984 kB
Buffers:         58148 kB
Cached:         552356 kB
SwapCached:       2924 kB
Active:         408040 kB
Inactive:       225748 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1349984 kB
SwapTotal:     4192956 kB
SwapFree:      4152672 kB
Dirty:            6512 kB
Writeback:           0 kB
Mapped:          30204 kB
Slab:            57600 kB
Committed_AS:  1394988 kB
PageTables:       1800 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66523 MiB

End job on node15 on Mon Mar 12 08:12:16 UTC 2007