Trace number 339532

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.08 1200.51

General information on the benchmark

Namecrafted/Difficult/contest-02-03-04/
contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf
MD5SUMbe0552b4894b69c578ebcc0b17dda689
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark210.366
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of clauses69990
Sum of the clauses size140820
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 269960
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data (download as text)

0.00/0.00	c Parsing...
0.01/0.05	c ==============================================================================
0.01/0.05	c |           |     ORIGINAL     |              LEARNT              |          |
0.01/0.05	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.01/0.05	c ==============================================================================
0.01/0.05	c |         0 |   69990   140820 |   20996       0        0     nan |  0.000 % |
1.09/1.17	c |         0 |   69090   217938 |      --       0       --      -- |     --   | -900/77118
1.09/1.17	c ==============================================================================
1.09/1.17	c Result  :   #vars: 870   #clauses: 69090   #literals: 217938
1.09/1.17	c CPU time:   1.16282 s
1.09/1.17	c ==============================================================================
1.18/1.26	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node12/watcher-339532-1173706655 -o ROOT/results/node12/solver-339532-1173706655 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/339532-1173706655/rsat.sh /tmp/evaluation/339532-1173706655/instance-339532-1173706655.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 14153
/proc/meminfo: memFree=1487536/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=0
/proc/14153/stat : 14153 (rsat.sh) R 14151 14153 11202 0 -1 4194304 264 0 0 0 0 0 0 0 18 0 1 0 390619978 5480448 231 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429527711 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/14153/statm: 1338 231 194 169 0 49 0
[pid=14154] ppid=14153 vsize=820 CPUtime=0
/proc/14154/stat : 14154 (SatElite) R 14153 14153 11202 0 -1 4194304 125 0 0 0 0 0 0 0 18 0 1 0 390619978 839680 107 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/14154/statm: 205 108 49 128 0 74 0

[startup+0.0190171 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 14153
/proc/meminfo: memFree=1487536/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=0
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 390619978 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14153/statm: 1338 232 195 169 0 49 0
[pid=14154] ppid=14153 vsize=1856 CPUtime=0.01
/proc/14154/stat : 14154 (SatElite) R 14153 14153 11202 0 -1 4194304 380 0 0 0 1 0 0 0 19 0 1 0 390619978 1900544 362 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/14154/statm: 464 363 49 128 0 333 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 7208

[startup+0.101033 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 14153
/proc/meminfo: memFree=1487536/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=0
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 390619978 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14153/statm: 1338 232 195 169 0 49 0
[pid=14154] ppid=14153 vsize=6516 CPUtime=0.09
/proc/14154/stat : 14154 (SatElite) R 14153 14153 11202 0 -1 4194304 1386 0 0 0 9 0 0 0 19 0 1 0 390619978 6672384 1368 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134703449 0 0 4096 3 0 0 0 17 1 0 0
/proc/14154/statm: 1697 1368 69 128 0 1566 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 11868

[startup+0.301067 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 14153
/proc/meminfo: memFree=1487536/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=0
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 390619978 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14153/statm: 1338 232 195 169 0 49 0
[pid=14154] ppid=14153 vsize=7560 CPUtime=0.29
/proc/14154/stat : 14154 (SatElite) R 14153 14153 11202 0 -1 4194304 1518 0 0 0 29 0 0 0 20 0 1 0 390619978 7741440 1500 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134567871 0 0 4096 3 0 0 0 17 1 0 0
/proc/14154/statm: 1890 1500 69 128 0 1759 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12912

[startup+0.70114 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 14153
/proc/meminfo: memFree=1487536/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=0
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 390619978 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/14153/statm: 1338 232 195 169 0 49 0
[pid=14154] ppid=14153 vsize=7560 CPUtime=0.69
/proc/14154/stat : 14154 (SatElite) R 14153 14153 11202 0 -1 4194304 1518 0 0 0 69 0 0 0 24 0 1 0 390619978 7741440 1500 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134574781 0 0 4096 3 0 0 0 17 1 0 0
/proc/14154/statm: 1890 1500 69 128 0 1759 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 12912

[startup+1.50129 s]
/proc/loadavg: 0.91 0.98 0.99 2/79 14155
/proc/meminfo: memFree=1482464/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 5352

[startup+3.10257 s]
/proc/loadavg: 0.91 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1486560/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=9548 CPUtime=1.82
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 2215 0 0 0 182 0 0 0 25 0 1 0 390620104 9777152 2201 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 2387 2201 86 211 0 2173 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 14900

[startup+6.30115 s]
/proc/loadavg: 0.92 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1482336/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=12944 CPUtime=5.02
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 3040 0 0 0 501 1 0 0 25 0 1 0 390620104 13254656 3026 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 3236 3026 86 211 0 3022 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 18296

[startup+12.7013 s]
/proc/loadavg: 0.93 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1479264/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=14880 CPUtime=11.42
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 3730 0 0 0 1141 1 0 0 25 0 1 0 390620104 15237120 3520 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 3720 3520 86 211 0 3506 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 20232

[startup+25.5016 s]
/proc/loadavg: 0.94 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1475168/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=19236 CPUtime=24.22
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 5240 0 0 0 2420 2 0 0 25 0 1 0 390620104 19697664 4544 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 4809 4544 86 211 0 4595 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 24588

[startup+51.1012 s]
/proc/loadavg: 0.96 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1466720/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=28044 CPUtime=49.81
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 7459 0 0 0 4976 5 0 0 25 0 1 0 390620104 28717056 6763 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 7011 6763 86 211 0 6797 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 33396

[startup+102.305 s]
/proc/loadavg: 0.98 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1460320/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=33996 CPUtime=100.99
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 9446 0 0 0 10093 6 0 0 25 0 1 0 390620104 34811904 8308 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 8499 8308 86 211 0 8285 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 39348

[startup+162.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1452384/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=42416 CPUtime=160.97
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 12359 0 0 0 16089 8 0 0 25 0 1 0 390620104 43433984 10255 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 10604 10255 86 211 0 10390 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 47768

[startup+222.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1442912/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=52088 CPUtime=220.96
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 14785 0 0 0 22085 11 0 0 25 0 1 0 390620104 53338112 12681 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523251 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 13022 12681 86 211 0 12808 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 57440

[startup+282.303 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1432032/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=63120 CPUtime=280.93
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 17490 0 0 0 28080 13 0 0 25 0 1 0 390620104 64634880 15386 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 15780 15386 86 211 0 15566 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 68472

[startup+342.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14156
/proc/meminfo: memFree=1430240/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=64248 CPUtime=340.91
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 18737 0 0 0 34077 14 0 0 25 0 1 0 390620104 65789952 15782 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523165 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 16062 15782 86 211 0 15848 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 69600


################
# More data... #
################

[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=84052 CPUtime=580.83
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 23539 0 0 0 58063 20 0 0 25 0 1 0 390620104 86069248 20198 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 21013 20198 86 211 0 20799 0
Current children cumulated CPU time (s) 582.08
Current children cumulated vsize (KiB) 89404

[startup+642.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1404768/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=91836 CPUtime=640.82
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 25516 0 0 0 64059 23 0 0 25 0 1 0 390620104 94040064 22142 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 22959 22142 86 211 0 22745 0
Current children cumulated CPU time (s) 642.07
Current children cumulated vsize (KiB) 97188

[startup+702.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1402720/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=92312 CPUtime=700.79
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28226 0 0 0 70054 25 0 0 25 0 1 0 390620104 94527488 22602 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23078 22602 86 211 0 22864 0
Current children cumulated CPU time (s) 702.04
Current children cumulated vsize (KiB) 97664

[startup+762.305 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1402784/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=92312 CPUtime=760.78
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28247 0 0 0 76052 26 0 0 25 0 1 0 390620104 94527488 22623 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23078 22623 86 211 0 22864 0
Current children cumulated CPU time (s) 762.03
Current children cumulated vsize (KiB) 97664

[startup+822.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1402272/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=93368 CPUtime=820.75
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28419 0 0 0 82049 26 0 0 25 0 1 0 390620104 95608832 22795 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23342 22795 86 211 0 23128 0
Current children cumulated CPU time (s) 822
Current children cumulated vsize (KiB) 98720

[startup+882.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1401824/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=94028 CPUtime=880.74
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28522 0 0 0 88047 27 0 0 25 0 1 0 390620104 96284672 22898 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23507 22898 86 211 0 23293 0
Current children cumulated CPU time (s) 881.99
Current children cumulated vsize (KiB) 99380

[startup+942.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1401760/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=93764 CPUtime=940.71
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28579 0 0 0 94044 27 0 0 25 0 1 0 390620104 96014336 22878 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23441 22878 86 211 0 23227 0
Current children cumulated CPU time (s) 941.96
Current children cumulated vsize (KiB) 99116

[startup+1002.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1401312/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=94552 CPUtime=1000.69
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28721 0 0 0 100041 28 0 0 25 0 1 0 390620104 96821248 23020 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23638 23020 86 211 0 23424 0
Current children cumulated CPU time (s) 1001.94
Current children cumulated vsize (KiB) 99904

[startup+1062.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1400736/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=95340 CPUtime=1060.67
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 28897 0 0 0 106039 28 0 0 25 0 1 0 390620104 97628160 23163 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 23835 23163 86 211 0 23621 0
Current children cumulated CPU time (s) 1061.92
Current children cumulated vsize (KiB) 100692

[startup+1122.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1400288/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=96132 CPUtime=1120.65
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 29012 0 0 0 112036 29 0 0 25 0 1 0 390620104 98439168 23278 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 24033 23278 86 211 0 23819 0
Current children cumulated CPU time (s) 1121.9
Current children cumulated vsize (KiB) 101484

[startup+1182.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1399264/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=97568 CPUtime=1180.63
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 29336 0 0 0 118033 30 0 0 25 0 1 0 390620104 99909632 23503 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 24392 23503 86 211 0 24178 0
Current children cumulated CPU time (s) 1181.88
Current children cumulated vsize (KiB) 102920



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1398176/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=99168 CPUtime=1198.83
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 29663 0 0 0 119853 30 0 0 25 0 1 0 390620104 101548032 23797 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 24792 23797 86 211 0 24578 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 104520

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 0.99 0.98 0.99 2/79 14158
/proc/meminfo: memFree=1398176/2055920 swapFree=4156588/4192956
[pid=14153] ppid=14151 vsize=5352 CPUtime=1.25
/proc/14153/stat : 14153 (rsat.sh) S 14151 14153 11202 0 -1 4194304 305 1520 0 0 0 0 124 1 16 0 1 0 390619978 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/14153/statm: 1338 234 195 169 0 49 0
[pid=14156] ppid=14153 vsize=99168 CPUtime=1198.83
/proc/14156/stat : 14156 (rsat) R 14153 14153 11202 0 -1 4194304 29663 0 0 0 119853 30 0 0 25 0 1 0 390620104 101548032 23797 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/14156/statm: 24792 23797 86 211 0 24578 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 104520

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 14153 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=245810 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=14997
CPU time returned by wait4() is 1.26081
while last known CPU time is 1200.08

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.08
CPU user time (s): 1199.77
CPU system time (s): 0.31
CPU usage (%): 99.9639
Max. virtual memory (cumulated for all children) (KiB): 107672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.24581
system time used= 0.014997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1825
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 3

runsolver used 1.22281 second user time and 3.15552 second system time

The end

Launcher Data (download as text)

Begin job on node12 on Mon Mar 12 13:37:35 UTC 2007

IDJOB= 339532
IDBENCH= 24749
IDSOLVER= 104
FILE ID= node12/339532-1173706655

PBS_JOBID= 4101477

Free space on /tmp= 66284 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/crafted/Difficult/contest-02-03-04/contest03-SGI_30_50_30_20_1-dir.sat05-439.reshuffled-07.cnf
COMMAND LINE= /tmp/evaluation/339532-1173706655/rsat.sh /tmp/evaluation/339532-1173706655/instance-339532-1173706655.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node12/watcher-339532-1173706655 -o ROOT/results/node12/solver-339532-1173706655 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/339532-1173706655/rsat.sh /tmp/evaluation/339532-1173706655/instance-339532-1173706655.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  be0552b4894b69c578ebcc0b17dda689

RANDOM SEED= 419079640

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node12.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.285
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.285
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1488008 kB
Buffers:         39824 kB
Cached:         434024 kB
SwapCached:      14596 kB
Active:         295940 kB
Inactive:       200740 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1488008 kB
SwapTotal:     4192956 kB
SwapFree:      4156588 kB
Dirty:            2504 kB
Writeback:           0 kB
Mapped:          29864 kB
Slab:            56864 kB
Committed_AS:  1732772 kB
PageTables:       1692 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66290 MiB

End job on node12 on Mon Mar 12 13:57:38 UTC 2007