Trace number 314820

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.06 1200.41

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-03.cnf
MD5SUM8c67f78ca36ec96e662a91c74844da21
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1174.88
Satisfiable
(Un)Satisfiability was proved
Number of variables3114
Number of clauses10827
Sum of the clauses size28341
Maximum clause length119
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 24934
Number of clauses of size 35378
Number of clauses of size 4408
Number of clauses of size 584
Number of clauses of size over 522

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.01	c ==============================================================================
0.00/0.01	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.01	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.01	c ==============================================================================
0.00/0.01	c |         0 |   10580    27785 |    3173       0        0     nan |  0.000 % |
0.06/0.07	c |         0 |    7470    25292 |      --       0       --      -- |     --   | -3110/-2493
0.06/0.07	c ==============================================================================
0.06/0.07	c Result  :   #vars: 1304   #clauses: 7470   #literals: 25292
0.06/0.07	c CPU time:   0.065989 s
0.06/0.07	c ==============================================================================
0.06/0.09	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node67/watcher-314820-1172643118 -o ROOT/results/node67/solver-314820-1172643118 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/314820-1172643118/rsat.sh /tmp/evaluation/314820-1172643118/instance-314820-1172643118.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.97 3/64 2451
/proc/meminfo: memFree=1089504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0
/proc/2451/stat : 2451 (rsat.sh) R 2449 2451 1249 0 -1 4194304 265 0 0 0 0 0 0 0 18 0 1 0 284269416 5480448 232 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638391455 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/2451/statm: 1338 232 194 169 0 49 0
[pid=2452] ppid=2451 vsize=1172 CPUtime=0
/proc/2452/stat : 2452 (SatElite) R 2451 2451 1249 0 -1 4194304 186 0 0 0 0 0 0 0 18 0 1 0 284269417 1200128 168 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/2452/statm: 293 168 50 128 0 162 0

[startup+0.0705529 s]
/proc/loadavg: 0.91 0.95 0.97 3/64 2451
/proc/meminfo: memFree=1089504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 284269416 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 233 195 169 0 49 0
[pid=2452] ppid=2451 vsize=2796 CPUtime=0.06
/proc/2452/stat : 2452 (SatElite) R 2451 2451 1249 0 -1 4194304 590 0 0 0 6 0 0 0 19 0 1 0 284269417 2863104 571 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134562506 0 0 4096 3 0 0 0 17 1 0 0
/proc/2452/statm: 699 571 69 128 0 568 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 8148

[startup+0.102556 s]
/proc/loadavg: 0.91 0.95 0.97 3/64 2451
/proc/meminfo: memFree=1089504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5352

[startup+0.302576 s]
/proc/loadavg: 0.91 0.95 0.97 3/64 2451
/proc/meminfo: memFree=1089504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5352

[startup+0.701618 s]
/proc/loadavg: 0.91 0.95 0.97 3/64 2451
/proc/meminfo: memFree=1089504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5352

[startup+1.5017 s]
/proc/loadavg: 0.91 0.95 0.97 2/66 2454
/proc/meminfo: memFree=1098512/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=3476 CPUtime=1.4
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 728 0 0 0 140 0 0 0 25 0 1 0 284269425 3559424 698 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529605 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 869 698 86 211 0 655 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 8828

[startup+3.10187 s]
/proc/loadavg: 0.92 0.95 0.97 2/66 2454
/proc/meminfo: memFree=1097424/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=4360 CPUtime=3
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 1090 0 0 0 300 0 0 0 25 0 1 0 284269425 4464640 931 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 1090 931 86 211 0 876 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 9712

[startup+6.3012 s]
/proc/loadavg: 0.92 0.95 0.97 2/66 2454
/proc/meminfo: memFree=1095504/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=6284 CPUtime=6.19
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 1744 0 0 0 619 0 0 0 25 0 1 0 284269425 6434816 1356 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 1571 1357 86 211 0 1357 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 11636

[startup+12.7019 s]
/proc/loadavg: 0.93 0.96 0.97 2/66 2454
/proc/meminfo: memFree=1092952/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=8976 CPUtime=12.6
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 2679 0 0 0 1259 1 0 0 25 0 1 0 284269425 9191424 1997 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522887 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 2244 1997 86 211 0 2030 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 14328

[startup+25.5022 s]
/proc/loadavg: 0.94 0.96 0.97 2/66 2454
/proc/meminfo: memFree=1088088/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=13380 CPUtime=25.39
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 4198 0 0 0 2537 2 0 0 25 0 1 0 284269425 13701120 3128 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522815 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 3345 3128 86 211 0 3131 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 18732

[startup+51.1029 s]
/proc/loadavg: 0.96 0.96 0.97 2/66 2454
/proc/meminfo: memFree=1083608/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=18020 CPUtime=50.99
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 5805 0 0 0 5096 3 0 0 25 0 1 0 284269425 18452480 4153 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 4505 4153 86 211 0 4291 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 23372

[startup+102.305 s]
/proc/loadavg: 0.98 0.96 0.97 2/66 2454
/proc/meminfo: memFree=1078680/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=22624 CPUtime=102.18
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 7819 0 0 0 10214 4 0 0 25 0 1 0 284269425 23166976 5395 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 5656 5395 86 211 0 5442 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 27976

[startup+162.303 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1066648/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=35640 CPUtime=162.16
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 12781 0 0 0 16208 8 0 0 25 0 1 0 284269425 36495360 8387 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523165 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 8910 8387 86 211 0 8696 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 40992

[startup+222.303 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1066648/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=35640 CPUtime=222.14
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 12786 0 0 0 22206 8 0 0 25 0 1 0 284269425 36495360 8392 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 8910 8392 86 211 0 8696 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 40992

[startup+282.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1058200/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=44144 CPUtime=282.13
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 14958 0 0 0 28202 11 0 0 25 0 1 0 284269425 45203456 10564 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 11036 10564 86 211 0 10822 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 49496

[startup+342.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1048344/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=53604 CPUtime=342.11
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 17404 0 0 0 34198 13 0 0 25 0 1 0 284269425 54890496 13010 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 13401 13010 86 211 0 13187 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 58956

[startup+402.303 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1048280/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0

################
# More data... #
################

[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=53948 CPUtime=522.06
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 19195 0 0 0 52192 14 0 0 25 0 1 0 284269425 55242752 13125 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 13487 13125 86 211 0 13273 0
Current children cumulated CPU time (s) 522.13
Current children cumulated vsize (KiB) 59300

[startup+582.301 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1042136/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=59492 CPUtime=582.05
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 20658 0 0 0 58189 16 0 0 25 0 1 0 284269425 60919808 14555 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 14873 14555 86 211 0 14659 0
Current children cumulated CPU time (s) 582.12
Current children cumulated vsize (KiB) 64844

[startup+642.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1035096/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=69492 CPUtime=642.04
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 23198 0 0 0 64185 19 0 0 25 0 1 0 284269425 71159808 16292 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 17373 16292 86 211 0 17159 0
Current children cumulated CPU time (s) 642.11
Current children cumulated vsize (KiB) 74844

[startup+702.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1028440/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=76256 CPUtime=702.02
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 24937 0 0 0 70181 21 0 0 25 0 1 0 284269425 78086144 17965 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522830 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 19064 17965 86 211 0 18850 0
Current children cumulated CPU time (s) 702.09
Current children cumulated vsize (KiB) 81608

[startup+762.305 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1022104/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=82608 CPUtime=762.01
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 26650 0 0 0 76178 23 0 0 25 0 1 0 284269425 84590592 19514 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 20652 19514 86 211 0 20438 0
Current children cumulated CPU time (s) 762.08
Current children cumulated vsize (KiB) 87960

[startup+822.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023640/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=79648 CPUtime=821.99
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 29922 0 0 0 82174 25 0 0 25 0 1 0 284269425 81559552 19081 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 19912 19081 86 211 0 19698 0
Current children cumulated CPU time (s) 822.06
Current children cumulated vsize (KiB) 85000

[startup+882.302 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023640/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=79648 CPUtime=881.97
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 29926 0 0 0 88172 25 0 0 25 0 1 0 284269425 81559552 19085 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 19912 19085 86 211 0 19698 0
Current children cumulated CPU time (s) 882.04
Current children cumulated vsize (KiB) 85000

[startup+942.301 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023640/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=79648 CPUtime=941.96
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 29926 0 0 0 94171 25 0 0 25 0 1 0 284269425 81559552 19085 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 19912 19085 86 211 0 19698 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 85000

[startup+1002.3 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023576/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=79780 CPUtime=1001.94
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 29954 0 0 0 100169 25 0 0 25 0 1 0 284269425 81694720 19113 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 19945 19113 86 211 0 19731 0
Current children cumulated CPU time (s) 1002.01
Current children cumulated vsize (KiB) 85132

[startup+1062.3 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023384/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=80172 CPUtime=1061.92
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 30011 0 0 0 106167 25 0 0 25 0 1 0 284269425 82096128 19170 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 20043 19170 86 211 0 19829 0
Current children cumulated CPU time (s) 1061.99
Current children cumulated vsize (KiB) 85524

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1023384/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=80172 CPUtime=1121.92
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 30015 0 0 0 112166 26 0 0 25 0 1 0 284269425 82096128 19174 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 20043 19174 86 211 0 19829 0
Current children cumulated CPU time (s) 1121.99
Current children cumulated vsize (KiB) 85524

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1021976/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=81580 CPUtime=1181.89
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 30379 0 0 0 118163 26 0 0 25 0 1 0 284269425 83537920 19538 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 20395 19538 86 211 0 20181 0
Current children cumulated CPU time (s) 1181.96
Current children cumulated vsize (KiB) 86932



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.4 s]
/proc/loadavg: 0.99 0.97 0.97 2/66 2454
/proc/meminfo: memFree=1019864/2055920 swapFree=4178840/4192956
[pid=2451] ppid=2449 vsize=5352 CPUtime=0.07
/proc/2451/stat : 2451 (rsat.sh) S 2449 2451 1249 0 -1 4194304 306 593 0 0 0 0 7 0 15 0 1 0 284269416 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 271638389572 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/2451/statm: 1338 234 195 169 0 49 0
[pid=2454] ppid=2451 vsize=83656 CPUtime=1199.99
/proc/2454/stat : 2454 (rsat) R 2451 2451 1249 0 -1 4194304 30887 0 0 0 119973 26 0 0 25 0 1 0 284269425 85663744 20046 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/2454/statm: 20914 20046 86 211 0 20700 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 89008

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 2451 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=77988 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=10998
CPU time returned by wait4() is 0.088986
while last known CPU time is 1200.06

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.41
CPU time (s): 1200.06
CPU user time (s): 1199.8
CPU system time (s): 0.26
CPU usage (%): 99.9706
Max. virtual memory (cumulated for all children) (KiB): 100832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.077988
system time used= 0.010998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 899
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 2

runsolver used 0.996848 second user time and 2.50662 second system time

The end

Launcher Data (download as text)

Begin job on node67 on Wed Feb 28 06:11:58 UTC 2007

IDJOB= 314820
IDBENCH= 20401
IDSOLVER= 104
FILE ID= node67/314820-1172643118

PBS_JOBID= 3981158

Free space on /tmp= 66534 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/fuhs/hard/AProVE07-03.cnf
COMMAND LINE= /tmp/evaluation/314820-1172643118/rsat.sh /tmp/evaluation/314820-1172643118/instance-314820-1172643118.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node67/watcher-314820-1172643118 -o ROOT/results/node67/solver-314820-1172643118 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/314820-1172643118/rsat.sh /tmp/evaluation/314820-1172643118/instance-314820-1172643118.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  8c67f78ca36ec96e662a91c74844da21

RANDOM SEED= 191842699

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node67.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1089848 kB
Buffers:         27240 kB
Cached:         810320 kB
SwapCached:       8292 kB
Active:         309144 kB
Inactive:       614748 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1089848 kB
SwapTotal:     4192956 kB
SwapFree:      4178840 kB
Dirty:            1836 kB
Writeback:           0 kB
Mapped:          86868 kB
Slab:            27956 kB
Committed_AS:   870728 kB
PageTables:       1624 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66545 MiB

End job on node67 on Wed Feb 28 06:32:00 UTC 2007