Trace number 305654

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.03 1200.47

General information on the benchmark

Namerandom/LargeSize/3SAT/v4000/
unif-k3-r4.2-v4000-c16800-S251010207-06.cnf
MD5SUM91dc612395480e1b0d1bd4361bc37ee8
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark58.3301
Satisfiable
(Un)Satisfiability was proved
Number of variables4000
Number of clauses16800
Sum of the clauses size50400
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 316800
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.01	c Parsing...
0.00/0.02	c ==============================================================================
0.00/0.02	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.02	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.02	c ==============================================================================
0.00/0.02	c |         0 |   16800    50400 |    5039       0        0     nan |  0.000 % |
0.00/0.06	c |         0 |   16696    50649 |      --       0       --      -- |     --   | -104/249
0.00/0.06	c ==============================================================================
0.00/0.06	c Result  :   #vars: 3911   #clauses: 16696   #literals: 50649
0.00/0.06	c CPU time:   0.048992 s
0.00/0.06	c ==============================================================================
0.00/0.09	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node69/watcher-305654-1172083171 -o ROOT/results/node69/solver-305654-1172083171 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/305654-1172083171/rsat.sh /tmp/evaluation/305654-1172083171/instance-305654-1172083171.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.85 0.97 0.99 3/64 22388
/proc/meminfo: memFree=1942960/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 228274804 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/22388/statm: 1338 232 195 169 0 49 0
[pid=22389] ppid=22388 vsize=684 CPUtime=0
/proc/22389/stat : 22389 (SatElite) D 22388 22388 22325 0 -1 4194304 62 0 0 0 0 0 0 0 18 0 1 0 228274804 700416 44 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699069 0 0 4096 3 18446744071563608240 0 0 17 1 0 0
/proc/22389/statm: 171 44 36 128 0 40 0

[startup+0.106963 s]
/proc/loadavg: 0.85 0.97 0.99 3/64 22388
/proc/meminfo: memFree=1942960/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 5352

[startup+0.51503 s]
/proc/loadavg: 0.85 0.97 0.99 3/64 22388
/proc/meminfo: memFree=1942960/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 5352

[startup+1.33516 s]
/proc/loadavg: 0.85 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1937888/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=5772 CPUtime=1.22
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 1321 0 0 0 122 0 0 0 25 0 1 0 228274814 5910528 1290 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 1443 1290 86 211 0 1229 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 11124

[startup+2.97744 s]
/proc/loadavg: 0.86 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1935968/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=7684 CPUtime=2.87
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 1861 0 0 0 286 1 0 0 25 0 1 0 228274814 7868416 1766 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 1921 1766 86 211 0 1707 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 13036

[startup+6.25397 s]
/proc/loadavg: 0.86 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1932576/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=11576 CPUtime=6.14
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 2889 0 0 0 613 1 0 0 25 0 1 0 228274814 11853824 2729 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 2894 2729 86 211 0 2680 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 16928

[startup+12.713 s]
/proc/loadavg: 0.88 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1922792/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=20160 CPUtime=12.6
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 5423 0 0 0 1257 3 0 0 25 0 1 0 228274814 20643840 4871 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 5040 4871 86 211 0 4826 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 25512

[startup+25.5241 s]
/proc/loadavg: 0.90 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1913832/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=29376 CPUtime=25.41
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 8134 0 0 0 2536 5 0 0 25 0 1 0 228274814 30081024 7096 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523307 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 7344 7096 86 211 0 7130 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 34728

[startup+51.1463 s]
/proc/loadavg: 0.93 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1899752/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=43072 CPUtime=51.02
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 12033 0 0 0 5095 7 0 0 25 0 1 0 228274814 44105728 10607 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 10768 10607 86 211 0 10554 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 48424

[startup+102.392 s]
/proc/loadavg: 0.97 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1876712/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=66500 CPUtime=102.25
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 18754 0 0 0 10213 12 0 0 25 0 1 0 228274814 68096000 16362 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 16625 16362 86 211 0 16411 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 71852

[startup+162.459 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 22391
/proc/meminfo: memFree=1846696/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=97384 CPUtime=162.3
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 28152 0 0 0 16210 20 0 0 25 0 1 0 228274814 99721216 23834 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 24346 23834 86 211 0 24132 0
Current children cumulated CPU time (s) 162.36
Current children cumulated vsize (KiB) 102736

[startup+222.513 s]
/proc/loadavg: 1.04 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1829480/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=114716 CPUtime=222.34
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 32545 0 0 0 22210 24 0 0 25 0 1 0 228274814 117469184 28227 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 28679 28227 86 211 0 28465 0
Current children cumulated CPU time (s) 222.4
Current children cumulated vsize (KiB) 120068

[startup+282.569 s]
/proc/loadavg: 1.01 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1799144/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=144008 CPUtime=282.37
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 41532 0 0 0 28204 33 0 0 25 0 1 0 228274814 147464192 35674 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 36002 35674 86 211 0 35788 0
Current children cumulated CPU time (s) 282.43
Current children cumulated vsize (KiB) 149360

[startup+342.619 s]
/proc/loadavg: 1.00 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1799144/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=144008 CPUtime=342.4
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 41536 0 0 0 34207 33 0 0 25 0 1 0 228274814 147464192 35678 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530136 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 36002 35678 86 211 0 35788 0
Current children cumulated CPU time (s) 342.46
Current children cumulated vsize (KiB) 149360

[startup+402.681 s]
/proc/loadavg: 1.00 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1792936/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=150152 CPUtime=402.45
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 43153 0 0 0 40210 35 0 0 25 0 1 0 228274814 153755648 37295 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523304 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 37538 37295 86 211 0 37324 0
Current children cumulated CPU time (s) 402.51
Current children cumulated vsize (KiB) 155504

[startup+462.745 s]
/proc/loadavg: 1.00 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1754280/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=191368 CPUtime=462.49
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 53634 0 0 0 46202 47 0 0 25 0 1 0 228274814 195960832 47006 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522826 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 47842 47006 86 211 0 47628 0
Current children cumulated CPU time (s) 462.55
Current children cumulated vsize (KiB) 196720

[startup+522.804 s]
/proc/loadavg: 1.00 0.99 0.99 2/66 22391
/proc/meminfo: memFree=1738408/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=206356 CPUtime=522.53
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 60539 0 0 0 52201 52 0 0 25 0 1 0 228274814 211308544 50835 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 51589 50835 86 211 0 51375 0
Current children cumulated CPU time (s) 522.59
Current children cumulated vsize (KiB) 211708

[startup+582.866 s]
/proc/loadavg: 1.06 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1738408/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=206356 CPUtime=582.58
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 60539 0 0 0 58206 52 0 0 25 0 1 0 228274814 211308544 50835 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 51589 50835 86 211 0 51375 0
Current children cumulated CPU time (s) 582.64
Current children cumulated vsize (KiB) 211708

[startup+642.928 s]
/proc/loadavg: 1.02 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1738472/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=206356 CPUtime=642.62
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 60539 0 0 0 64210 52 0 0 25 0 1 0 228274814 211308544 50835 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 51589 50835 86 211 0 51375 0
Current children cumulated CPU time (s) 642.68
Current children cumulated vsize (KiB) 211708

[startup+702.979 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1738472/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=206356 CPUtime=702.65
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 60539 0 0 0 70213 52 0 0 25 0 1 0 228274814 211308544 50835 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 51589 50835 86 211 0 51375 0
Current children cumulated CPU time (s) 702.71
Current children cumulated vsize (KiB) 211708

[startup+763.036 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1732392/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=212896 CPUtime=762.69
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 62128 0 0 0 76215 54 0 0 25 0 1 0 228274814 218005504 52424 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 53224 52424 86 211 0 53010 0
Current children cumulated CPU time (s) 762.75
Current children cumulated vsize (KiB) 218248

[startup+823.098 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1711272/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=233636 CPUtime=822.73
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 67334 0 0 0 82214 59 0 0 25 0 1 0 228274814 239243264 57630 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 58409 57630 86 211 0 58195 0
Current children cumulated CPU time (s) 822.79
Current children cumulated vsize (KiB) 238988

[startup+883.155 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1681512/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=263112 CPUtime=882.76
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 74810 0 0 0 88209 67 0 0 25 0 1 0 228274814 269426688 65106 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 65778 65106 86 211 0 65564 0
Current children cumulated CPU time (s) 882.82
Current children cumulated vsize (KiB) 268464

[startup+943.215 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1653864/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=290316 CPUtime=942.81
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 81742 0 0 0 94205 76 0 0 25 0 1 0 228274814 297283584 72038 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 72579 72038 86 211 0 72365 0
Current children cumulated CPU time (s) 942.87
Current children cumulated vsize (KiB) 295668

[startup+1003.27 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1628648/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=314920 CPUtime=1002.85
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 88020 0 0 0 100203 82 0 0 25 0 1 0 228274814 322478080 78316 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523307 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 78730 78316 86 211 0 78516 0
Current children cumulated CPU time (s) 1002.91
Current children cumulated vsize (KiB) 320272

[startup+1063.34 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1615144/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=327468 CPUtime=1062.89
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 94353 0 0 0 106201 88 0 0 25 0 1 0 228274814 335327232 81539 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522879 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 81867 81539 86 211 0 81653 0
Current children cumulated CPU time (s) 1062.95
Current children cumulated vsize (KiB) 332820

[startup+1123.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1615208/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=327468 CPUtime=1122.93
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 94359 0 0 0 112205 88 0 0 25 0 1 0 228274814 335327232 81545 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530122 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 81867 81545 86 211 0 81653 0
Current children cumulated CPU time (s) 1122.99
Current children cumulated vsize (KiB) 332820

[startup+1183.45 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1615208/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=327468 CPUtime=1182.96
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 94360 0 0 0 118208 88 0 0 25 0 1 0 228274814 335327232 81546 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 81867 81546 86 211 0 81653 0
Current children cumulated CPU time (s) 1183.02
Current children cumulated vsize (KiB) 332820



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.46 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 22391
/proc/meminfo: memFree=1615208/2055920 swapFree=4183360/4192956
[pid=22388] ppid=22386 vsize=5352 CPUtime=0.06
/proc/22388/stat : 22388 (rsat.sh) S 22386 22388 22325 0 -1 4194304 305 587 0 0 0 0 6 0 16 0 1 0 228274804 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22388/statm: 1338 234 195 169 0 49 0
[pid=22391] ppid=22388 vsize=327468 CPUtime=1199.97
/proc/22391/stat : 22391 (rsat) R 22388 22388 22325 0 -1 4194304 94360 0 0 0 119909 88 0 0 25 0 1 0 228274814 335327232 81546 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/22391/statm: 81867 81546 86 211 0 81653 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 332820

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 22388 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=71989 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=6998
CPU time returned by wait4() is 0.078987
while last known CPU time is 1200.03

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.47
CPU time (s): 1200.03
CPU user time (s): 1199.15
CPU system time (s): 0.88
CPU usage (%): 99.9634
Max. virtual memory (cumulated for all children) (KiB): 345264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.071989
system time used= 0.006998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 892
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 4

runsolver used 0.901862 second user time and 2.40163 second system time

The end

Launcher Data (download as text)

Begin job on node69 on Wed Feb 21 18:39:31 UTC 2007

IDJOB= 305654
IDBENCH= 20162
IDSOLVER= 104
FILE ID= node69/305654-1172083171

PBS_JOBID= 3892856

Free space on /tmp= 66561 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/3SAT/v4000/unif-k3-r4.2-v4000-c16800-S251010207-06.cnf
COMMAND LINE= /tmp/evaluation/305654-1172083171/rsat.sh /tmp/evaluation/305654-1172083171/instance-305654-1172083171.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node69/watcher-305654-1172083171 -o ROOT/results/node69/solver-305654-1172083171 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/305654-1172083171/rsat.sh /tmp/evaluation/305654-1172083171/instance-305654-1172083171.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  91dc612395480e1b0d1bd4361bc37ee8

RANDOM SEED= 801194794

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node69.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1943368 kB
Buffers:          5288 kB
Cached:          52936 kB
SwapCached:       3928 kB
Active:          31208 kB
Inactive:        36668 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1943368 kB
SwapTotal:     4192956 kB
SwapFree:      4183360 kB
Dirty:            2148 kB
Writeback:           0 kB
Mapped:          15304 kB
Slab:            30652 kB
Committed_AS:   658048 kB
PageTables:       1472 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node69 on Wed Feb 21 18:59:33 UTC 2007