A simpler analysis of Burrows–Wheeler-based compression
In this paper, we present a new technique for worst-case analysis of compression algorithms which are based on the Burrows–Wheeler Transform. We mainly deal with the algorithm proposed by Burrows and Wheeler in their first paper on the subject [M. Burrows, D.J. Wheeler, A block sorting lossless data...
Uloženo v:
| Vydáno v: | Theoretical computer science Ročník 387; číslo 3; s. 220 - 235 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
Elsevier B.V
22.11.2007
|
| Témata: | |
| ISSN: | 0304-3975, 1879-2294 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Shrnutí: | In this paper, we present a new technique for worst-case analysis of compression algorithms which are based on the Burrows–Wheeler Transform. We mainly deal with the algorithm proposed by Burrows and Wheeler in their first paper on the subject [M. Burrows, D.J. Wheeler, A block sorting lossless data compression algorithm, Technical Report 124, Digital Equipment Corporation, Palo Alto, California, 1994], called
bw0. This algorithm consists of the following three essential steps: (1) Obtain the Burrows–Wheeler Transform of the text, (2) Convert the transform into a sequence of integers using the move-to-front algorithm, (3) Encode the integers using Arithmetic code or any order-0 encoding (possibly with run-length encoding).
We achieve a strong upper bound on the worst-case compression ratio of this algorithm. This bound is significantly better than bounds known to date and is obtained via simple analytical techniques. Specifically, we show that for any input string
s
, and
μ
>
1
, the length of the compressed string is bounded by
μ
⋅
|
s
|
H
k
(
s
)
+
log
(
ζ
(
μ
)
)
⋅
|
s
|
+
μ
g
k
+
O
(
log
n
)
where
H
k
is the
k
th order empirical entropy,
g
k
is a constant depending only on
k
and on the size of the alphabet, and
ζ
(
μ
)
=
1
1
μ
+
1
2
μ
+
⋯
is the standard zeta function. As part of the analysis, we prove a result on the compressibility of integer sequences, which is of independent interest.
Finally, we apply our techniques to prove a worst-case bound on the compression ratio of a compression algorithm based on the Burrows–Wheeler Transform followed by distance coding, for which worst-case guarantees have never been given. We prove that the length of the compressed string is bounded by
1.7286
⋅
|
s
|
H
k
(
s
)
+
g
k
+
O
(
log
n
)
. This bound is
better than the bound we give for
bw0. |
|---|---|
| ISSN: | 0304-3975 1879-2294 |
| DOI: | 10.1016/j.tcs.2007.07.020 |