Improved Alignment-Based Algorithm for Multilingual Text Compression

Multilingual text compression exploits the existence of the same text in several languages to compress the second and subsequent copies by reference to the first. This is done based on bilingual text alignment, a mapping of words and phrases in one text to their semantic equivalents in the translati...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Mathematics in computer science Ročník 7; číslo 2; s. 137 - 153
Hlavní autoři: Conley, Ehud S., Klein, Shmuel T.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Basel Springer Basel 01.06.2013
Témata:
Computer Science
Mathematics
Mathematics and Statistics
Text compression
Bilingual compression
94A29
68P30
Parallel texts
Text alignment
Multilingual compression
ISSN:1661-8270, 1661-8289
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Multilingual text compression exploits the existence of the same text in several languages to compress the second and subsequent copies by reference to the first. This is done based on bilingual text alignment, a mapping of words and phrases in one text to their semantic equivalents in the translation. A new multilingual text compression scheme is suggested, which improves over an immediate generalization of bilingual algorithms. The idea is to store the necessary markup data within the source language text; the incurred compression loss due to this overhead is smaller than the savings in the compressed target language texts, for a large enough number of the latter. Experimental results are presented for a parallel corpus in six languages extracted from the EUR-Lex website of the European Union. These results show the superiority of the new algorithm as a function of the number of languages.
ISSN:1661-8270
1661-8289
DOI:10.1007/s11786-012-0138-1