Direct Transformation Techniques for Compressed Data: General Approach and Application Scenarios

Saved in:
Bibliographic Details
Title: Direct Transformation Techniques for Compressed Data: General Approach and Application Scenarios
Authors: Damme, Patrick, Habich, Dirk, Lehner, Wolfgang
Publication Status: acceptedVersion
Publisher Information: Springer, 2015.
Publication Year: 2015
Collection: Hochschulschriftenserver (HSSS) der SLUB Dresden
Original Material: urn:nbn:de:bsz:14-qucosa2-836539
Subject Terms: Lightweight data compression, Main memory database systems, Efficient algorithms, Leichte Datenkompression, Hauptspeicher-Datenbank Systeme, Effiziente Algorithmen, info:eu-repo/classification/ddc/004, ddc:004
Description: Lightweight data compression techniques like dictionary or run-length compression play an important role in main memory database systems. Having decided for a compression scheme for a dataset, the transformation to another scheme is very inefficient today. The common approach works as follows: First, the compressed data is decompressed using the source decompression algorithm resulting in the materialization of the raw data in main memory. Second, the compression algorithm of the destination scheme is applied. This indirect way relies on existing algorithms, but is very inefficient, since the whole uncompressed data has to be materialized as an intermediate step. To overcome these drawbacks, we propose a novel approach called direct transformation, which avoids the materialization of the whole uncompressed data. Our techniques are cache optimized to reduce necessary data accesses. Moreover, we present application scenarios, where such direct transformations can be efficiently applied.
Original Identifier: oai:qucosa:de:qucosa:83653
Document Type: Text
Conference Material
Language: English
ISBN: 978-3-319-23134-1
978-3-319-23135-8
Relation: info:eu-repo/grantAgreement/Deutsche Forschungsgemeinschaft/Sachbeihilfen/255187874//Leichtgewichtige Kompressionsverfahren zur Optimierung komplexer Datenbankanfragen/LE-1416/26-1
DOI: 10.1007/978-3-319-23135-8_11
Availability: https://tud.qucosa.de/id/qucosa%3A83653
https://tud.qucosa.de/api/qucosa%3A83653/attachment/ATT-0/
Rights: info:eu-repo/semantics/openAccess
Accession Number: edsndl.DRESDEN.oai.qucosa.de.qucosa.83653
Database: Networked Digital Library of Theses & Dissertations
Description
Abstract:Lightweight data compression techniques like dictionary or run-length compression play an important role in main memory database systems. Having decided for a compression scheme for a dataset, the transformation to another scheme is very inefficient today. The common approach works as follows: First, the compressed data is decompressed using the source decompression algorithm resulting in the materialization of the raw data in main memory. Second, the compression algorithm of the destination scheme is applied. This indirect way relies on existing algorithms, but is very inefficient, since the whole uncompressed data has to be materialized as an intermediate step. To overcome these drawbacks, we propose a novel approach called direct transformation, which avoids the materialization of the whole uncompressed data. Our techniques are cache optimized to reduce necessary data accesses. Moreover, we present application scenarios, where such direct transformations can be efficiently applied.
ISBN:9783319231341
9783319231358
DOI:10.1007/978-3-319-23135-8_11