Cracking in-memory database index: A case study for Adaptive Radix Tree index

Indexes provide a method to access data in databases quickly. It can improve the response speed of subsequent queries by building a complete index in advance. However, it also leads to a huge overhead of the continuous updating during creating the index. An in-memory database usually has a higher qu...

Full description

Saved in:
Bibliographic Details
Published in:Information systems (Oxford) Vol. 104; p. 101913
Main Authors: Wu, Gang, Song, Yidong, Zhao, Guodong, Sun, Wei, Han, Donghong, Qiao, Baiyou, Wang, Guoren, Yuan, Ye
Format: Journal Article
Language:English
Published: Oxford Elsevier Ltd 01.02.2022
Elsevier Science Ltd
Subjects:
Algorithms
Antiretroviral therapy
Case studies
Columnar structure
Data structures
Database cracking
Experiments
Feasibility
In-memory database
Indexes
Information systems
Memory
Performance indices
Queries
Query processing
Reaction time
Response time (computers)
Time
Database cracking
ART
In-memory database
ISSN:0306-4379, 1873-6076
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Indexes provide a method to access data in databases quickly. It can improve the response speed of subsequent queries by building a complete index in advance. However, it also leads to a huge overhead of the continuous updating during creating the index. An in-memory database usually has a higher query processing performance than disk databases and is more suitable for real-time query processing. Therefore, there is an urgent need to reduce the index creation and update cost for in-memory databases. Database cracking technology is currently recognized as an effective method to reduce the index initialization time. However, conventional cracking algorithms are focused on simple column data structure rather than those complex index structures for in-memory databases. In order to show the feasibility of in-memory database index cracking and promote to future more extensive research, this paper conducted a case study on the Adaptive Radix Tree (ART), a popular tree index structure of in-memory databases. On the basis of carefully examining the ART index construction overhead, an algorithm using auxiliary data structures to crack the ART index is proposed. This makes it possible to build up an ART index step by step with incessant queries, and hence avoids the poor instant availability of a complete index which is constructed once and for all, but is time consuming. Furthermore, updating a cracking ART index is considered as well. Extensive experiments show that the average initialization time of the ART cracker index is reduced by 75%, and the query response time gradually approaches the original ART algorithm with the coming queries. •In-memory database indexes have more extensive research and application space.•Database Cracking is used as a method applied to in-memory database indexes.•The algorithm has better performance advantages under random queries.
Bibliography:ObjectType-Case Study-2
SourceType-Scholarly Journals-1
content type line 14
ObjectType-Feature-4
ObjectType-Report-1
ObjectType-Article-3
ISSN:0306-4379
1873-6076
DOI:10.1016/j.is.2021.101913