Similarity Joins: Their implementation and interactions with other database operators

Similarity Joins are extensively used in multiple application domains and are recognized among the most useful data processing and analysis operations. They retrieve all data pairs whose distances are smaller than a predefined threshold ε. While several standalone implementations have been proposed,...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Information systems (Oxford) Ročník 52; s. 149 - 162
Hlavní autoři: Silva, Yasin N., Pearson, Spencer S., Chon, Jaime, Roberts, Ryan
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.08.2015
Témata:
Data processing
Database operator
Information systems
Operators
Optimization
PostgreSQL
Query processing
Query processing and optimization
Similarity
Similarity Join
Similarity queries
Transformations
Similarity queries
Query processing and optimization
Database operator
PostgreSQL
Similarity Join
ISSN:0306-4379, 1873-6076
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Similarity Joins are extensively used in multiple application domains and are recognized among the most useful data processing and analysis operations. They retrieve all data pairs whose distances are smaller than a predefined threshold ε. While several standalone implementations have been proposed, very little work has addressed the implementation of Similarity Joins as physical database operators. In this paper, we focus on the study, design, implementation, and optimization of a Similarity Join database operator for metric spaces. We present DBSimJoin, a physical database operator that integrates techniques to: enable a non-blocking behavior, prioritize the early generation of results, and fully support the database iterator interface. The proposed operator can be used with multiple distance functions and data types. We describe the changes in each query engine module to implement DBSimJoin and provide details of our implementation in PostgreSQL. We also study ways in which DBSimJoin can be combined with other similarity and non-similarity operators to answer more complex queries, and how DBSimJoin can be used in query transformation rules to improve query performance. The extensive performance evaluation shows that DBSimJoin significantly outperforms alternative approaches and scales very well when important parameters like ε, data size, and number of dimensions increase.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0306-4379
1873-6076
DOI:10.1016/j.is.2015.01.008