White-Box Micro-Adaptive Query Processing

Operator performance in in-memory data management systems (DMS) often suffers from micro-architectural hazards such as cache misses and branch mispredictions. While many operators have alternative implementations that are robust against such hazards, these generally perform worse when no hazards are...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Data engineering s. 2880 - 2893
Hlavní autoři: Pearce, Jack, Mohr-Daurat, Hubert, Pirk, Holger
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 19.05.2025
Témata:
Engines
Glass box
Hazards
in-memory database
Measurement
micro-adaptivity
micro-architectural hazards
Microarchitecture
Monitoring
Optimization
Pathology
Query processing
Runtime
white-box optimization
ISSN:2375-026X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Operator performance in in-memory data management systems (DMS) often suffers from micro-architectural hazards such as cache misses and branch mispredictions. While many operators have alternative implementations that are robust against such hazards, these generally perform worse when no hazards are encountered. Unfortunately, hazards are caused by order-dependent data characteristics that query optimizers struggle to capture (e.g., sortedness, clusteredness) making a priori hazard-conscious optimization difficult. Additionally, statically optimized plans fail to adapt when data characteristics vary within a table. To address these problems, we propose a hazardadaptive approach to query execution. Through hardwareassisted runtime profiling of low-level metrics, operators dynamically adapt to "hazardous" data. We propose an architecture for hazard-adaptive operators and integrate our approach into a DMS. We demonstrate that using hazard-adaptive operators provides a \sim \mathbf{2-20} \times speedup across several TPC-H queries.
ISSN:2375-026X
DOI:10.1109/ICDE65448.2025.00216