Taming Uncertainty in Critical Scenario Generation for Testing Automated Driving Systems

Scenario-based testing in simulation has become a cornerstone of industrial practice for systematically assessing autonomous driving systems across diverse and relevant situations. Generating critical scenarios is central to this methodology, yet it remains challenging due to the inherent uncertaint...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2025 IEEE Conference on Software Testing, Verification and Validation (ICST) s. 464 - 475
Hlavní autoři: Grosse, Selma, Molin, Adam, Nickovic, Dejan, Gambi, Alessio, Mateis, Cristinel
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 31.03.2025
Témata:
Autonomous driving
Autonomous vehicles
Measurement
Road transportation
Scenario generation
Scenario-based testing
Sensitivity analysis
Software algorithms
Software testing
Test pattern generators
Testing
Uncertainty
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Scenario-based testing in simulation has become a cornerstone of industrial practice for systematically assessing autonomous driving systems across diverse and relevant situations. Generating critical scenarios is central to this methodology, yet it remains challenging due to the inherent uncertainties resulting from scenario parameterization. While parameterization is essential for modeling unpredictable factors, like weather, an excess of parameters hampers testing effectiveness. To address these challenges, this paper introduces a methodology that guides testers in selecting scenario parameters and managing the associated uncertainties. Our approach integrates specification-driven and optimization-based test generation with sensitivity analysis, enabling testers to assess the impact of scenario parameters on scenario criticality. We implemented our approach using well-established industry technologies and evaluated it in a highway case study on three reference search-based scenario generation methods with varying degrees of exploitativeness. Results from our evaluation suggest that reducing the parameter-induced uncertainty can improve the ability of some testing methods to identify critical scenarios while maintaining the diversity of input parameter values.
DOI:10.1109/ICST62969.2025.10989034