Multi-sensor fusion and segmentation for autonomous vehicle multi-object tracking using deep Q networks

Autonomous vehicles, often known as self-driving cars, have emerged as a disruptive technology with the promise of safer, more efficient, and convenient transportation. The existing works provide achievable results but lack effective solutions, as accumulation on roads can obscure lane markings and...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Scientific reports Jg. 14; H. 1; S. 31130 - 32
Hauptverfasser: Vinoth, K., Sasikumar, P.
Format: Journal Article
Sprache:Englisch
Veröffentlicht: London Nature Publishing Group UK 28.12.2024
Nature Publishing Group
Nature Portfolio
Schlagworte:
639/166
639/705/117
Autonomous vehicles
Dense net (D net)
Dust storms
Energy Valley Optimizer (EVO)
Fog
Humanities and Social Sciences
Image processing
Information processing
Lidar
Multi-sensor fusion
multidisciplinary
Noise reduction
Pedestrians
Pipelines
Rainfall
Science
Science (multidisciplinary)
Segmentation
Self-driving vehicles
Sensors
YOLO V7 model
Multi-sensor fusion
Segmentation
Self-driving vehicles
Energy Valley Optimizer (EVO)
Dense net (D net)
YOLO V7 model
ISSN:2045-2322, 2045-2322
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Autonomous vehicles, often known as self-driving cars, have emerged as a disruptive technology with the promise of safer, more efficient, and convenient transportation. The existing works provide achievable results but lack effective solutions, as accumulation on roads can obscure lane markings and traffic signs, making it difficult for the self-driving car to navigate safely. Heavy rain, snow, fog, or dust storms can severely limit the car’s sensors’ ability to detect obstacles, pedestrians, and other vehicles, which pose potential safety risks. So, we have presented a multi-sensor fusion and segmentation for multi-object tracking using DQN in self-driving cars. Our proposed scheme incorporates the handling of pipelines for camera and LiDAR data and the development of an autonomous solution for object detection by handling sensor images. An Improved Adaptive Extended Kalman Filter (IAEKF) was used for noise reduction. The Contrast enhancement was done using a Normalised Gamma Transformation based CLAHE (NGT-CLAHE), and the adaptive thresholding was implemented using an Improved Adaptive Weighted Mean Filter (IAWMF) which was used for preprocessing. The multi-segmentation based on orientation employs various segmentation techniques and degrees. The dense net-based multi-image fusion gives more efficiency and a high memory in terms of fast processing time. The Energy Valley Optimizer (EVO) approach is used to select grid map-based paths and lanes. This strategy solves complicated tasks in a simple manner, which leads to ease of flexibility, resilience, and scalability. In addition, the YOLO V7 model is used for detection and categorization. The proposed work is evaluated using metrics such as velocity, accuracy rate, success rate, success ratio, mean squared error, loss rate, and accumulated reward.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-024-82356-0