Multi-objective: hybrid particle swarm optimization with firefly algorithm for feature selection with Leaky ReLU

High-dimensional datasets often pose challenges due to the presence of numerous irrelevant and redundant features, which can compromise the performance of machine learning models. This study proposes a novel optimization algorithm, LR-GPSOFA, designed to improve feature selection by enhancing comput...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Discover Artificial Intelligence Ročník 5; číslo 1; s. 192 - 24
Hlavní autoři: Singh, Ashish Kumar, Kumar, Anoj
Médium: Journal Article
Jazyk:angličtina
Vydáno: Cham Springer International Publishing 01.12.2025
Springer Nature B.V
Springer
Témata:
Accuracy
Artificial Intelligence
Classification
Computer Science
Datasets
Efficiency
Engineering
Feature selection
Genetic algorithms
KNN
Leaky ReLU
Machine learning
Meta-heuristic
Methods
Optimization algorithms
Optimization techniques
PSO
Swarm intelligence
Leaky ReLU
Feature selection
KNN
Swarm intelligence
Meta-heuristic
PSO
ISSN:2731-0809, 2731-0809
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:High-dimensional datasets often pose challenges due to the presence of numerous irrelevant and redundant features, which can compromise the performance of machine learning models. This study proposes a novel optimization algorithm, LR-GPSOFA, designed to improve feature selection by enhancing computational efficiency and classification accuracy. The algorithm integrates Particle Swarm Optimization (PSO) with the Firefly Algorithm and Leaky Rectified Linear Unit (Leaky ReLU), utilizing the K-Nearest Neighbors (KNN) classifier to increase processing speed and ensure accurate classification. The reason behind selecting PSO is that it is well-suited for smaller search spaces, while the Firefly Algorithm (FA) excels in larger search spaces, making their hybridization particularly effective. By combining these strengths, LR-GPSOFA improves adaptability and randomness in particle motion while reducing the tendency for greedy search behavior. The inclusion of Leaky ReLU addresses the “dying ReLU” problem by preserving non-zero gradients, enabling the algorithm to navigate complex, irregular landscapes effectively. A penalty mechanism is incorporated to ensure convergence even when no features are selected, enhancing the robustness of the strategy. The algorithm was evaluated on eight diverse datasets, demonstrating significant improvements in feature selection efficiency and performance. These results highlight the potential of LR-GPSOFA as a powerful tool for feature selection in high-dimensional data, with broad applicability across various domains and real-world challenges.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2731-0809
2731-0809
DOI:10.1007/s44163-025-00428-0