HSBNN: A High-Scalable Bayesian Neural Networks Accelerator Based on Field Programmable Gate Arrays (FPGA)

Traditional artificial neural networks have inherent overfitting problems and tend to produce overly confident predictions due to their reliance on point estimation methods. In contrast, Bayesian theory offers a probabilistic framework that replaces point estimation with probability distributions, e...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Cognitive computation Ročník 17; číslo 3; s. 100
Hlavní autori: Liu, Yinghao, Zhang, Hao, Sun, Zhe, Duan, Feng, Ma, Yuan, Lu, Wenyi, Caiafa, Cesar F., Solé-Casals, Jordi
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York Springer US 01.06.2025
Springer Nature B.V
Predmet:
Artificial Intelligence
Artificial neural networks
Bayesian analysis
Classification
Computation
Computation by Abstract Devices
Computational Biology/Bioinformatics
Computer Science
Data processing
Data transfer (computers)
Edge computing
Efficiency
Field programmable gate arrays
High acceleration
Information sources
Neural networks
Normal distribution
Optimization techniques
Parallel processing
Parameterization
Pipelining (computers)
Probability distribution
Random numbers
Statistical analysis
Edge Computing
Bio-inspired Neural Networks
FPGA
Bayesian Neural Networks
Hardware Accelerator
ISSN:1866-9956, 1866-9964
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Traditional artificial neural networks have inherent overfitting problems and tend to produce overly confident predictions due to their reliance on point estimation methods. In contrast, Bayesian theory offers a probabilistic framework that replaces point estimation with probability distributions, effectively addressing issues of overconfidence. The brain is also believed working under the Bayesian rules, the neural networks of which evaluate the precision of prior knowledge and incoming evidence, achieving the balance of weight updating to the most reliable information sources [ 1 ]. By integrating Bayesian principles with artificial neural networks, the bio-inspired Bayesian Neural Networks (BNNs) can generate predictions accompanied by confidence evaluations, enhancing their practical applicability. To further improve the computational efficiency of BNNs and enable scalable deployment on edge devices, we propose a High-Scalable Bayesian Neural Network (HSBNN) accelerator based on field-programmable gate arrays (FPGAs) with multiple optimizations. A resource-saving Gaussian random number generator (RS-GRNG) optimized for FPGAs shows high efficiency, which seamlessly extends to support parallel sampling of weight distributions, enabling reliable confidence probability evaluations. Furthermore, the parameterization of BNN architectures with configuration files and employment of a layer-by-layer computing mode ensure that different BNNs can be accelerated without reprogramming the FPGA, offering excellent scalability. The entire system, implemented with the OpenCL heterogeneous computing library, leverages parallel processing units and pipeline channels to achieve high acceleration performance and efficient data transfer. The experiment results demonstrate that the system achieves a data processing throughput of 1.002 milliseconds per image, exceeding CPU performance by 1000-fold and GPU performance by nearly 500-fold.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1866-9956
1866-9964
DOI:10.1007/s12559-025-10455-9