Search Results - Adaptive Moment Estimation with Weight Decay algorithm

A data-driven cost estimation model for agile development based on Kolmogorov-Arnold Networks and AdamW optimization by Zhao, Xiaoyan, Xiong, Xin, Mansor, Zulkefli, Razali, Rozilawati, Ahmad Nazri, Mohd Zakree, Li, Liangyu

“… However, accurate cost estimation in agile projects remains challenging, mainly due to frequent requirement changes and data scarcity…”
Get full text

An Improved Adaptive Moment Estimation Algorithm for the Industrial Robot Calibration by Chen, Tinghui, Li, Shuai

“… To address this issue, this paper presents a novel robot algorithm that combines an adaptive and momental bound algorithm with decoupled weight decay (AdaModW…”
Get full text

Short-term building cooling load prediction model based on DwdAdam-ILSTM algorithm: A case study of a commercial building by Dong, Fangnan, Yu, Junqi, Quan, Wei, Xiang, Yalun, Li, Xiang, Sun, Fukang

“… Then, the decoupling weight decay adaptive moment estimation (DwdAdam) optimization algorithm is utilized to optimize the parameters of the improved long short term memory (ILSTM) prediction model…”
Get full text

Highly Accurate Robot Calibration Using Adaptive and Momental Bound with Decoupled Weight Decay by Chen, Tinghui, Li, Shuai

“… To address this issue, this paper presents a novel robot algorithm that combines an adaptive and momental bound algorithm with decoupled weight decay (AdaModW…”
Get full text

A new optimization algorithm for non-stationary time series prediction based on recurrent neural networks by Zhang, Yulai, Wang, Yuchao, Luo, Guiming

“… A moving window and exponential decay weights are used in this algorithm to eliminate the effects of the history gradients…”
Get full text

Variational HyperAdam: A Meta-Learning Approach to Network Training by Wang, Shipeng, Yang, Yan, Sun, Jian, Xu, Zongben

“…Stochastic optimization algorithms have been popular for training deep neural networks…”
Get full text

Automatic Impervious Surface Area Detection Using Image Texture Analysis and Neural Computing Models with Advanced Optimizers by Hoang, Nhat-Duc

“… To achieve this task, advanced optimizers of adaptive moment estimation (Adam), a variation of Adam called Adamax, Nesterov-accelerated adaptive moment estimation (Nadam…”
Get full text

Enhanced Short-Term Load Power Forecasting Using Lion-Optimized Temporal Convolutional Networks with Advanced Hyperparameter Tuning by Musbah, Hmeda, Aly, Hamed H., Othoman, Ali

“…), Adaptive Moment Estimation with Weight Decay (AdamW), and the Lion…”
Get full text

The Analysis of the Neural Network Optimizers in Condition of the Limited Dataset by Pchelin, Andrey V., Martyanov, Andrey S., Antipin, Dmitry S.

“…), root-mean-square propagation (RMSProp), adaptive moment estimation (Adam) and decoupled weight decay regularization…”
Get full text

Application of a convolutional neural network to land use classification based on GF-2 remote sensing imagery by Yu, Jun, Du, Shizhou, Xin, Zhenghua, Huang, Linsheng, Zhao, Jinling

“…Traditional remote sensing-based land use classification methods mainly focus on pixel-based unsupervised and supervised approaches and object-based image…”
Get full text

Attention-Enhanced Hybrid Automatic Modulation Classification for Advanced Wireless Communication Systems: A Deep Learning-Transformer Framework by Ansari, Sam, Alnajjar, Khawla A., Majzoub, Sohaib, Almajali, Eqab, Jarndal, Anwar, Bonny, Talal, Hussain, Abir, Mahmoud, Soliman

“…The advancement of wireless communication toward beyond fifth-generation (B5G) and sixth-generation (6G) standards demands intelligent and scalable signal…”
Get full text

Computations over data streams by Puttagunta, Vasundhara

“… We present novel summaries to estimate aggregate queries over streaming data, and adaptive computations for stream applications based on forgetting factors…”
Get full text