Search Results - Mini-batch gradient algorithm~

A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize by Yu, Teng-Teng, Liu, Xin-Wei, Dai, Yu-Hong, Sun, Jie

“… We propose a mini-batch proximal stochastic recursive gradient algorithm SRG-DBB, which incorporates the diagonal Barzilai–Borwein (DBB…”
Get full text

Deterministic convergence of complex mini-batch gradient learning algorithm for fully complex-valued neural networks by Zhang, Huisheng, Zhang, Ying, Zhu, Shuai, Xu, Dongpo

“…This paper investigates the fully complex mini-batch gradient algorithm for training complex-valued neural networks…”
Get full text

A mini-batch stochastic conjugate gradient algorithm with variance reduction by Kou, Caixia, Yang, Han

“… In this paper, in the spirit of SAGA, we propose a stochastic conjugate gradient algorithm which we call SCGA…”
Get full text

Prediction of students’ academic performance using ANN with mini-batch gradient descent and Levenberg-Marquardt optimization algorithms by Simanungkalit, F R J, Hanifah, H, Ardaneswari, G, Hariadi, N, Handari, B D

“… In this paper, we use artificial neural networks (ANN) to predict this performance. ANNs with two optimization algorithms, mini-batch gradient descent and Levenberg-Marquardt, are implemented on students…”
Get full text

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering by Kim, Hee-Seung, Zhang, Lingyi, Bienkowski, Adam, Pattipati, Krishna R.

“… This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better…”
Get full text

A novel short-term load forecasting method based on mini-batch stochastic gradient descent regression model by Lizhen, Wu, Yifan, Zhao, Gang, Wang, Xiaohong, Hao

“… In order to solve the problem, an improved regression model based on mini-batch stochastic gradient descent is proposed in this paper…”
Get full text

An online self-organizing radial basis function neural network based on Gaussian Membership by Jia, Lijie, Li, Wenjing, Qiao, Junfei, Zhang, Xinliang

“…Radial basis function neural network (RBFNN) is one of the most popular neural networks, and an appropriate selection of its structure and learning algorithms is crucial for its performance…”
Get full text

Mini-Batch Gradient-Based Algorithms on High-Dimensional Quadratic Problems: Exact Dynamics and Consequences by Cheng, Andrew

“… (il- lustrated by Figure 1.2). A popular class of these algorithms are the mini-batch gradient- based methods (see Definition 2…”
Get full text

Random Barzilai–Borwein step size for mini-batch algorithms by Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… (mini-batch semi-stochastic gradient descent (mS2GD) method), which leads to a new algorithm…”
Get full text

Trustworthy Network Anomaly Detection Based on an Adaptive Learning Rate and Momentum in IIoT by Yan, Xiaodan, Xu, Yang, Xing, Xiaofei, Cui, Baojiang, Guo, Zihao, Guo, Taibiao

“… and trustworthiness of IIoT devices has become an urgent problem to solve. In this article, we design a new hinge classification algorithm based on mini-batch gradient descent with an adaptive learning rate and momentum (HCA-MBGDALRM…”
Get full text

Mini-batch algorithms with online step size by Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… Specifically, we incorporate online step size into advanced mini-batch algorithms, mini-batch nonconvex stochastic variance reduced gradient (MSVRG…”
Get full text

Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator by Qi, Haobo, Wang, Feifei, Wang, Hansheng

“…We study here a fixed mini-batch gradient descent (FMGD) algorithm to solve optimization problems with massive datasets…”
Get full text

Research on high-precision measuring technology of gear grinder based on the consideration of machine tool thermal error and probe pre-travel error by Yang, Yongming, Wang, Zhonghou, Kubo, Aizoh

“…) based on involute property and L300G involute gear measuring principle. Mini-batch gradient descent optimization algorithm (MGDOA…”
Get full text

Gradient preconditioned mini-batch SGD for ridge regression by Zhang, Zhuan, Zhou, Shuisheng, Li, Dong, Yang, Ting

“… In this paper, we have a gradient preconditioning trick and combine it with mini-batch SGD. The proposed gradient preconditioned mini-batch SGD algorithm boosts indeed…”
Get full text

Intelligent Event-Triggered Control Supervised by Mini-Batch Machine Learning and Data Compression Mechanism for T-S Fuzzy NCSs Under DoS Attacks by Cai, Xiao, Shi, Kaibo, Sun, Yanbin, Cao, Jinde, Wen, Shiping, Tian, Zhihong

“…) attacks and quality-of-service (QoS) queuing mechanisms. We develop a novel data compression mechanism to alleviate network congestion and use a mini-batch descent…”
Get full text

Online GMM Clustering and Mini-Batch Gradient Descent Based Optimization for Industrial IoT 4.0 by Messaoud, Seifeddine, Bradai, Abbas, Moulay, Emmanuel

“…The future fifth-generation (5G) networks are expected to support a huge number of connected devices with various and multitude services having different…”
Get full text

A variable metric mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize by Yu, Tengteng, Xin-Wei, Liu, Yu-Hong, Dai, Sun, Jie

“… In this paper, we propose a variable metric mini-batch proximal stochastic recursive gradient algorithm VM-mSRGBB, which updates the metric using a new diagonal BB stepsize…”
Get full text

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training by Shin, Dongyeob, Kim, Geonho, Jo, Joongho, Park, Jongsun

“…Deep neural network (DNN) training is an iterative process of updating network weights, called gradient computation, where (mini-batch…”
Get full text

An adaptive mini-batch stochastic gradient method for AUC maximization by Cheng, Fan, Zhang, Xia, Zhang, Chuang, Qiu, Jianfeng, Zhang, Lei

“… Specifically, the algorithm adopts the framework of mini-batch, and uses projection gradient method for the inner optimization…”
Get full text

Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization by Ghadimi, Saeed, Lan, Guanghui, Zhang, Hongchao

“…) algorithm, in which proper mini-batch of samples are taken at each iteration depending on the total budget of stochastic samples allowed…”
Get full text