Suchergebnisse - Mini-batch gradient algorithm

A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize von Yu, Teng-Teng, Liu, Xin-Wei, Dai, Yu-Hong, Sun, Jie

“… We propose a mini-batch proximal stochastic recursive gradient algorithm SRG-DBB, which incorporates the diagonal Barzilai–Borwein (DBB …”
Volltext

Deterministic convergence of complex mini-batch gradient learning algorithm for fully complex-valued neural networks von Zhang, Huisheng, Zhang, Ying, Zhu, Shuai, Xu, Dongpo

“… This paper investigates the fully complex mini-batch gradient algorithm for training complex-valued neural networks …”
Volltext

A mini-batch stochastic conjugate gradient algorithm with variance reduction von Kou, Caixia, Yang, Han

“… In this paper, in the spirit of SAGA, we propose a stochastic conjugate gradient algorithm which we call SCGA …”
Volltext

Prediction of students’ academic performance using ANN with mini-batch gradient descent and Levenberg-Marquardt optimization algorithms von Simanungkalit, F R J, Hanifah, H, Ardaneswari, G, Hariadi, N, Handari, B D

“… In this paper, we use artificial neural networks (ANN) to predict this performance. ANNs with two optimization algorithms, mini-batch gradient descent and Levenberg-Marquardt, are implemented on students …”
Volltext

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering von Kim, Hee-Seung, Zhang, Lingyi, Bienkowski, Adam, Pattipati, Krishna R.

“… This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better …”
Volltext

A novel short-term load forecasting method based on mini-batch stochastic gradient descent regression model von Lizhen, Wu, Yifan, Zhao, Gang, Wang, Xiaohong, Hao

“… In order to solve the problem, an improved regression model based on mini-batch stochastic gradient descent is proposed in this paper …”
Volltext

An online self-organizing radial basis function neural network based on Gaussian Membership von Jia, Lijie, Li, Wenjing, Qiao, Junfei, Zhang, Xinliang

“… Radial basis function neural network (RBFNN) is one of the most popular neural networks, and an appropriate selection of its structure and learning algorithms is crucial for its performance …”
Volltext

Mini-Batch Gradient-Based Algorithms on High-Dimensional Quadratic Problems: Exact Dynamics and Consequences von Cheng, Andrew

“… (il- lustrated by Figure 1.2). A popular class of these algorithms are the mini-batch gradient- based methods (see Definition 2 …”
Volltext

Random Barzilai–Borwein step size for mini-batch algorithms von Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… (mini-batch semi-stochastic gradient descent (mS2GD) method), which leads to a new algorithm …”
Volltext

Trustworthy Network Anomaly Detection Based on an Adaptive Learning Rate and Momentum in IIoT von Yan, Xiaodan, Xu, Yang, Xing, Xiaofei, Cui, Baojiang, Guo, Zihao, Guo, Taibiao

“… and trustworthiness of IIoT devices has become an urgent problem to solve. In this article, we design a new hinge classification algorithm based on mini-batch gradient descent with an adaptive learning rate and momentum (HCA-MBGDALRM …”
Volltext

Mini-batch algorithms with online step size von Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… Specifically, we incorporate online step size into advanced mini-batch algorithms, mini-batch nonconvex stochastic variance reduced gradient (MSVRG …”
Volltext

Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator von Qi, Haobo, Wang, Feifei, Wang, Hansheng

“… We study here a fixed mini-batch gradient descent (FMGD) algorithm to solve optimization problems with massive datasets …”
Volltext

Research on high-precision measuring technology of gear grinder based on the consideration of machine tool thermal error and probe pre-travel error von Yang, Yongming, Wang, Zhonghou, Kubo, Aizoh

“… ) based on involute property and L300G involute gear measuring principle. Mini-batch gradient descent optimization algorithm (MGDOA …”
Volltext

Gradient preconditioned mini-batch SGD for ridge regression von Zhang, Zhuan, Zhou, Shuisheng, Li, Dong, Yang, Ting

“… In this paper, we have a gradient preconditioning trick and combine it with mini-batch SGD. The proposed gradient preconditioned mini-batch SGD algorithm boosts indeed …”
Volltext

Intelligent Event-Triggered Control Supervised by Mini-Batch Machine Learning and Data Compression Mechanism for T-S Fuzzy NCSs Under DoS Attacks von Cai, Xiao, Shi, Kaibo, Sun, Yanbin, Cao, Jinde, Wen, Shiping, Tian, Zhihong

“… ) attacks and quality-of-service (QoS) queuing mechanisms. We develop a novel data compression mechanism to alleviate network congestion and use a mini-batch descent …”
Volltext

Online GMM Clustering and Mini-Batch Gradient Descent Based Optimization for Industrial IoT 4.0 von Messaoud, Seifeddine, Bradai, Abbas, Moulay, Emmanuel

“… The future fifth-generation (5G) networks are expected to support a huge number of connected devices with various and multitude services having different …”
Volltext

A variable metric mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize von Yu, Tengteng, Xin-Wei, Liu, Yu-Hong, Dai, Sun, Jie

“… In this paper, we propose a variable metric mini-batch proximal stochastic recursive gradient algorithm VM-mSRGBB, which updates the metric using a new diagonal BB stepsize …”
Volltext

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training von Shin, Dongyeob, Kim, Geonho, Jo, Joongho, Park, Jongsun

“… Deep neural network (DNN) training is an iterative process of updating network weights, called gradient computation, where (mini-batch …”
Volltext

An adaptive mini-batch stochastic gradient method for AUC maximization von Cheng, Fan, Zhang, Xia, Zhang, Chuang, Qiu, Jianfeng, Zhang, Lei

“… Specifically, the algorithm adopts the framework of mini-batch, and uses projection gradient method for the inner optimization …”
Volltext

Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization von Ghadimi, Saeed, Lan, Guanghui, Zhang, Hongchao

“… ) algorithm, in which proper mini-batch of samples are taken at each iteration depending on the total budget of stochastic samples allowed …”
Volltext