Výsledky vyhledávání - Mini-batch gradient algorithm*

A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize Autor Yu, Teng-Teng, Liu, Xin-Wei, Dai, Yu-Hong, Sun, Jie

“… We propose a mini-batch proximal stochastic recursive gradient algorithm SRG-DBB, which incorporates the diagonal Barzilai–Borwein (DBB…”
Získat plný text

Deterministic convergence of complex mini-batch gradient learning algorithm for fully complex-valued neural networks Autor Zhang, Huisheng, Zhang, Ying, Zhu, Shuai, Xu, Dongpo

“…This paper investigates the fully complex mini-batch gradient algorithm for training complex-valued neural networks…”
Získat plný text

A mini-batch stochastic conjugate gradient algorithm with variance reduction Autor Kou, Caixia, Yang, Han

“… In this paper, in the spirit of SAGA, we propose a stochastic conjugate gradient algorithm which we call SCGA…”
Získat plný text

Prediction of students’ academic performance using ANN with mini-batch gradient descent and Levenberg-Marquardt optimization algorithms Autor Simanungkalit, F R J, Hanifah, H, Ardaneswari, G, Hariadi, N, Handari, B D

“… In this paper, we use artificial neural networks (ANN) to predict this performance. ANNs with two optimization algorithms, mini-batch gradient descent and Levenberg-Marquardt, are implemented on students…”
Získat plný text

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering Autor Kim, Hee-Seung, Zhang, Lingyi, Bienkowski, Adam, Pattipati, Krishna R.

“… This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better…”
Získat plný text

An online self-organizing radial basis function neural network based on Gaussian Membership Autor Jia, Lijie, Li, Wenjing, Qiao, Junfei, Zhang, Xinliang

“…Radial basis function neural network (RBFNN) is one of the most popular neural networks, and an appropriate selection of its structure and learning algorithms is crucial for its performance…”
Získat plný text

Mini-Batch Gradient-Based Algorithms on High-Dimensional Quadratic Problems: Exact Dynamics and Consequences Autor Cheng, Andrew

“… (il- lustrated by Figure 1.2). A popular class of these algorithms are the mini-batch gradient- based methods (see Definition 2…”
Získat plný text

Trustworthy Network Anomaly Detection Based on an Adaptive Learning Rate and Momentum in IIoT Autor Yan, Xiaodan, Xu, Yang, Xing, Xiaofei, Cui, Baojiang, Guo, Zihao, Guo, Taibiao

“… and trustworthiness of IIoT devices has become an urgent problem to solve. In this article, we design a new hinge classification algorithm based on mini-batch gradient descent with an adaptive learning rate and momentum (HCA-MBGDALRM…”
Získat plný text

Random Barzilai–Borwein step size for mini-batch algorithms Autor Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… (mini-batch semi-stochastic gradient descent (mS2GD) method), which leads to a new algorithm…”
Získat plný text

A novel short-term load forecasting method based on mini-batch stochastic gradient descent regression model Autor Lizhen, Wu, Yifan, Zhao, Gang, Wang, Xiaohong, Hao

“… In order to solve the problem, an improved regression model based on mini-batch stochastic gradient descent is proposed in this paper…”
Získat plný text

Mini-batch algorithms with online step size Autor Yang, Zhuang, Wang, Cheng, Zhang, Zhemin, Li, Jonathan

“… Specifically, we incorporate online step size into advanced mini-batch algorithms, mini-batch nonconvex stochastic variance reduced gradient (MSVRG…”
Získat plný text

Research on high-precision measuring technology of gear grinder based on the consideration of machine tool thermal error and probe pre-travel error Autor Yang, Yongming, Wang, Zhonghou, Kubo, Aizoh

“…) based on involute property and L300G involute gear measuring principle. Mini-batch gradient descent optimization algorithm (MGDOA…”
Získat plný text

Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator Autor Qi, Haobo, Wang, Feifei, Wang, Hansheng

“…We study here a fixed mini-batch gradient descent (FMGD) algorithm to solve optimization problems with massive datasets…”
Získat plný text

Gradient preconditioned mini-batch SGD for ridge regression Autor Zhang, Zhuan, Zhou, Shuisheng, Li, Dong, Yang, Ting

“… In this paper, we have a gradient preconditioning trick and combine it with mini-batch SGD. The proposed gradient preconditioned mini-batch SGD algorithm boosts indeed…”
Získat plný text

Low Complexity Gradient Computation Techniques to Accelerate Deep Neural Network Training Autor Shin, Dongyeob, Kim, Geonho, Jo, Joongho, Park, Jongsun

“…Deep neural network (DNN) training is an iterative process of updating network weights, called gradient computation, where (mini-batch…”
Získat plný text

Explore a deep learning multi-output neural network for regional multi-step-ahead air quality forecasts Autor Zhou, Yanlai, Chang, Fi-John, Chang, Li-Chiu, Kao, I-Feng, Wang, Yi-Shin

“…) neural network model that were incorporated with three deep learning algorithms (i.e., mini-batch gradient descent, dropout neuron and L2 regularization…”
Získat plný text

A new perspective for understanding generalization gap of deep neural networks trained with large batch sizes Autor Oyedotun, Oyebade K., Papadopoulos, Konstantinos, Aouada, Djamila

“…Deep neural networks (DNNs) are typically optimized using various forms of mini-batch gradient descent algorithm…”
Získat plný text

Intelligent Event-Triggered Control Supervised by Mini-Batch Machine Learning and Data Compression Mechanism for T-S Fuzzy NCSs Under DoS Attacks Autor Cai, Xiao, Shi, Kaibo, Sun, Yanbin, Cao, Jinde, Wen, Shiping, Tian, Zhihong

“…) attacks and quality-of-service (QoS) queuing mechanisms. We develop a novel data compression mechanism to alleviate network congestion and use a mini-batch descent…”
Získat plný text

Improved digital chest tomosynthesis image quality by use of a projection-based dual-energy virtual monochromatic convolutional neural network with super resolution Autor Gomi, Tsutomu, Hara, Hidetake, Watanabe, Yusuke, Mizukami, Shinya

“…–VDSR algorithm employs a training network (mini-batch stochastic gradient-descent algorithm with momentum…”
Získat plný text

A new lightweight deep neural network for surface scratch detection Autor Li, Wei, Zhang, Liangchi, Wu, Chuhan, Cui, Zhenxiang, Niu, Chao

“… To this end, a large surface scratch dataset obtained from cylinder-on-flat sliding tests was used to train the WearNet with appropriate training parameters such as learning rate, gradient algorithm and mini-batch size…”
Získat plný text