Search Results - Batch gradient algorithm

Convergence of batch gradient algorithm with smoothing composition of group $$l_{0}$$ and $$l_{1/2}$$ regularization for feedforward neural networks by Ramchoun, Hassan, Ettaouil, Mohamed

Get full text

Convergence of batch gradient learning algorithm with smoothing L1/2 regularization for Sigma–Pi–Sigma neural networks by Liu, Yan, Li, Zhengxue, Yang, Dakun, Mohamed, Kh.Sh, Wang, Jing, Wu, Wei

“… However, the nonsmoothness of L1/2 regularization may lead to oscillation phenomenon. The aim of this paper is to develop a novel batch gradient method with smoothing L1/2 regularization for Sigma–Pi…”
Get full text

A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize by Yu, Teng-Teng, Liu, Xin-Wei, Dai, Yu-Hong, Sun, Jie

“… We propose a mini-batch proximal stochastic recursive gradient algorithm SRG-DBB, which incorporates the diagonal Barzilai–Borwein (DBB…”
Get full text

Deterministic convergence of complex mini-batch gradient learning algorithm for fully complex-valued neural networks by Zhang, Huisheng, Zhang, Ying, Zhu, Shuai, Xu, Dongpo

“…This paper investigates the fully complex mini-batch gradient algorithm for training complex-valued neural networks…”
Get full text

Convergence of batch gradient algorithm with smoothing composition of group l0 and l1/2 regularization for feedforward neural networks by Ramchoun, Hassan, Ettaouil, Mohamed

“…In this paper, we prove the convergence of batch gradient method for training feedforward neural network…”
Get full text

A mini-batch stochastic conjugate gradient algorithm with variance reduction by Kou, Caixia, Yang, Han

“… In this paper, in the spirit of SAGA, we propose a stochastic conjugate gradient algorithm which we call SCGA…”
Get full text

Convergence analysis of the batch gradient-based neuro-fuzzy learning algorithm with smoothing L 1/2 regularization for the first-order Takagi–Sugeno system by Liu, Yan, Yang, Dakun

Get full text

Batch Gradient Learning Algorithm with Smoothing L1 Regularization for Feedforward Neural Networks by Mohamed, Khidir Shaib

“… In this paper, we propose a batch gradient learning algorithm with smoothing L1 regularization (BGSL1…”
Get full text

Design and Analysis of Urban Land Lease Price Predicting Model Using Batch Gradient Descent Algorithm by Berhane Niguse, Kifle

“… But with prediction, they tend to over-fit samples and simplify poorly to new, undetected data. This paper presents a batch gradient algorithm for predicting the rice of land with large datasets…”
Get full text

Batch Gradient Learning Algorithm with Smoothing Regularization for Feedforward Neural Networks by Khidir Shaib Mohamed

“… In this paper, we propose a batch gradient learning algorithm with smoothing L1 regularization (BGS L1…”
Get full text

Prediction of students’ academic performance using ANN with mini-batch gradient descent and Levenberg-Marquardt optimization algorithms by Simanungkalit, F R J, Hanifah, H, Ardaneswari, G, Hariadi, N, Handari, B D

“… In this paper, we use artificial neural networks (ANN) to predict this performance. ANNs with two optimization algorithms, mini-batch gradient descent and Levenberg-Marquardt, are implemented on students…”
Get full text

Convergence of a Batch Gradient Algorithm with Adaptive Momentum for Neural Networks by Shao, Hongmei, Xu, Dongpo, Zheng, Gaofeng

“…In this paper, a batch gradient algorithm with adaptive momentum is considered and a convergence theorem is presented when it is used for two-layer feedforward neural networks training…”
Get full text

Deterministic convergence analysis for regularized long short-term memory and its application to regression and multi-classification problems by Kang, Qian, Yu, Dengxiu, Cheong, Kang Hao, Wang, Zhen

“… This paper propose a novel regularized LSTM based on the batch gradient method. Specifically, the L2 regularization is appended to the objective function as a systematic…”
Get full text

L1/2 regularization learning for smoothing interval neural networks: Algorithms and convergence analysis by Yang, Dakun, Liu, Yan

“… In this paper, a novel batch gradient algorithm with smoothing L1/2 regularization is proposed to prevent the weights oscillation for a smoothing interval neural network (SINN…”
Get full text

An online self-organizing radial basis function neural network based on Gaussian Membership by Jia, Lijie, Li, Wenjing, Qiao, Junfei, Zhang, Xinliang

“…Radial basis function neural network (RBFNN) is one of the most popular neural networks, and an appropriate selection of its structure and learning algorithms is crucial for its performance…”
Get full text

Convergence Analysis of Batch Gradient Algorithm for Three Classes of Sigma-Pi Neural Networks by Zhang, Chao, Wu, Wei, Xiong, Yan

“… A unified convergence analysis for the batch gradient algorithm for SPNN learning is presented, covering three classes of SPNNs: Σ-Π-Σ, Σ-Σ-Π and Σ-Π-Σ-Π…”
Get full text

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering by Kim, Hee-Seung, Zhang, Lingyi, Bienkowski, Adam, Pattipati, Krishna R.

“… This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better…”
Get full text

Strong Convergence Analysis of Batch Gradient-Based Learning Algorithm for Training Pi-Sigma Network Based on TSK Fuzzy Models by Liu, Yan, Yang, Dakun, Nan, Nan, Guo, Li, Zhang, Jianjun

“… The aim of this paper is to present a gradient-based learning method for Pi-Sigma network to train TSK fuzzy inference system…”
Get full text

Mini-Batch Gradient-Based Algorithms on High-Dimensional Quadratic Problems: Exact Dynamics and Consequences by Cheng, Andrew

“… (il- lustrated by Figure 1.2). A popular class of these algorithms are the mini-batch gradient- based methods (see Definition 2…”
Get full text

Convergence analysis of the batch gradient-based neuro-fuzzy learning algorithm with smoothing L1/2 regularization for the first-order Takagi–Sugeno system by Liu, Yan, Yang, Dakun

“… The neuro-fuzzy learning algorithm involves two tasks: generating comparable sparse networks and training the parameters…”
Get full text