Search Results - standard stochastic gradient algorithm

Particle filtering-based recursive identification for controlled auto-regressive systems with quantised output by Ding, Jie, Chen, Jiazhong, Lin, Jinxing, Jiang, Guoping

“… In this study, a recursive identification algorithm is proposed based on the auxiliary model principle by modifying the standard stochastic gradient algorithm…”
Get full text

Zeroth-Order Nonconvex Stochastic Optimization: Handling Constraints, High Dimensionality, and Saddle Points by Balasubramanian, Krishnakumar, Ghadimi, Saeed

“… to the standard stochastic gradient algorithm using only zeroth-order information. To facilitate zeroth-order optimization in high dimensions, we explore the advantages of structural sparsity assumptions. Specifically…”
Get full text

Convergence Analysis of Weighted Stochastic Gradient Identification Algorithms Based on Latest‐Estimation for ARX Models by Wu, Ai‐Guo, Fu, Fang‐Zhou, Dong, Rui‐Qi

“…In this paper, weighted stochastic gradient (WSG) algorithms for ARX models are proposed by modifying the standard stochastic gradient identification algorithms…”
Get full text

Partially Coupled Stochastic Gradient Identification Methods for Non-Uniformly Sampled Systems by Feng Ding, Guangjun Liu, Liu, Xiaoping Peter

“…) algorithm is proposed to estimate the model parameters with high computational efficiency compared with the standard stochastic gradient (SG) algorithm…”
Get full text

A proportional-integral-derivative-incorporated stochastic gradient descent-based latent factor analysis model by Li, Jinli, Yuan, Ye, Ruan, Tao, Chen, Jia, Luo, Xin

“…) is frequently adopted as the learning algorithm. However, a standard SGD algorithm updates a decision parameter with the stochastic gradient on the instant loss only, without considering information described by prior updates…”
Get full text

Stochastic Gradient Markov Chain Monte Carlo by Nemeth, Christopher, Fearnhead, Paul

“… In this article, we focus on a particular class of scalable Monte Carlo algorithms, stochastic gradient Markov chain Monte Carlo (SGMCMC…”
Get full text

Almost sure convergence rates of stochastic proximal gradient descent algorithm by Liang, Yuqing, Xu, Dongpo

“…Stochastic proximal gradient descent (Prox-SGD) is a standard optimization algorithm for solving stochastic composite optimization problems in machine learning…”
Get full text

Guided Stochastic Gradient Descent Algorithm for inconsistent datasets by Sharma, Anuraganand

“…Stochastic Gradient Descent (SGD) Algorithm, despite its simplicity, is considered an effective and default standard optimization algorithm for machine learning…”
Get full text

Differentially private stochastic gradient descent via compression and memorization by Phong, Le Trieu, Phuong, Tran Thi

“… Our differentially private algorithm, called dp-memSGD for short, converges mathematically at the same rate of 1/T as standard stochastic gradient descent (SGD…”
Get full text

Fastest rates for stochastic mirror descent methods by Hanzely, Filip, Richtárik, Peter

“… We propose and analyze two new algorithms: Relative Randomized Coordinate Descent (relRCD) and Relative Stochastic Gradient Descent (relSGD…”
Get full text

Linear mixed effects models for non-Gaussian continuous repeated measurement data by Asar, Özgür, Bolin, David, Diggle, Peter J., Wallin, Jonas

“… A standard framework for analysing data of this kind is a linear Gaussian mixed effects model within which the outcome variable can be decomposed into fixed effects, time invariant and time-varying…”
Get full text

Adaptive Stochastic Gradient Descent Optimisation for Image Registration by Klein, Stefan, Pluim, Josien P. W., Staring, Marius, Viergever, Max A.

“… The proposed adaptive stochastic gradient descent (ASGD) method is compared to a standard, non-adaptive Robbins-Monro (RM) algorithm…”
Get full text

A Nonlinear PID-Incorporated Adaptive Stochastic Gradient Descent Algorithm for Latent Factor Analysis by Li, Jinli, Luo, Xin, Yuan, Ye, Gao, Shangce

“… from them. However, a standard SGD algorithm updates a latent factor based on the current stochastic gradient only, without the considerations on the past information, making a resultant model suffer from slow convergence…”
Get full text

An Efficient Stochastic Gradient Descent Algorithm to Maximize the Coverage of Cellular Networks by Liu, Yaxi, Huangfu, Wei, Zhang, Haijun, Long, Keping

“… A standard gradient descent algorithm and its improved version, namely a Stochastic Gradient Descent (SGD…”
Get full text

A Fuzzy PID-Incorporated Stochastic Gradient Descent Algorithm for Fast and Accurate Latent Factor Analysis by Yuan, Ye, Li, Jinli, Luo, Xin

“… However, an SGD-based LFA model is often stacked by slow convergence since a standard SGD algorithm updates a single latent factor depending on the stochastic gradient of current instance learning…”
Get full text

Latent Factor-Based Recommenders Relying on Extended Stochastic Gradient Descent Algorithms by Luo, Xin, Wang, Dexian, Zhou, MengChu, Yuan, Huaqiang

“… Stochastic gradient descent (SGD) is a highly efficient algorithm for building an LF model…”
Get full text

Model-free control of nonlinear stochastic systems with discrete-time measurements by Spall, J.C., Cristion, J.A.

“… This paper considers the use of the simultaneous perturbation stochastic approximation algorithm which requires only system measurements…”
Get full text

Stochastic Gradient Made Stable: A Manifold Propagation Approach for Large-Scale Optimization by Mu, Yadong, Liu, Wei, Liu, Xiaobai, Fan, Wei

“… To improve the stability of stochastic gradient, recent years have witnessed the proposal of several semi-stochastic gradient descent algorithms, which distinguish themselves from standard SGD…”
Get full text

Learning Error Refinement in Stochastic Gradient Descent-Based Latent Factor Analysis via Diversified PID Controllers by Li, Jinli, Yuan, Ye, Luo, Xin

“… Unfortunately, a standard SGD algorithm trains a single latent factor relying on the stochastic gradient related to the current learning error only, leading to a slow convergence rate…”
Get full text

Device Specifications for Neural Network Training with Analog Resistive Cross‐Point Arrays Using Tiki‐Taka Algorithms by Byun, Jinho, Kim, Seungkun, Kim, Doyoon, Lee, Jimin, Ji, Wonjae, Kim, Seyoung

“…Recently, specialized training algorithms for analog cross‐point array‐based neural network accelerators have been introduced to counteract device non…”
Get full text