A survey of randomized algorithms for training neural networks

As a powerful tool for data regression and classification, neural networks have received considerable attention from researchers in fields such as machine learning, statistics, computer vision and so on. There exists a large body of research work on network training, among which most of them tune th...

Full description

Saved in:
Bibliographic Details
Published in:Information sciences Vol. 364-365; pp. 146 - 155
Main Authors: Zhang, Le, Suganthan, P.N.
Format: Journal Article
Language:English
Published: Elsevier Inc 10.10.2016
Subjects:
Classification
Convergence
Convolutional neural networks
Deep learning
Networks
Neural networks
Randomization
Randomized neural networks
Recurrent neural networks
Regression
Statistics
Training
Deep learning
Recurrent neural networks
Randomized neural networks
Convolutional neural networks
ISSN:0020-0255, 1872-6291
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As a powerful tool for data regression and classification, neural networks have received considerable attention from researchers in fields such as machine learning, statistics, computer vision and so on. There exists a large body of research work on network training, among which most of them tune the parameters iteratively. Such methods often suffer from local minima and slow convergence. It has been shown that randomization based training methods can significantly boost the performance or efficiency of neural networks. Among these methods, most approaches use randomization either to change the data distributions, and/or to fix a part of the parameters or network configurations. This article presents a comprehensive survey of the earliest work and recent advances as well as some suggestions for future research.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0020-0255
1872-6291
DOI:10.1016/j.ins.2016.01.039