Approximation Algorithms for Training One-Node ReLU Neural Networks

Training a one-node neural network with the ReLU activation function via optimization, which we refer to as the ON-ReLU problem, is a fundamental problem in machine learning. In this paper, we begin by proving the NP-hardness of the ON-ReLU problem. We then present an approximation algorithm to solv...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on signal processing Vol. 68; pp. 6696 - 6706
Main Authors:	Dey, Santanu S., Wang, Guanyi, Xie, Yao
Format:	Journal Article
Language:	English
Published:	New York IEEE 2020 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Algorithms Approximation Approximation algorithms Biological neural networks Machine learning Machine learning algorithms Neural networks Non-convex optimization Optimization Optimized production technology Performance enhancement Random noise Ratios Signal processing algorithms Training training neural networks
ISSN:	1053-587X, 1941-0476
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!