Neural network with unbounded activation functions is universal approximator

This paper presents an investigation of the approximation property of neural networks with unbounded activation functions, such as the rectified linear unit (ReLU), which is the new de-facto standard of deep learning. The ReLU network can be analyzed by the ridgelet transform with respect to Lizorki...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	Applied and computational harmonic analysis Ročník 43; číslo 2; s. 233 - 268
Hlavní autori:	Sonoda, Sho, Murata, Noboru
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Elsevier Inc 01.09.2017
Predmet:	Admissibility condition Backprojection filter Bounded extension to [formula omitted] Integral representation Lizorkin distribution Neural network Radon transform Rectified linear unit (ReLU) Ridgelet transform Universal approximation Admissibility condition Universal approximation Radon transform Lizorkin distribution Neural network Bounded extension to L2 Integral representation Backprojection filter Rectified linear unit (ReLU) Ridgelet transform
ISSN:	1063-5203, 1096-603X
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Buďte prvý, kto okomentuje tento záznam!