On the uniform approximation estimation of deep ReLU networks via frequency decomposition

A recent line of works established the approximation complexity estimation of deep ReLU networks for the bandlimited functions in the MSE (mean square error) sense. In this note, we significantly enhance this result, that is, we estimate the approximation complexity in the $ L_{\infty} $ sense. The...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:AIMS mathematics Jg. 7; H. 10; S. 19018 - 19025
Hauptverfasser: Chen, Liang, Liu, Wenjun
Format: Journal Article
Sprache:Englisch
Veröffentlicht: AIMS Press 01.01.2022
Schlagworte:
approximation complexity
bandlimited functions
deep relu networks
fat-shattering dimension
ISSN:2473-6988, 2473-6988
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A recent line of works established the approximation complexity estimation of deep ReLU networks for the bandlimited functions in the MSE (mean square error) sense. In this note, we significantly enhance this result, that is, we estimate the approximation complexity in the $ L_{\infty} $ sense. The key to the proof is to establish a frequency decomposition lemma which may be of independent interest.
ISSN:2473-6988
2473-6988
DOI:10.3934/math.20221045