Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activations

This paper investigates the approximation properties of deep neural networks with piecewise-polynomial activation functions. We derive the required depth, width, and sparsity of a deep neural network to approximate any Hölder smooth function up to a given approximation error in Hölder norms in such...

Full description

Bibliographic Details

Published in:	Neural networks Vol. 161; pp. 242 - 253
Main Authors:	Belomestny, Denis, Naumov, Alexey, Puchkin, Nikita, Samsonov, Sergey
Format:	Journal Article
Language:	English
Published:	United States Elsevier Ltd 01.04.2023
Subjects:	Algorithms Approximation complexity Deep neural networks Hölder class Machine Learning Neural Networks, Computer ReLUk activations ReQU activations Approximation complexity Deep neural networks Hölder class ReQU activations ReLUk activations ReLU(k) activations
ISSN:	0893-6080, 1879-2782, 1879-2782
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!