A General Survey on Attention Mechanisms in Deep Learning

Attention is an important mechanism that can be employed for a variety of deep learning models across many different domains and tasks. This survey provides an overview of the most important attention mechanisms proposed in the literature. The various attention mechanisms are explained by means of a...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	IEEE transactions on knowledge and data engineering Jg. 35; H. 4; S. 3279 - 3298
Hauptverfasser:	Brauwers, Gianni, Frasincar, Flavius
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York IEEE 01.04.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Attention models Biological system modeling Computational modeling Data models Deep learning Feature extraction introductory and survey neural nets supervised learning Task analysis Taxonomy
ISSN:	1041-4347, 1558-2191
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!