Distributed Audio-Visual Parsing Based On Multimodal Transformer and Deep Joint Source Channel Coding

Audio-visual parsing (AVP) is a newly emerged multimodal perception task, which detects and classifies audio-visual events in video. However, most existing AVP networks only use a simple attention mechanism to guide audio-visual multimodal events, and are implemented in a single end. This makes it u...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) S. 4623 - 4627
Hauptverfasser:	Wang, Penghong, Li, Jiahui, Ma, Mengyao, Fan, Xiaopeng
Format:	Tagungsbericht
Sprache:	Englisch
Veröffentlicht:	IEEE 23.05.2022
Schlagworte:	Channel coding Decoding deep joint source channel coding distributed audio-visual parsing network multimodal transformer Signal processing algorithms Speech coding Training Transformers Visualization
ISSN:	2379-190X
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!