Distributed Audio-Visual Parsing Based On Multimodal Transformer and Deep Joint Source Channel Coding

Audio-visual parsing (AVP) is a newly emerged multimodal perception task, which detects and classifies audio-visual events in video. However, most existing AVP networks only use a simple attention mechanism to guide audio-visual multimodal events, and are implemented in a single end. This makes it u...

Celý popis

Podrobná bibliografia

Vydané v:	Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) s. 4623 - 4627
Hlavní autori:	Wang, Penghong, Li, Jiahui, Ma, Mengyao, Fan, Xiaopeng
Médium:	Konferenčný príspevok..
Jazyk:	English
Vydavateľské údaje:	IEEE 23.05.2022
Predmet:	Channel coding Decoding deep joint source channel coding distributed audio-visual parsing network multimodal transformer Signal processing algorithms Speech coding Training Transformers Visualization
ISSN:	2379-190X
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!