Multimodal information fusion using the iterative decoding algorithm and its application to audio-visual speech recognition

The fusion of information from heterogenous sensors is crucial to the effectiveness of a multimodal system. Noise affect the sensors of different modalities independently. A good fusion scheme should be able to use local estimates of the reliability of each modality to weight the decisions. This pap...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2008 IEEE International Conference on Acoustics, Speech and Signal Processing s. 2241 - 2244
Hlavní autoři: Shivappa, S.T., Rao, B.D., Trivedi, M.M.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.03.2008
Témata:
Acoustic noise
Application software
Drives
Feature extraction
Hidden Markov models
Iterative algorithms
Iterative decoding
Multimedia systems
Multimodal sensors
Robustness
Sensor fusion
Speech recognition
ISBN:9781424414833, 1424414830
ISSN:1520-6149
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The fusion of information from heterogenous sensors is crucial to the effectiveness of a multimodal system. Noise affect the sensors of different modalities independently. A good fusion scheme should be able to use local estimates of the reliability of each modality to weight the decisions. This paper presents an iterative decoding based information fusion scheme motivated by the theory of turbo codes. This fusion framework is developed in the context of hidden Markov models. We present the mathematical framework of the fusion scheme. We then apply this algorithm to an audio-visual speech recognition task on the GRID audio-visual speech corpus and present the results.
ISBN:9781424414833
1424414830
ISSN:1520-6149
DOI:10.1109/ICASSP.2008.4518091