AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation

While considerable progress has been made in achieving accurate lip synchronization for 3D speech-driven talking face generation, the task of incorporating expressive facial detail synthesis aligned with the speaker's speaking status remains challenging. Existing efforts either focus on learnin...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE Access Jg. 12; S. 57288 - 57301
Hauptverfasser:	Sun, Yasheng, Chu, Wenqing, Zhou, Hang, Wang, Kaisiyuan, Koike, Hideki
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Piscataway IEEE 2024 Institute of Electrical and Electronics Engineers (IEEE) The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Alignment Audio data audio-visual instruction Computer Science - Computer Vision and Pattern Recognition contrastive learning diffusion model Diffusion processes Electrical engineering. Electronics. Nuclear engineering expressive talking face generation Harnesses Large language models Speaking Speech Speech processing Synchronism Synchronization Synthesis Talking Task analysis Three-dimensional displays TK1-9971 Visualization
ISSN:	2169-3536, 2169-3536
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!