AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation

While considerable progress has been made in achieving accurate lip synchronization for 3D speech-driven talking face generation, the task of incorporating expressive facial detail synthesis aligned with the speaker's speaking status remains challenging. Existing efforts either focus on learnin...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE Access Vol. 12; pp. 57288 - 57301
Main Authors:	Sun, Yasheng, Chu, Wenqing, Zhou, Hang, Wang, Kaisiyuan, Koike, Hideki
Format:	Journal Article
Language:	English
Published:	Piscataway IEEE 2024 Institute of Electrical and Electronics Engineers (IEEE) The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Alignment Audio data audio-visual instruction Computer Science - Computer Vision and Pattern Recognition contrastive learning diffusion model Diffusion processes Electrical engineering. Electronics. Nuclear engineering expressive talking face generation Harnesses Large language models Speaking Speech Speech processing Synchronism Synchronization Synthesis Talking Task analysis Three-dimensional displays TK1-9971 Visualization
ISSN:	2169-3536, 2169-3536
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!