EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

arXiv:2606.15848 · cs.CV · Submitted 2026-06-14 · Read on arXiv

cs.CV

Submitted: 2026-06-14

Updated: 2026-09-25

Terminology

• Consistency — 13× in this paper · explained in 3 episodes
• Fidelity — 12× in this paper · explained in 2 episodes
• Accuracy — 7× in this paper · explained in 1 episode
• 3D Gaussian Splatting — 6× in this paper · explained in 2 episodes
• Ablation — 6× in this paper · explained in 1 episode
• Alignment — 6× in this paper · explained in 1 episode
• Decoupling — 6× in this paper · explained in 2 episodes
• Gaussian Splatting — 6× in this paper · explained in 4 episodes
• 3D Gaussian Splatting (3DGS) — 4× in this paper · explained in 4 episodes
• Regularization — 4× in this paper · explained in 3 episodes
• Ablation study — 3× in this paper · explained in 1 episode
• Temporal consistency — 3× in this paper · explained in 2 episodes
• Ablation Studies — 2× in this paper · explained in 1 episode
• Adam — 2× in this paper · explained in 2 episodes
• Diffusion Model — 2× in this paper · explained in 8 episodes
• Entanglement — 2× in this paper · explained in 3 episodes
• Facial Action Coding System — 2× in this paper
• Multimodal Fusion — 2× in this paper · explained in 3 episodes
• Adaptation — 1× in this paper · explained in 1 episode
• Benchmark — 1× in this paper · explained in 2 episodes
• Clustering — 1× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Evaluation Dimensions — 1× in this paper · explained in 3 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• Joint AU Detection and Face Alignment — 1× in this paper
• Latent Dynamics — 1× in this paper · explained in 2 episodes
• Latent Space — 1× in this paper · explained in 7 episodes
• Multi-objective Optimization — 1× in this paper · explained in 4 episodes
• Representation Learning — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• EmoTalkingGaussian: Continuous Emotion-conditioned Talking Head Synthesis
• Talking Head Generation via AU-Guided Landmark Prediction
• Talking Head Generation Driven by Speech-Related Facial Action Units and Audio- Based on Multimodal Representation Fusion
• Adam: A Method for Stochastic Optimization
• EmoDiffTalk:Emotion-aware Diffusion for Editable 3D Gaussian Talking Head
• AUHead: Realistic Emotional Talking Head Generation via Action Units Control
• DreamTalk: When Emotional Talking Head Generation Meets Diffusion Probabilistic Models
• Towards Localized Fine-Grained Control for Facial Expression Generation
• GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models