Browse State-of-the-Art › Talking Head Generation
Talking Head Generation
51 papers with code · 7 benchmarks · 3 datasets archive 2025-07-28
Talking head generation is the task of generating a talking face from a set of images of a person.
( Image credit: Few-Shot Adversarial Learning of Realistic Neural Talking Head Models )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
3 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 119 · with a code link: 51 · where Syntology ran a sample: 11 (9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (11 of 119 tagged: 9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 119, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
20 May 2019 6 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)In order to create a personalized talking head model, these works require training on a large dataset of images of a single person.
-
23 Aug 2020 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)However, they fail to accurately morph the lip movements of arbitrary identities in dynamic, unconstrained talking face videos, resulting in significant parts of the video being out-of-sync with the new audio.
-
27 Apr 2020 3 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)We present a method that generates expressive talking heads from a single facial image with audio as the only input.
-
22 Nov 2022 2 repositories listedWe present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation.
-
23 Jun 2025 1 repository listedTalking Head Generation (THG) has emerged as a transformative technology in computer vision, enabling the synthesis of realistic human faces synchronized with image, audio, text, or video inputs.
-
2 Jun 2025 1 repository listedAdvances in talking-head animation based on Latent Diffusion Models (LDM) enable the creation of highly realistic, synchronized videos.
-
3 Apr 2025 1 repository listedTo this end, we introduce ACTalker, an end-to-end video diffusion framework that supports both multi-signals control and single-signal control for talking head video generation.
-
27 Feb 2025 1 repository listedTo fully exploit the universal motion priors to learn an unseen new identity, we then present a Motion-Aligned Adaptation strategy to adaptively align the target head to the pre-trained field, and constrain a robust…
-
18 Dec 2024 1 repository listedRecent advances in co-speech gesture and talking head generation have been impressive, yet most methods focus on only one of the two tasks.
-
12 Dec 2024 1 repository listedAudio-driven talking head generation necessitates seamless integration of audio and visual data amidst the challenges posed by diverse input portraits and intricate correlations between audio and facial motions.
-
20 Nov 2024 1 repository listedThis paper examines the integration of real-time talking-head generation for interviewer training, focusing on overcoming challenges in Audio Feature Extraction (AFE), which often introduces latency and limits…
-
17 Oct 2024 1 repository listedTo address these challenges, we present DAWN (Dynamic frame Avatar With Non-autoregressive diffusion), a framework that enables all-at-once generation of dynamic-length video sequences.
-
14 Oct 2024 1 repository listedOur extensive evaluation shows our approach performs favorably compared to fixed topology techniques, setting a new benchmark by offering a versatile and high-fidelity solution for 3D talking head generation.
-
11 Sep 2024 1 repository listedIn response to this challenge, we propose EMOdiffhead, a novel method for emotional talking head video generation that not only enables fine-grained control of emotion categories and intensities but also enables…
-
28 Mar 2024 1 repository listedAToM excels in capturing subtle lip movements by leveraging an audio attention mechanism.
-
23 Mar 2024 1 repository listedIn this work, we propose an adaptive high-quality talking-head video generation method, which synthesizes high-resolution video without additional pre-trained modules.
-
19 Mar 2024 1 repository listedThe domain of 3D talking head generation has witnessed significant progress in recent years.
-
11 Mar 2024 1 repository listedHowever, performance evaluation research lags behind the development of talking head generation techniques.
-
15 Dec 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)To more conveniently specify personalized emotions, a diffusion-based style predictor is utilized to predict the personalized emotion directly from the audio, eliminating the need for extra emotion reference.
-
29 Nov 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)A lifelike talking head requires synchronized coordination of subject identity, lip movements, facial expressions, and head poses.
-
3 Nov 2023 1 repository listedOur rigorous experiments comprehensively highlight that our ground-breaking approach outpaces existing methods with considerable margins and delivers seamless, intelligible videos in person-generic and multilingual…
-
10 Sep 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)Audio-driven talking-head synthesis is a popular research topic for virtual human-related applications.
-
12 Aug 2023 1 repository listedIn the second stage, an audio-driven talking head generation method is employed to produce compelling videos privided the audio generated in the first stage.
-
19 Jul 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)Talking head video generation aims to animate a human face in a still image with dynamic poses and expressions using motion information derived from a target-driving video, while maintaining the person's identity in the…
-
4 Jul 2023 1 repository listedAnimating still face images with deep generative models using a speech input signal is an active research topic and has seen important recent progress.
-
2 Jun 2023 1 repository listedThis paper presents a novel approach for generating 3D talking heads from raw audio inputs.
-
22 May 2023 1 repository listedIt is a large-scale digital library for head avatars with three key attributes: 1) High Fidelity: all subjects are captured by 60 synchronized, high-resolution 2K cameras in 360 degrees.
-
10 May 2023 1 repository listedIn this work, firstly, we present a novel self-supervised method for learning dense 3D facial geometry (ie, depth) from face videos, without requiring camera parameters and 3D geometry annotations in training.
-
6 Apr 2023 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 2 pointer-only (licence)Face animation has achieved much progress in computer vision.
-
21 Mar 2023 1 repository listedTo mitigate this, we build a talking face generation framework conditioned on a categorical emotion to generate videos with appropriate expressions, making them more realistic and convincing.
-
14 Mar 2023 1 repository listed
-
10 Jan 2023 1 repository listed
-
3 Jan 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
15 Dec 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
2 Nov 2022 1 repository listed
-
24 Jul 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
26 Jun 2022 1 repository listed
-
13 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
15 Dec 2021 1 repository listed
-
15 Nov 2021 1 repository listed
-
22 Sep 2021 1 repository listed
-
20 Jul 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 5 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
26 Jun 2021 1 repository listed
-
16 Apr 2021 1 repository listed
-
24 Aug 2020 1 repository listed
-
1 Aug 2020 1 repository listed
-
16 Jul 2020 1 repository listed
-
7 May 2020 1 repository listed
-
11 Dec 2019 1 repository listed
-
4 Jun 2019 1 repository listed
-
29 Jul 2018 1 repository listed
-
MEDTalk: Multimodal Controlled 3D Facial Animation with Dynamic Emotions by Disentangled Embedding8 Jul 2025 0 repositories listed
-
DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversations23 May 2025 0 repositories listed
-
KeySync: A Robust Approach for Leakage-free Lip Synchronization in High Resolution1 May 2025 0 repositories listed
-
OmniTalker: Real-Time Text-Driven Talking Head Generation with In-Context Audio-Visual Style Replication3 Apr 2025 0 repositories listed
-
Audio-Plane: Audio Factorization Plane Gaussian Splatting for Real-Time Talking Head Synthesis28 Mar 2025 0 repositories listed
-
Dual Audio-Centric Modality Coupling for Talking Head Generation26 Mar 2025 0 repositories listed
-
Perceptually Accurate 3D Talking Head Generation: New Definitions, Speech-Mesh Representation, and Evaluation Metrics26 Mar 2025 0 repositories listed
-
Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generation24 Mar 2025 0 repositories listed
-
Dimitra: Audio-driven Diffusion model for Expressive Talking Head Generation24 Feb 2025 0 repositories listed
-
VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Control2 Jan 2025 0 repositories listed
-
UniAvatar: Taming Lifelike Audio-Driven Talking Head Generation with Comprehensive Motion and Lighting Control26 Dec 2024 0 repositories listed
-
VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization13 Dec 2024 0 repositories listed
-
IF-MDM: Implicit Face Motion Diffusion Model for High-Fidelity Realtime Talking Head Generation5 Dec 2024 0 repositories listed
-
ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidance23 Nov 2024 0 repositories listed
-
EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusion23 Nov 2024 0 repositories listed
-
LES-Talker: Fine-Grained Emotion Editing for Talking Head Generation in Linear Emotion Space14 Nov 2024 0 repositories listed
-
EmoGene: Audio-Driven Emotional 3D Talking-Head Generation7 Oct 2024 0 repositories listed
-
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details1 Oct 2024 0 repositories listed
-
Learning Frame-Wise Emotion Intensity for Audio-Driven Talking-Head Generation29 Sep 2024 0 repositories listed
-
DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis16 Sep 2024 0 repositories listed
-
DiffTED: One-shot Audio-driven TED Talk Video Generation with Diffusion-based Co-speech Gestures11 Sep 2024 0 repositories listed
-
SVP: Style-Enhanced Vivid Portrait Talking Head Diffusion Model5 Sep 2024 0 repositories listed
-
PoseTalk: Text-and-Audio-based Pose Control and Motion Refinement for One-Shot Talking Head Generation4 Sep 2024 0 repositories listed
-
FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model18 Aug 2024 0 repositories listed
-
Landmark-guided Diffusion Model for High-fidelity and Temporally Coherent Talking Head Generation3 Aug 2024 0 repositories listed
-
GLDiTalker: Speech-Driven 3D Facial Animation with Graph Latent Diffusion Transformer3 Aug 2024 0 repositories listed
-
MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Dataset20 Jun 2024 0 repositories listed
-
NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation17 Jun 2024 0 repositories listed
-
SPEAK: Speech-Driven Pose and Emotion-Adjustable Talking Head Generation12 May 2024 0 repositories listed
-
NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior9 May 2024 0 repositories listed
-
Embedded Representation Learning Network for Animating Styled Video Portrait29 Apr 2024 0 repositories listed
-
EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis2 Apr 2024 0 repositories listed
-
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style11 Mar 2024 0 repositories listed
-
AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis18 Dec 2023 0 repositories listed
-
VectorTalker: SVG Talking Face Generation with Progressive Vectorisation18 Dec 2023 0 repositories listed
-
PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal Features5 Dec 2023 0 repositories listed
-
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior4 Dec 2023 0 repositories listed
-
LaughTalk: Expressive 3D Talking Head Generation with Laughter2 Nov 2023 0 repositories listed
-
OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions28 Sep 2023 0 repositories listed
-
RADIO: Reference-Agnostic Dubbing Video Synthesis5 Sep 2023 0 repositories listed
-
From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023 0 repositories listed
-
Hierarchical Semantic Perceptual Listener Head Video Generation: A High-performance Pipeline19 Jul 2023 0 repositories listed
-
Interactive Conversational Head Generation5 Jul 2023 0 repositories listed
-
Emotional Talking Head Generation based on Memory-Sharing and Attention-Augmented Networks6 Jun 2023 0 repositories listed
-
High-Fidelity and Freely Controllable Talking Head Video Generation20 Apr 2023 0 repositories listed
-
One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Field11 Apr 2023 0 repositories listed
-
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles1 Apr 2023 0 repositories listed
-
FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions31 Mar 2023 0 repositories listed
-
OPT: One-shot Pose-Controllable Talking Head Generation16 Feb 2023 0 repositories listed
Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections