Papers › Learning a model of facial shape and expression from 4D scans

Learning a model of facial shape and expression from 4D scans

1 Nov 2017SIGGRAPH Asia 2017 11archive 2025-07-28

Tianye Li, Timo Bolkart, Michael J. Black, Hao Li, Javier Romero

he field of 3D face modeling has a large gap between high-end and low-end methods. At the high end, the best facial animation is indistinguishablefrom real humans, but this comes at the cost of extensive manual labor. At the low end, face capture from consumer depth sensors relies on 3D face models that are not expressive enough to capture the variability in natural facial shape and expression. We seek a middle ground by learning a facial model from thousands of accurately aligned 3D scans. Our FLAME model (Faces Learned with an Articulated Model and Expressions) is designed to work with existing graphics software and be easy to fit to data. FLAME uses a linear shape space trained from 3800 scans of human heads. FLAME combines this linear shape space with an articulated jaw, neck, and eyeballs, pose-dependent corrective blendshapes, and additional global expression blendshapes. The pose and expression dependent articulations are learned from 4D face sequences in the D3DFACS dataset along with additional 4D sequences. We accurately register a template mesh to the scan sequences and make the D3DFACS registrations available for research purposes. In total the model is trained from over 33, 000 scans. FLAME is low-dimensional but more expressive than the FaceWarehouse model and the Basel Face Model. We compare FLAME to these models by fitting them to static 3D scans and 4D sequences using the same optimization method. FLAME is significantly more accurate and is available for research purposes.

PaperPDFCode

Syntology This paper has no arXiv id in the archive, and this site joins papers to Syntology's graph by arXiv id, so this page does not say whether the graph holds it.

Code

Rubikplayer/flame-fitting officialtfSyntology: not harvested report
HavenFeng/photometric_optimization pytorchSyntology: not harvested report
TimoBolkart/BFM_to_FLAME tfSyntology: not harvested report
TimoBolkart/FLAME-Blender-Add-on Syntology: not harvested report
TimoBolkart/FLAME-Universe pytorchSyntology: not harvested report
TimoBolkart/TF_FLAME tfSyntology: not harvested report
YadiraF/DECA pytorchSyntology: not harvested report
soubhiksanyal/FLAME_PyTorch pytorchSyntology: not harvested report
soubhiksanyal/RingNet tfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision (arXiv:1905.06817; that paper's own run record: 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Face Animation3D Face Modelling3D Face ReconstructionFace AlignmentFace GenerationFace Model

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Face Reconstruction NoW Benchmark FLAME template Mean Reconstruction Error (mm) 1.53 #9 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark FLAME template Median Reconstruction Error 1.21 #9 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark FLAME template Stdev Reconstruction Error (mm) 1.31 #9 of 17 Archive leaderboard report
Face Alignment FaceScape FLAME NME 0.341 #3 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections