Papers › 3D Face Reconstruction with the Geometric Guidance of Facial Part Segmentation

3D Face Reconstruction with the Geometric Guidance of Facial Part Segmentation

1 Dec 2023CVPR 2024 1arXiv:2312.00311archive 2025-07-28

Zidu Wang, Xiangyu Zhu, Tianshuo Zhang, Baiqin Wang, Zhen Lei

3D Morphable Models (3DMMs) provide promising 3D face reconstructions in various applications. However, existing methods struggle to reconstruct faces with extreme expressions due to deficiencies in supervisory signals, such as sparse or inaccurate landmarks. Segmentation information contains effective geometric contexts for face reconstruction. Certain attempts intuitively depend on differentiable renderers to compare the rendered silhouettes of reconstruction with segmentation, which is prone to issues like local optima and gradient instability. In this paper, we fully utilize the facial part segmentation geometry by introducing Part Re-projection Distance Loss (PRDL). Specifically, PRDL transforms facial part segmentation into 2D points and re-projects the reconstruction onto the image plane. Subsequently, by introducing grid anchors and computing different statistical distances from these anchors to the point sets, PRDL establishes geometry descriptors to optimize the distribution of the point sets for face reconstruction. PRDL exhibits a clear gradient compared to the renderer-based methods and presents state-of-the-art reconstruction performance in extensive quantitative and qualitative experiments. Our project is available at https://github.com/wang-zidu/3DDFA-V3 .

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

wang-zidu/3ddfa-v3 officialmentioned in papermentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Searching for MobileNetV3 (arXiv:1905.02244; that paper's own run record: 86 ran (of which 22 constructed an object rather than computing a result; 75 with no instrument failure: 9 honoured, 2 violated, 64 with no contract checked; 11 where Syntology's instrument failed) · 19 unverified) and CVF open access id Wang_3D_Face_Reconstruction_with_the_Geometric_Guidance_of_Facial_Part_CVPR_2024_paper (that paper's own run record: 19 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
wang-zidu/s2td-face mentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Face ReconstructionFace ReconstructionSegmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Face Reconstruction REALY 3DDFA-v3 @cheek 1.110 (±0.328) #4 of 24 Archive leaderboard report
3D Face Reconstruction REALY 3DDFA-v3 @forehead 1.809 (±0.394) #4 of 24 Archive leaderboard report
3D Face Reconstruction REALY 3DDFA-v3 @mouth 1.237 (±0.375) #4 of 24 Archive leaderboard report
3D Face Reconstruction REALY 3DDFA-v3 @nose 1.584 (±0.308) #4 of 24 Archive leaderboard report
3D Face Reconstruction REALY 3DDFA-v3 all 1.435 #4 of 24 Archive leaderboard report
3D Face Reconstruction REALY (side-view) 3DDFA-v3 @cheek 1.073 (±0.316) #3 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) 3DDFA-v3 @forehead 1.861 (±0.421) #3 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) 3DDFA-v3 @mouth 1.209 (±0.369) #3 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) 3DDFA-v3 @nose 1.621 (±0.312) #3 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) 3DDFA-v3 all 1.441 #3 of 19 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections