{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/smpler-x-scaling-up-expressive-human-pose-and","title":"SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation","arxiv_id":"2309.17448","date":"2023-09-29","proceeding":"NeurIPS 2023 11","authors":["Zhongang Cai","Wanqi Yin","Ailing Zeng","Chen Wei","Qingping Sun","Yanjun Wang","Hui En Pang","Haiyi Mei","Mingyuan Zhang","Lei Zhang","Chen Change Loy","Lei Yang","Ziwei Liu"],"abstract":"Expressive human pose and shape estimation (EHPS) unifies body, hands, and face motion capture with numerous applications. Despite encouraging progress, current state-of-the-art methods still depend largely on a confined set of training datasets. In this work, we investigate scaling up EHPS towards the first generalist foundation model (dubbed SMPLer-X), with up to ViT-Huge as the backbone and training with up to 4.5M instances from diverse data sources. With big data and the large model, SMPLer-X exhibits strong performance across diverse test benchmarks and excellent transferability to even unseen environments. 1) For the data scaling, we perform a systematic investigation on 32 EHPS datasets, including a wide range of scenarios that a model trained on any single dataset cannot handle. More importantly, capitalizing on insights obtained from the extensive benchmarking process, we optimize our training scheme and select datasets that lead to a significant leap in EHPS capabilities. 2) For the model scaling, we take advantage of vision transformers to study the scaling law of model sizes in EHPS. Moreover, our finetuning strategy turn SMPLer-X into specialist models, allowing them to achieve further performance boosts. Notably, our foundation model SMPLer-X consistently delivers state-of-the-art results on seven benchmarks such as AGORA (107.2 mm NMVE), UBody (57.4 mm PVE), EgoBody (63.6 mm PVE), and EHF (62.3 mm PVE without finetuning). Homepage: https://caizhongang.github.io/projects/SMPLer-X/","url_abs":"https://arxiv.org/abs/2309.17448v3","url_pdf":"https://arxiv.org/pdf/2309.17448v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"smpler-x-scaling-up-expressive-human-pose-and","repo_url":"https://github.com/caizhongang/SMPLer-X","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"smpler-x-scaling-up-expressive-human-pose-and","repo_url":"https://github.com/wqyin/smplest-x","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"3d-human-pose-estimation","task_name":"3D Human Pose Estimation"},{"task_slug":"3d-human-reconstruction","task_name":"3D Human Reconstruction"},{"task_slug":"3d-multi-person-mesh-recovery","task_name":"3D Multi-Person Mesh Recovery"},{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-human-pose-estimation-on-3dpw","task":"3D Human Pose Estimation","dataset":"3DPW","model":"SMPLer-X","rank_in_archive_order":116,"of":119,"metrics":{"MPJPE":"75.2"},"uses_additional_data":false},{"leaderboard":"/sota/3d-human-pose-estimation-on-ubody","task":"3D Human Pose Estimation","dataset":"UBody","model":"SMPLer-X","rank_in_archive_order":2,"of":4,"metrics":{"PA-PVE-All":"31.9","PA-PVE-Face":"2.8","PA-PVE-Hands":"10.3","PVE-All":"57.5","PVE-Face":"21.6","PVE-Hands":"40.2"},"uses_additional_data":false},{"leaderboard":"/sota/3d-human-reconstruction-on-ehf","task":"3D Human Reconstruction","dataset":"EHF","model":"SMPLer-X","rank_in_archive_order":2,"of":3,"metrics":{"MPVPE":"62.4","PA V2V (mm), whole body":"37.1"},"uses_additional_data":false},{"leaderboard":"/sota/3d-multi-person-mesh-recovery-on-agora","task":"3D Multi-Person Mesh Recovery","dataset":"AGORA","model":"SMPLer-X","rank_in_archive_order":3,"of":7,"metrics":{"B-NMVE":"68.3","F-MVE":"29.9","FB-MVE":"99.7","FB-NMVE":"107.2","LH/RH-MVE":"39.3"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.17448","atlas_url":"https://app.syntology.ai/?focus=2309.17448","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2309.17448"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2309.17448\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2309.17448"},"call":"get_concepts_for_paper(arxiv_id=\"2309.17448\")"}],"by_repo":[{"repo":"caizhongang/SMPLer-X","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"wqyin/smplest-x","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"aaa1e57b032da5b005d5315120e36190f2a30ceebdb2a3dca73f988ababe4689","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}