{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/holistic-3d-scene-understanding-from-a-single-1","title":"Holistic 3D Scene Understanding from a Single Image with Implicit Representation","arxiv_id":"2103.06422","date":"2021-03-11","proceeding":"CVPR 2021 1","authors":["Cheng Zhang","Zhaopeng Cui","yinda zhang","Bing Zeng","Marc Pollefeys","Shuaicheng Liu"],"abstract":"We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer from inaccurate estimation of both shapes and layout especially for the cluttered scene due to the heavy occlusion between objects. We propose to utilize the latest deep implicit representation to solve this challenge. We not only propose an image-based local structured implicit network to improve the object shape estimation, but also refine the 3D object pose and scene layout via a novel implicit scene graph neural network that exploits the implicit local object features. A novel physical violation loss is also proposed to avoid incorrect context between objects. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods in terms of object shape, scene layout estimation, and 3D object detection.","url_abs":"https://arxiv.org/abs/2103.06422v3","url_pdf":"https://arxiv.org/pdf/2103.06422v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"holistic-3d-scene-understanding-from-a-single-1","repo_url":"https://github.com/chengzhag/Implicit3DUnderstanding","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"3d-shape-reconstruction","task_name":"3D Shape Reconstruction"},{"task_slug":"graph-neural-network","task_name":"Graph Neural Network"},{"task_slug":"monocular-3d-object-detection","task_name":"Monocular 3D Object Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"room-layout-estimation","task_name":"Room Layout Estimation"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"graph-neural-network","method_name":"Graph Neural Network"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-shape-reconstruction-on-pix3d","task":"3D Shape Reconstruction","dataset":"Pix3D","model":"IM3D","rank_in_archive_order":1,"of":5,"metrics":{"CD":"0.0672","EMD":"N/A","IoU":"N/A"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-3d-object-detection-on-sun-rgb-d","task":"Monocular 3D Object Detection","dataset":"SUN RGB-D","model":"IM3D","rank_in_archive_order":1,"of":7,"metrics":{"AP@0.15 (10 / NYU-37)":"45.21","AP@0.15 (NYU-37)":"24.10"},"uses_additional_data":true},{"leaderboard":"/sota/room-layout-estimation-on-sun-rgb-d","task":"Room Layout Estimation","dataset":"SUN RGB-D","model":"IM3D","rank_in_archive_order":1,"of":7,"metrics":{"Camera Pitch":"2.98","Camera Roll":"2.11","IoU":"64.4"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2103.06422","atlas_url":"https://app.syntology.ai/?focus=2103.06422","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2103.06422"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2103.06422\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2103.06422"},"call":"get_concepts_for_paper(arxiv_id=\"2103.06422\")"}],"by_repo":[{"repo":"chengzhag/Implicit3DUnderstanding","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"aa333d0601707c7e538627480c3dc2760fe1c2989b848ae3ed072053d2f0e00a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}