{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/scaledepth-decomposing-metric-depth","title":"ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation","arxiv_id":"2407.08187","date":"2024-07-11","proceeding":null,"authors":["Ruijie Zhu","Chuxin Wang","Ziyang Song","Li Liu","Tianzhu Zhang","Yongdong Zhang"],"abstract":"Estimating depth from a single image is a challenging visual task. Compared to relative depth estimation, metric depth estimation attracts more attention due to its practical physical significance and critical applications in real-life scenarios. However, existing metric depth estimation methods are typically trained on specific datasets with similar scenes, facing challenges in generalizing across scenes with significant scale variations. To address this challenge, we propose a novel monocular depth estimation method called ScaleDepth. Our method decomposes metric depth into scene scale and relative depth, and predicts them through a semantic-aware scale prediction (SASP) module and an adaptive relative depth estimation (ARDE) module, respectively. The proposed ScaleDepth enjoys several merits. First, the SASP module can implicitly combine structural and semantic features of the images to predict precise scene scales. Second, the ARDE module can adaptively estimate the relative depth distribution of each image within a normalized depth space. Third, our method achieves metric depth estimation for both indoor and outdoor scenes in a unified framework, without the need for setting the depth range or fine-tuning model. Extensive experiments demonstrate that our method attains state-of-the-art performance across indoor, outdoor, unconstrained, and unseen scenes. Project page: https://ruijiezhu94.github.io/ScaleDepth","url_abs":"https://arxiv.org/abs/2407.08187v1","url_pdf":"https://arxiv.org/pdf/2407.08187v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"scaledepth-decomposing-metric-depth","repo_url":"https://github.com/RuijieZhu94/mmdepth/blob/main/projects/ScaleDepth/README.md","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"depth-estimation","task_name":"Depth Estimation"},{"task_slug":"monocular-depth-estimation","task_name":"Monocular Depth Estimation"}],"methods":[{"method_slug":"attention","method_name":"Attention"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/monocular-depth-estimation-on-ddad","task":"Monocular Depth Estimation","dataset":"DDAD","model":"ScaleDepth-NK","rank_in_archive_order":2,"of":4,"metrics":{"Delta < 1.25":"0.871","RMSE":"6.097","absolute relative error":"0.121"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-diml-outdoor","task":"Monocular Depth Estimation","dataset":"DIML Outdoor","model":"ScaleDepth-NK","rank_in_archive_order":1,"of":1,"metrics":{"Delta < 1.25":"0.058","RMSE":"4.344","absolute relative error":"1.007"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-diode-indoor","task":"Monocular Depth Estimation","dataset":"DIODE Indoor","model":"ScaleDepth-NK","rank_in_archive_order":1,"of":1,"metrics":{"Delta < 1.25":"0.447","RMSE":"1.443","absolute relative error":"0.355"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-diode-outdoor","task":"Monocular Depth Estimation","dataset":"DIODE Outdoor","model":"ScaleDepth-NK","rank_in_archive_order":1,"of":1,"metrics":{"Delta < 1.25":"0.262","RMSE":"8.632","absolute relative error":"0.562"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-hypersim","task":"Monocular Depth Estimation","dataset":"Hypersim","model":"ScaleDepth-NK","rank_in_archive_order":1,"of":1,"metrics":{"Delta < 1.25":"0.413","RMSE":"4.825","absolute relative error":"0.381"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-ibims-1","task":"Monocular Depth Estimation","dataset":"IBims-1","model":"ScaleDepth-NK","rank_in_archive_order":3,"of":4,"metrics":{"RMSE":"0.59","absolute relative error":"0.164","δ1.25":"0.778"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-kitti-eigen","task":"Monocular Depth Estimation","dataset":"KITTI Eigen split","model":"ScaleDepth-K","rank_in_archive_order":13,"of":79,"metrics":{"Delta < 1.25":"0.98","Delta < 1.25^2":"0.998","Delta < 1.25^3":"1.000","RMSE":"1.987","RMSE log":"0.073","Sq Rel":"0.136","absolute relative error":"0.048"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-nyu-depth-v2","task":"Monocular Depth Estimation","dataset":"NYU-Depth V2","model":"ScaleDepth-N","rank_in_archive_order":24,"of":85,"metrics":{"Delta < 1.25":"0.957","Delta < 1.25^2":"0.994","Delta < 1.25^3":"0.999","RMSE":"0.267","absolute relative error":"0.074","log 10":"0.032"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-sun-rgbd","task":"Monocular Depth Estimation","dataset":"SUN-RGBD","model":"ScaleDepth-NK","rank_in_archive_order":2,"of":3,"metrics":{"Delta < 1.25":"0.866","RMSE":"0.359","absolute relative error":"0.129"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-depth-estimation-on-virtual-kitti-2","task":"Monocular Depth Estimation","dataset":"Virtual KITTI 2","model":"ScaleDepth-NK","rank_in_archive_order":1,"of":1,"metrics":{"Delta < 1.25":"0.834","RMSE":"4.747","absolute relative error":"0.12"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.08187","atlas_url":"https://app.syntology.ai/?focus=2407.08187","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2407.08187"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2407.08187\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2407.08187"},"call":"get_concepts_for_paper(arxiv_id=\"2407.08187\")"}],"by_repo":[{"repo":"RuijieZhu94/mmdepth","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"b0f3bd6981c26a6f73eaa4ef1d902964564f83d5a4782b1763aaf222857c0a9b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}