{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/seeing-through-fog-without-seeing-fog-deep","title":"Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather","arxiv_id":"1902.08913","date":"2019-02-24","proceeding":"CVPR 2020 6","authors":["Mario Bijelic","Tobias Gruber","Fahim Mannan","Florian Kraus","Werner Ritter","Klaus Dietmayer","Felix Heide"],"abstract":"The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit redundant information in good environmental conditions, they fail in adverse weather where the sensory streams can be asymmetrically distorted. These rare \"edge-case\" scenarios are not represented in available datasets, and existing fusion architectures are not designed to handle them. To address this challenge we present a novel multimodal dataset acquired in over 10,000km of driving in northern Europe. Although this dataset is the first large multimodal dataset in adverse weather, with 100k labels for lidar, camera, radar, and gated NIR sensors, it does not facilitate training as extreme weather is rare. To this end, we present a deep fusion network for robust fusion without a large corpus of labeled training data covering all asymmetric distortions. Departing from proposal-level fusion, we propose a single-shot model that adaptively fuses features, driven by measurement entropy. We validate the proposed method, trained on clean data, on our extensive validation dataset. Code and data are available here https://github.com/princeton-computational-imaging/SeeingThroughFog.","url_abs":"https://arxiv.org/abs/1902.08913v3","url_pdf":"https://arxiv.org/pdf/1902.08913v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"seeing-through-fog-without-seeing-fog-deep","repo_url":"https://github.com/princeton-computational-imaging/SeeingThroughFog","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":"2d-object-detection","task_name":"2D Object Detection"},{"task_slug":"autonomous-vehicles","task_name":"Autonomous Vehicles"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"sensor-fusion","task_name":"Sensor Fusion"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[{"slug":"clear-weather","name":"Clear Weather","full_name":"DENSE"},{"slug":"stf","name":"Dense Fog","full_name":"DENSE"},{"slug":"stf-heavy-snow","name":"Heavy Snowfall","full_name":"DENSE"},{"slug":"stf-light-snowfall","name":"Light Snowfall","full_name":"DENSE"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/2d-object-detection-on-clear-weather","task":"2D Object Detection","dataset":"Clear Weather","model":"Deep Entropy Fusion","rank_in_archive_order":2,"of":2,"metrics":{"clear hard (AP)":"79.46"},"uses_additional_data":false},{"leaderboard":"/sota/2d-object-detection-on-dense-fog","task":"2D Object Detection","dataset":"Dense Fog","model":"Deep Entropy Fusion","rank_in_archive_order":2,"of":2,"metrics":{"dense fog hard (AP)":"76.69","light fog hard (AP)":"84.9","snow/rain hard (AP)":"77.85"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1902.08913","atlas_url":"https://app.syntology.ai/?focus=1902.08913","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1902.08913"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1902.08913\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1902.08913"},"call":"get_concepts_for_paper(arxiv_id=\"1902.08913\")"}],"by_repo":[{"repo":"princeton-computational-imaging/SeeingThroughFog","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"c00997f1d3103d5de3548bb48993871bb00373792bc3a2ed3f52fda33f07d972","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}