{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/target-aware-dual-adversarial-learning-and-a","title":"Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection","arxiv_id":"2203.16220","date":"2022-03-30","proceeding":"CVPR 2022 1","authors":["JinYuan Liu","Xin Fan","Zhanbo Huang","Guanyao Wu","Risheng Liu","Wei Zhong","Zhongxuan Luo"],"abstract":"This study addresses the issue of fusing infrared and visible images that appear differently for object detection. Aiming at generating an image of high visual quality, previous approaches discover commons underlying the two modalities and fuse upon the common space either by iterative optimization or deep networks. These approaches neglect that modality differences implying the complementary information are extremely important for both fusion and subsequent detection task. This paper proposes a bilevel optimization formulation for the joint problem of fusion and detection, and then unrolls to a target-aware Dual Adversarial Learning (TarDAL) network for fusion and a commonly used detection network. The fusion network with one generator and dual discriminators seeks commons while learning from differences, which preserves structural information of targets from the infrared and textural details from the visible. Furthermore, we build a synchronized imaging system with calibrated infrared and optical sensors, and collect currently the most comprehensive benchmark covering a wide range of scenarios. Extensive experiments on several public datasets and our benchmark demonstrate that our method outputs not only visually appealing fusion but also higher detection mAP than the state-of-the-art approaches.","url_abs":"https://arxiv.org/abs/2203.16220v1","url_pdf":"https://arxiv.org/pdf/2203.16220v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"target-aware-dual-adversarial-learning-and-a","repo_url":"https://github.com/dlut-dimt/tardal","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"target-aware-dual-adversarial-learning-and-a","repo_url":"https://github.com/JinyuanLiu-CV/TarDAL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"2d-object-detection","task_name":"2D Object Detection"},{"task_slug":"bilevel-optimization","task_name":"Bilevel Optimization"},{"task_slug":"infrared-and-visible-image-fusion","task_name":"Infrared And Visible Image Fusion"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/2d-object-detection-on-dronevehicle","task":"2D Object Detection","dataset":"DroneVehicle","model":"TarDAL","rank_in_archive_order":4,"of":11,"metrics":{"test/mAP":"43.3","test/mAP50":"72.6"},"uses_additional_data":false},{"leaderboard":"/sota/object-detection-on-india-driving-dataset","task":"Object Detection","dataset":"India Driving Dataset","model":"","rank_in_archive_order":4,"of":4,"metrics":{"mAP@0.5":"81.1"},"uses_additional_data":false},{"leaderboard":"/sota/object-detection-on-multispectral-dataset","task":"Object Detection","dataset":"Multispectral Dataset","model":"TarDAL","rank_in_archive_order":1,"of":1,"metrics":{"mAP@0.5":"78"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-fmb-dataset","task":"Semantic Segmentation","dataset":"FMB Dataset","model":"TarDAL (RGB-Infrared)","rank_in_archive_order":12,"of":14,"metrics":{"mIoU":"48.10"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.16220","atlas_url":"https://app.syntology.ai/?focus=2203.16220","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2203.16220"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2203.16220\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2203.16220"},"call":"get_concepts_for_paper(arxiv_id=\"2203.16220\")"}],"by_repo":[{"repo":"dlut-dimt/tardal","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"JinyuanLiu-CV/TarDAL","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"9cec2b5f8371046e40387a1ee157056252cb60d2c704131b580ee00b6b742e5a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}