{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/joint-representation-learning-and-keypoint","title":"Joint Representation Learning and Keypoint Detection for Cross-view Geo-localization","arxiv_id":null,"date":"2022-05-15","proceeding":"IEEE Transactions on Image Processing (TIP) 2022 5","authors":["Jinliang Lin","Zhedong Zheng","Zhun Zhong","Zhiming Luo","Shaozi Li","Yi Yang","Nicu Sebe"],"abstract":"In this paper, we study the cross-view geo-localization problem to match images from different viewpoints. The key motivation underpinning this task is to learn a discriminative viewpoint-invariant visual representation. Inspired by the human visual system for mining local patterns, we propose a new framework called RK-Net to jointly learn the discriminative Representation and detect salient Keypoints with a single Network. Specifically, we introduce a Unit Subtraction Attention Module (USAM) that can automatically discover representative keypoints from feature maps and draw attention to the salient regions. USAM contains very few learning parameters but yields significant performance improvement and can be easily plugged into different networks. We demonstrate through extensive experiments that (1) by incorporating USAM, RK-Net facilitates end-to-end joint learning without the prerequisite of extra annotations. Representation learning and keypoint detection are two highly-related tasks. Representation learning aids keypoint detection. Keypoint detection, in turn, enriches the model capability against large appearance changes caused by viewpoint variants.  (2) USAM is easy to implement and can be integrated with existing methods, further improving the state-of-the-art performance. We achieve competitive geo-localization accuracy on three challenging datasets, i.e., University-1652, CVUSA and CVACT. Our code is available at https://github.com/AggMan96/RK-Net.","url_abs":"https://zhunzhong.site/paper/RK_Net.pdf","url_pdf":"https://zhunzhong.site/paper/RK_Net.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"joint-representation-learning-and-keypoint","repo_url":"https://github.com/AggMan96/RK-Net","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"drone-navigation","task_name":"Drone navigation"},{"task_slug":"drone-view-target-localization","task_name":"Drone-view target localization"},{"task_slug":"image-based-localization","task_name":"Image-Based Localization"},{"task_slug":"keypoint-detection","task_name":"Keypoint Detection"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"geo-localization","task_name":"geo-localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/drone-navigation-on-university-1652-1","task":"Drone navigation","dataset":"University-1652","model":"LPN + USAM","rank_in_archive_order":2,"of":6,"metrics":{"AP":"75.96","Recall@1":"86.59"},"uses_additional_data":false},{"leaderboard":"/sota/drone-navigation-on-university-1652-1","task":"Drone navigation","dataset":"University-1652","model":"SAFA + USAM","rank_in_archive_order":4,"of":6,"metrics":{"AP":"71.77","Recall@1":"83.23"},"uses_additional_data":false},{"leaderboard":"/sota/drone-navigation-on-university-1652-1","task":"Drone navigation","dataset":"University-1652","model":"RK-Net","rank_in_archive_order":5,"of":6,"metrics":{"AP":"65.76","Recall@1":"80.17"},"uses_additional_data":false},{"leaderboard":"/sota/drone-view-target-localization-on-university-1","task":"Drone-view target localization","dataset":"University-1652","model":"LPN + USAM","rank_in_archive_order":6,"of":11,"metrics":{"AP":"80.55","Recall@1":"77.60"},"uses_additional_data":false},{"leaderboard":"/sota/drone-view-target-localization-on-university-1","task":"Drone-view target localization","dataset":"University-1652","model":"SAFA + USAM","rank_in_archive_order":8,"of":11,"metrics":{"AP":"75.79","Recall@1":"72.19"},"uses_additional_data":false},{"leaderboard":"/sota/drone-view-target-localization-on-university-1","task":"Drone-view target localization","dataset":"University-1652","model":"RK-Net","rank_in_archive_order":10,"of":11,"metrics":{"AP":"70.23","Recall@1":"66.13"},"uses_additional_data":false},{"leaderboard":"/sota/image-based-localization-on-cvact","task":"Image-Based Localization","dataset":"cvact","model":"RK-Net","rank_in_archive_order":7,"of":8,"metrics":{"Recall@1":"40.53","Recall@1 (%)":"89.12"},"uses_additional_data":false},{"leaderboard":"/sota/image-based-localization-on-cvact","task":"Image-Based Localization","dataset":"cvact","model":"Instance Loss","rank_in_archive_order":8,"of":8,"metrics":{"Recall@1":"35.24","Recall@1 (%)":"87.34"},"uses_additional_data":false},{"leaderboard":"/sota/image-based-localization-on-cvusa-1","task":"Image-Based Localization","dataset":"cvusa","model":"RK-Net","rank_in_archive_order":7,"of":8,"metrics":{"Recall@1":"52.50","Recall@top1%":"96.52"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"no_arxiv_id","checked_against":null,"by_repo":[{"repo":"AggMan96/RK-Net","kind":"named_in_paper","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"97f283b12e072d5c030a278e64c2b6d929a45f655047ac991cf4a25b2da63362","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}