{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/progeo-generating-prompts-through-image-text","title":"ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localization","arxiv_id":"2406.01906","date":"2024-06-04","proceeding":null,"authors":["Chen Mao","Jingqi Hu"],"abstract":"Visual Geo-localization (VG) refers to the process to identify the location described in query images, which is widely applied in robotics field and computer vision tasks, such as autonomous driving, metaverse, augmented reality, and SLAM. In fine-grained images lacking specific text descriptions, directly applying pure visual methods to represent neighborhood features often leads to the model focusing on overly fine-grained features, unable to fully mine the semantic information in the images. Therefore, we propose a two-stage training method to enhance visual performance and use contrastive learning to mine challenging samples. We first leverage the multi-modal description capability of CLIP (Contrastive Language-Image Pretraining) to create a set of learnable text prompts for each geographic image feature to form vague descriptions. Then, by utilizing dynamic text prompts to assist the training of the image encoder, we enable the image encoder to learn better and more generalizable visual features. This strategy of applying text to purely visual tasks addresses the challenge of using multi-modal models for geographic images, which often suffer from a lack of precise descriptions, making them difficult to utilize widely. We validate the effectiveness of the proposed strategy on several large-scale visual geo-localization datasets, and our method achieves competitive results on multiple visual geo-localization datasets. Our code and model are available at https://github.com/Chain-Mao/ProGEO.","url_abs":"https://arxiv.org/abs/2406.01906v1","url_pdf":"https://arxiv.org/pdf/2406.01906v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"progeo-generating-prompts-through-image-text","repo_url":"https://github.com/chain-mao/progeo","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"visual-place-recognition","task_name":"Visual Place Recognition"},{"task_slug":"geo-localization","task_name":"geo-localization"}],"methods":[{"method_slug":"clip","method_name":"CLIP"},{"method_slug":"contrastive-learning","method_name":"Contrastive Learning"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/visual-place-recognition-on-msls","task":"Visual Place Recognition","dataset":"MSLS","model":"ProGEO","rank_in_archive_order":1,"of":3,"metrics":{"Recall@1":"84.9","Recall@5":"91.6"},"uses_additional_data":true},{"leaderboard":"/sota/visual-place-recognition-on-pittsburgh-250k","task":"Visual Place Recognition","dataset":"Pittsburgh-250k-test","model":"ProGEO","rank_in_archive_order":11,"of":13,"metrics":{"Recall@1":"92.2","Recall@5":"97.7"},"uses_additional_data":true},{"leaderboard":"/sota/visual-place-recognition-on-pittsburgh-30k","task":"Visual Place Recognition","dataset":"Pittsburgh-30k-test","model":"ProGEO","rank_in_archive_order":9,"of":22,"metrics":{"Recall@1":"93.0","Recall@5":"98.3"},"uses_additional_data":true},{"leaderboard":"/sota/visual-place-recognition-on-sf-xl-test-v1","task":"Visual Place Recognition","dataset":"SF-XL test v1","model":"ProGEO","rank_in_archive_order":3,"of":5,"metrics":{"Recall@1":"84.7","Recall@5":"90.3"},"uses_additional_data":false},{"leaderboard":"/sota/visual-place-recognition-on-sf-xl-test-v2","task":"Visual Place Recognition","dataset":"SF-XL test v2","model":"ProGEO","rank_in_archive_order":3,"of":5,"metrics":{"Recall@1":"93.0","Recall@5":"96.7"},"uses_additional_data":false},{"leaderboard":"/sota/visual-place-recognition-on-st-lucia","task":"Visual Place Recognition","dataset":"St Lucia","model":"ProGEO","rank_in_archive_order":6,"of":14,"metrics":{"Recall@1":"99.7","Recall@5":"99.9"},"uses_additional_data":true},{"leaderboard":"/sota/visual-place-recognition-on-tokyo247","task":"Visual Place Recognition","dataset":"Tokyo247","model":"ProGEO","rank_in_archive_order":10,"of":14,"metrics":{"Recall@1":"88.6","Recall@5":"93.3"},"uses_additional_data":true}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"chain-mao/progeo","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2717cf066b09f1dc299d957eff56f3093b27862a44e18043d28c73b0bc4d2afd","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}