{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/revisiting-oxford-and-paris-large-scale-image","title":"Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking","arxiv_id":"1803.11285","date":"2018-03-29","proceeding":"CVPR 2018 6","authors":["Filip Radenović","Ahmet Iscen","Giorgos Tolias","Yannis Avrithis","Ondřej Chum"],"abstract":"In this paper we address issues with image retrieval benchmarking on standard\nand popular Oxford 5k and Paris 6k datasets. In particular, annotation errors,\nthe size of the dataset, and the level of challenge are addressed: new\nannotation for both datasets is created with an extra attention to the\nreliability of the ground truth. Three new protocols of varying difficulty are\nintroduced. The protocols allow fair comparison between different methods,\nincluding those using a dataset pre-processing stage. For each dataset, 15 new\nchallenging queries are introduced. Finally, a new set of 1M hard,\nsemi-automatically cleaned distractors is selected.\n  An extensive comparison of the state-of-the-art methods is performed on the\nnew benchmark. Different types of methods are evaluated, ranging from\nlocal-feature-based to modern CNN based methods. The best results are achieved\nby taking the best of the two worlds. Most importantly, image retrieval appears\nfar from being solved.","url_abs":"http://arxiv.org/abs/1803.11285v1","url_pdf":"http://arxiv.org/pdf/1803.11285v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"revisiting-oxford-and-paris-large-scale-image","repo_url":"https://github.com/tensorflow/models","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"revisiting-oxford-and-paris-large-scale-image","repo_url":"https://github.com/tensorflow/models/tree/master/research/delf","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[{"slug":"roxford","name":"ROxford","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–HQE+SP","rank_in_archive_order":10,"of":23,"metrics":{"mAP":"49.7"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–HQE","rank_in_archive_order":12,"of":23,"metrics":{"mAP":"41.3"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–ASMK*+SP","rank_in_archive_order":14,"of":23,"metrics":{"mAP":"36.7"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–ASMK*","rank_in_archive_order":15,"of":23,"metrics":{"mAP":"36.4 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–SMK*+SP","rank_in_archive_order":16,"of":23,"metrics":{"mAP":"35.8 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–SMK*","rank_in_archive_order":17,"of":23,"metrics":{"mAP":"35.4 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-hard","task":"Image Retrieval","dataset":"ROxford (Hard)","model":"HesAff–rSIFT–VLAD","rank_in_archive_order":22,"of":23,"metrics":{"mAP":"13.2"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–HQE+SP","rank_in_archive_order":9,"of":23,"metrics":{"mAP":"71.3 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–HQE","rank_in_archive_order":11,"of":23,"metrics":{"mAP":"66.3 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–ASMK*+SP","rank_in_archive_order":15,"of":23,"metrics":{"mAP":"60.6"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–ASMK*","rank_in_archive_order":16,"of":23,"metrics":{"mAP":"60.4 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–SMK*+SP","rank_in_archive_order":17,"of":23,"metrics":{"mAP":"59.8 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–SMK*","rank_in_archive_order":18,"of":23,"metrics":{"mAP":"59.4"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium","task":"Image Retrieval","dataset":"ROxford (Medium)","model":"HesAff–rSIFT–VLAD","rank_in_archive_order":23,"of":23,"metrics":{"mAP":"33.9 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-roxford-medium-without","task":"Image Retrieval","dataset":"ROxford Medium without fine-tuning","model":"HesAff–rSIFT–VLAD","rank_in_archive_order":1,"of":1,"metrics":{"Average mAP":"33.9"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–HQE+SP","rank_in_archive_order":15,"of":23,"metrics":{"mAP":"45.1"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–HQE","rank_in_archive_order":17,"of":23,"metrics":{"mAP":"44.7"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–ASMK*+SP","rank_in_archive_order":19,"of":23,"metrics":{"mAP":"35.0"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–ASMK*","rank_in_archive_order":20,"of":23,"metrics":{"mAP":"34.5"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–SMK*+SP","rank_in_archive_order":21,"of":23,"metrics":{"mAP":"31.3 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–SMK*","rank_in_archive_order":22,"of":23,"metrics":{"mAP":"31.2 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-hard","task":"Image Retrieval","dataset":"RParis (Hard)","model":"HesAff–rSIFT–VLAD","rank_in_archive_order":23,"of":23,"metrics":{"mAP":"17.5 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–HQE+SP","rank_in_archive_order":15,"of":23,"metrics":{"mAP":"70.2"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–HQE","rank_in_archive_order":17,"of":23,"metrics":{"mAP":"68.9 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–ASMK*+SP","rank_in_archive_order":19,"of":23,"metrics":{"mAP":"61.4"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–ASMK*","rank_in_archive_order":20,"of":23,"metrics":{"mAP":"61.2 "},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–SMK*+SP","rank_in_archive_order":21,"of":23,"metrics":{"mAP":"59.2"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–SMK*","rank_in_archive_order":22,"of":23,"metrics":{"mAP":"59.0"},"uses_additional_data":false},{"leaderboard":"/sota/image-retrieval-on-rparis-medium","task":"Image Retrieval","dataset":"RParis (Medium)","model":"HesAff–rSIFT–VLAD","rank_in_archive_order":23,"of":23,"metrics":{"mAP":"43.6"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1803.11285","atlas_url":"https://app.syntology.ai/?focus=1803.11285","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1803.11285"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1803.11285\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1803.11285"},"call":"get_concepts_for_paper(arxiv_id=\"1803.11285\")"}],"by_repo":[{"repo":"tensorflow/models","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":4,"harvested_for":["1502.03167","1512.03385","1605.07146","1704.04861"],"harvested_for_calls":[{"arxiv_id":"1502.03167","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1502.03167"},"call":"get_harvested_code_for_paper(arxiv_id=\"1502.03167\")"},{"arxiv_id":"1512.03385","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1512.03385"},"call":"get_harvested_code_for_paper(arxiv_id=\"1512.03385\")"},{"arxiv_id":"1605.07146","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1605.07146"},"call":"get_harvested_code_for_paper(arxiv_id=\"1605.07146\")"},{"arxiv_id":"1704.04861","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1704.04861"},"call":"get_harvested_code_for_paper(arxiv_id=\"1704.04861\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"7ee366d9f495865c75eb37f346087cbbfb6e8c5658a06e544aed3eae13887093","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}