{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/circo","name":"CIRCO","full_name":"Composed Image Retrieval on Common Objects in context","description_markdown":"**CIRCO (Composed Image Retrieval on Common Objects in context)** is an open-domain benchmarking dataset for Composed Image Retrieval (CIR) based on real-world images from COCO 2017 unlabeled set. It is the first CIR dataset with multiple ground truths and aims to address the problem of false negatives in existing datasets. CIRCO comprises a total of 1020 queries, randomly divided into 220 and 800 for the validation and test set, respectively, with an average of 4.53 ground truths per query.\r\n\r\nSource: [Zero-Shot Composed Image Retrieval with Textual Inversion](https://arxiv.org/pdf/2303.15247v1.pdf)\r\n\r\nImage Source: [Zero-Shot Composed Image Retrieval with Textual Inversion](https://arxiv.org/pdf/2303.15247v1.pdf)","description_withheld":null,"homepage":"https://github.com/miccunifi/CIRCO","introduced_date":"2023-03-27","introduced_date_note":null,"introduced_by":{"paper":"/paper/zero-shot-composed-image-retrieval-with","title":"Zero-Shot Composed Image Retrieval with Textual Inversion","first_author":"Alberto Baldrati","url":null},"license":{"name":"Creative Commons BY-NC 4.0","url":"https://github.com/miccunifi/CIRCO/blob/main/LICENSE"},"modalities":[{"name":"Images","url":"/datasets/modality/images"},{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Image Retrieval","url":"/task/image-retrieval","datasets_with_task":"/datasets/task/image-retrieval"},{"name":"Composed Image Retrieval (CoIR)","url":"/task/composed-image-retrieval","datasets_with_task":"/datasets/task/composed-image-retrieval"},{"name":"Zero-Shot Composed Image Retrieval (ZS-CIR)","url":"/task/zero-shot-composed-image-retrieval-zs-cir","datasets_with_task":"/datasets/task/zero-shot-composed-image-retrieval-zs-cir"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["CIRCO"],"data_loaders":[{"repo":"https://github.com/miccunifi/circo","url":"https://github.com/miccunifi/CIRCO/blob/main/README.md","frameworks":["pytorch"]}],"num_papers_in_archive":35,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/zero-shot-composed-image-retrieval-zs-cir-on","task":"Zero-Shot Composed Image Retrieval (ZS-CIR)","dataset_variant":"CIRCO","rows":43,"metrics":["mAP@10","MAP@5","mAP@50","mAP@25"],"first_row_in_archive_order":{"model":"MMRet-MLLM","paper":"/paper/megapairs-massive-data-synthesis-for","metrics":{"mAP@10":"43.4"},"code_links":[{"title":"VectorSpaceLab/MegaPairs","url":"https://github.com/VectorSpaceLab/MegaPairs"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":20,"of":20,"counts":{"papers_with_a_benchmark_row":20,"with_a_code_link":18,"where_syntology_ran_a_sample":10,"not_listed_spam_title":0,"listed":20,"listed_where_code_ran":10,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":7,"every_run_a_failure_of_syntologys_instrument":3,"listed_with_a_run_with_no_instrument_failure":7,"listed_every_run_a_failure_of_syntologys_instrument":3,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/collm-a-large-language-model-for-composed","slug":"collm-a-large-language-model-for-composed","title":"CoLLM: A Large Language Model for Composed Image Retrieval","date":"2025-03-25","arxiv_id":"2503.19910","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/imagescope-unifying-language-guided-image-1","slug":"imagescope-unifying-language-guided-image-1","title":"ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning","date":"2025-03-13","arxiv_id":"2503.10166","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/scot-self-supervised-contrastive-pretraining","slug":"scot-self-supervised-contrastive-pretraining","title":"SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval","date":"2025-01-12","arxiv_id":"2501.08347","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/megapairs-massive-data-synthesis-for","slug":"megapairs-massive-data-synthesis-for","title":"MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval","date":"2024-12-19","arxiv_id":"2412.14475","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/reason-before-retrieve-one-stage-reflective","slug":"reason-before-retrieve-one-stage-reflective","title":"Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval","date":"2024-12-15","arxiv_id":"2412.11077","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/imagine-and-seek-improving-composed-image","slug":"imagine-and-seek-improving-composed-image","title":"Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy","date":"2024-11-24","arxiv_id":"2411.16752","rows_on_this_dataset":2,"code_links":0,"syntology":null},{"paper":"/paper/semantic-editing-increment-benefits-zero-shot","slug":"semantic-editing-increment-benefits-zero-shot","title":"Semantic Editing Increment Benefits Zero-Shot Composed Image Retrieval","date":"2024-10-28","arxiv_id":null,"rows_on_this_dataset":3,"code_links":2,"syntology":null},{"paper":"/paper/ldre-llm-based-divergent-reasoning-and","slug":"ldre-llm-based-divergent-reasoning-and","title":"LDRE: LLM-based Divergent Reasoning and Ensemble for Zero-Shot Composed Image Retrieval","date":"2024-07-11","arxiv_id":null,"rows_on_this_dataset":3,"code_links":2,"syntology":null},{"paper":"/paper/reducing-task-discrepancy-of-text-encoders","slug":"reducing-task-discrepancy-of-text-encoders","title":"An Efficient Post-hoc Framework for Reducing Task Discrepancy of Text Encoders for Composed Image Retrieval","date":"2024-06-13","arxiv_id":"2406.09188","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/isearle-improving-textual-inversion-for-zero","slug":"isearle-improving-textual-inversion-for-zero","title":"iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval","date":"2024-05-05","arxiv_id":"2405.02951","rows_on_this_dataset":4,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":2,"samples_unverified":1,"pointer_only_for_licence":4,"official":{"repos":["miccunifi/circo"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["named_in_paper"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/isearle-improving-textual-inversion-for-zero#ran","syntology_url":"https://syntology.ai/paper/2405.02951","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.02951"}}}},{"paper":"/paper/magiclens-self-supervised-image-retrieval","slug":"magiclens-self-supervised-image-retrieval","title":"MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions","date":"2024-03-28","arxiv_id":"2403.19651","rows_on_this_dataset":4,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["google-deepmind/magiclens"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/magiclens-self-supervised-image-retrieval#ran","syntology_url":"https://syntology.ai/paper/2403.19651","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.19651"}}}},{"paper":"/paper/language-only-efficient-training-of-zero-shot","slug":"language-only-efficient-training-of-zero-shot","title":"Language-only Efficient Training of Zero-shot Composed Image Retrieval","date":"2023-12-04","arxiv_id":"2312.01998","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":8,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":1,"samples_unverified":5,"pointer_only_for_licence":8,"official":{"repos":["navervision/lincir"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":5,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/language-only-efficient-training-of-zero-shot#ran","syntology_url":"https://syntology.ai/paper/2312.01998","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.01998"}}}},{"paper":"/paper/pretrain-like-you-inference-masked-tuning","slug":"pretrain-like-you-inference-masked-tuning","title":"Pretrain like Your Inference: Masked Tuning Improves Zero-Shot Composed Image Retrieval","date":"2023-11-13","arxiv_id":"2311.07622","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":2,"samples_unverified":1,"pointer_only_for_licence":4,"official":{"repos":["Chen-Junyang-cn/PLI"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/pretrain-like-you-inference-masked-tuning#ran","syntology_url":"https://syntology.ai/paper/2311.07622","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.07622"}}}},{"paper":"/paper/vision-by-language-for-training-free","slug":"vision-by-language-for-training-free","title":"Vision-by-Language for Training-Free Compositional Image Retrieval","date":"2023-10-13","arxiv_id":"2310.09291","rows_on_this_dataset":3,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":8,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":3,"samples_ran_instrument_failed":1,"samples_unverified":4,"pointer_only_for_licence":2,"official":{"repos":["explainableml/vision_by_language"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/vision-by-language-for-training-free#ran","syntology_url":"https://syntology.ai/paper/2310.09291","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.09291"}}}},{"paper":"/paper/context-i2w-mapping-images-to-context","slug":"context-i2w-mapping-images-to-context","title":"Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrieval","date":"2023-09-28","arxiv_id":"2309.16137","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["pter61/context-i2w"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/context-i2w-mapping-images-to-context#ran","syntology_url":"https://syntology.ai/paper/2309.16137","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.16137"}}}},{"paper":"/paper/covr-learning-composed-video-retrieval-from","slug":"covr-learning-composed-video-retrieval-from","title":"CoVR-2: Automatic Data Construction for Composed Video Retrieval","date":"2023-08-28","arxiv_id":"2308.14746","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["lucas-ventura/CoVR"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/covr-learning-composed-video-retrieval-from#ran","syntology_url":"https://syntology.ai/paper/2308.14746","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.14746"}}}},{"paper":"/paper/zero-shot-composed-image-retrieval-with","slug":"zero-shot-composed-image-retrieval-with","title":"Zero-Shot Composed Image Retrieval with Textual Inversion","date":"2023-03-27","arxiv_id":"2303.15247","rows_on_this_dataset":2,"code_links":2,"syntology":null},{"paper":"/paper/compodiff-versatile-composed-image-retrieval","slug":"compodiff-versatile-composed-image-retrieval","title":"CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion","date":"2023-03-21","arxiv_id":"2303.11916","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":2,"pointer_only_for_licence":1,"official":{"repos":["navervision/compodiff"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/compodiff-versatile-composed-image-retrieval#ran","syntology_url":"https://syntology.ai/paper/2303.11916","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.11916"}}}},{"paper":"/paper/pic2word-mapping-pictures-to-words-for-zero","slug":"pic2word-mapping-pictures-to-words-for-zero","title":"Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval","date":"2023-02-06","arxiv_id":"2302.03084","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["google-research/composed_image_retrieval"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/pic2word-mapping-pictures-to-words-for-zero#ran","syntology_url":"https://syntology.ai/paper/2302.03084","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.03084"}}}},{"paper":"/paper/this-is-my-unicorn-fluffy-personalizing","slug":"this-is-my-unicorn-fluffy-personalizing","title":"\"This is my unicorn, Fluffy\": Personalizing frozen vision-language representations","date":"2022-04-04","arxiv_id":"2204.01694","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["nvlabs/palavra","nvlabs/pervlbenchmark"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/this-is-my-unicorn-fluffy-personalizing#ran","syntology_url":"https://syntology.ai/paper/2204.01694","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.01694"}}}}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/collm-a-large-language-model-for-composed","slug":"collm-a-large-language-model-for-composed","title":"CoLLM: A Large Language Model for Composed Image Retrieval","date":"2025-03-25","arxiv_id":"2503.19910","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/imagescope-unifying-language-guided-image-1","slug":"imagescope-unifying-language-guided-image-1","title":"ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning","date":"2025-03-13","arxiv_id":"2503.10166","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/scot-self-supervised-contrastive-pretraining","slug":"scot-self-supervised-contrastive-pretraining","title":"SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval","date":"2025-01-12","arxiv_id":"2501.08347","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/megapairs-massive-data-synthesis-for","slug":"megapairs-massive-data-synthesis-for","title":"MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval","date":"2024-12-19","arxiv_id":"2412.14475","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/reason-before-retrieve-one-stage-reflective","slug":"reason-before-retrieve-one-stage-reflective","title":"Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval","date":"2024-12-15","arxiv_id":"2412.11077","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/imagine-and-seek-improving-composed-image","slug":"imagine-and-seek-improving-composed-image","title":"Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy","date":"2024-11-24","arxiv_id":"2411.16752","rows_on_this_dataset":2,"code_links":0,"syntology":null},{"paper":"/paper/semantic-editing-increment-benefits-zero-shot","slug":"semantic-editing-increment-benefits-zero-shot","title":"Semantic Editing Increment Benefits Zero-Shot Composed Image Retrieval","date":"2024-10-28","arxiv_id":null,"rows_on_this_dataset":3,"code_links":2,"syntology":null},{"paper":"/paper/ldre-llm-based-divergent-reasoning-and","slug":"ldre-llm-based-divergent-reasoning-and","title":"LDRE: LLM-based Divergent Reasoning and Ensemble for Zero-Shot Composed Image Retrieval","date":"2024-07-11","arxiv_id":null,"rows_on_this_dataset":3,"code_links":2,"syntology":null},{"paper":"/paper/reducing-task-discrepancy-of-text-encoders","slug":"reducing-task-discrepancy-of-text-encoders","title":"An Efficient Post-hoc Framework for Reducing Task Discrepancy of Text Encoders for Composed Image Retrieval","date":"2024-06-13","arxiv_id":"2406.09188","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/isearle-improving-textual-inversion-for-zero","slug":"isearle-improving-textual-inversion-for-zero","title":"iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval","date":"2024-05-05","arxiv_id":"2405.02951","rows_on_this_dataset":4,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":2,"samples_unverified":1,"pointer_only_for_licence":4,"official":{"repos":["miccunifi/circo"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["named_in_paper"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/isearle-improving-textual-inversion-for-zero#ran","syntology_url":"https://syntology.ai/paper/2405.02951","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.02951"}}}},{"paper":"/paper/magiclens-self-supervised-image-retrieval","slug":"magiclens-self-supervised-image-retrieval","title":"MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions","date":"2024-03-28","arxiv_id":"2403.19651","rows_on_this_dataset":4,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["google-deepmind/magiclens"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/magiclens-self-supervised-image-retrieval#ran","syntology_url":"https://syntology.ai/paper/2403.19651","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.19651"}}}},{"paper":"/paper/language-only-efficient-training-of-zero-shot","slug":"language-only-efficient-training-of-zero-shot","title":"Language-only Efficient Training of Zero-shot Composed Image Retrieval","date":"2023-12-04","arxiv_id":"2312.01998","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":8,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":1,"samples_unverified":5,"pointer_only_for_licence":8,"official":{"repos":["navervision/lincir"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":5,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/language-only-efficient-training-of-zero-shot#ran","syntology_url":"https://syntology.ai/paper/2312.01998","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.01998"}}}},{"paper":"/paper/pretrain-like-you-inference-masked-tuning","slug":"pretrain-like-you-inference-masked-tuning","title":"Pretrain like Your Inference: Masked Tuning Improves Zero-Shot Composed Image Retrieval","date":"2023-11-13","arxiv_id":"2311.07622","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":2,"samples_unverified":1,"pointer_only_for_licence":4,"official":{"repos":["Chen-Junyang-cn/PLI"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/pretrain-like-you-inference-masked-tuning#ran","syntology_url":"https://syntology.ai/paper/2311.07622","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.07622"}}}},{"paper":"/paper/vision-by-language-for-training-free","slug":"vision-by-language-for-training-free","title":"Vision-by-Language for Training-Free Compositional Image Retrieval","date":"2023-10-13","arxiv_id":"2310.09291","rows_on_this_dataset":3,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":8,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":3,"samples_ran_instrument_failed":1,"samples_unverified":4,"pointer_only_for_licence":2,"official":{"repos":["explainableml/vision_by_language"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/vision-by-language-for-training-free#ran","syntology_url":"https://syntology.ai/paper/2310.09291","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.09291"}}}},{"paper":"/paper/context-i2w-mapping-images-to-context","slug":"context-i2w-mapping-images-to-context","title":"Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrieval","date":"2023-09-28","arxiv_id":"2309.16137","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["pter61/context-i2w"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/context-i2w-mapping-images-to-context#ran","syntology_url":"https://syntology.ai/paper/2309.16137","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.16137"}}}},{"paper":"/paper/covr-learning-composed-video-retrieval-from","slug":"covr-learning-composed-video-retrieval-from","title":"CoVR-2: Automatic Data Construction for Composed Video Retrieval","date":"2023-08-28","arxiv_id":"2308.14746","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["lucas-ventura/CoVR"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/covr-learning-composed-video-retrieval-from#ran","syntology_url":"https://syntology.ai/paper/2308.14746","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.14746"}}}},{"paper":"/paper/zero-shot-composed-image-retrieval-with","slug":"zero-shot-composed-image-retrieval-with","title":"Zero-Shot Composed Image Retrieval with Textual Inversion","date":"2023-03-27","arxiv_id":"2303.15247","rows_on_this_dataset":2,"code_links":2,"syntology":null},{"paper":"/paper/compodiff-versatile-composed-image-retrieval","slug":"compodiff-versatile-composed-image-retrieval","title":"CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion","date":"2023-03-21","arxiv_id":"2303.11916","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":2,"pointer_only_for_licence":1,"official":{"repos":["navervision/compodiff"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/compodiff-versatile-composed-image-retrieval#ran","syntology_url":"https://syntology.ai/paper/2303.11916","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.11916"}}}},{"paper":"/paper/pic2word-mapping-pictures-to-words-for-zero","slug":"pic2word-mapping-pictures-to-words-for-zero","title":"Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval","date":"2023-02-06","arxiv_id":"2302.03084","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["google-research/composed_image_retrieval"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/pic2word-mapping-pictures-to-words-for-zero#ran","syntology_url":"https://syntology.ai/paper/2302.03084","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.03084"}}}},{"paper":"/paper/this-is-my-unicorn-fluffy-personalizing","slug":"this-is-my-unicorn-fluffy-personalizing","title":"\"This is my unicorn, Fluffy\": Personalizing frozen vision-language representations","date":"2022-04-04","arxiv_id":"2204.01694","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["nvlabs/palavra","nvlabs/pervlbenchmark"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/this-is-my-unicorn-fluffy-personalizing#ran","syntology_url":"https://syntology.ai/paper/2204.01694","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.01694"}}}}],"papers_where_code_ran":10,"papers_where_code_ran_first_page":"/dataset/circo/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/dataset/circo/papers/ran/1","json":"/dataset/circo/papers/ran/1.json","rows":10}],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":10,"samples_harvested":35,"samples_ran":22,"samples_constructed":0,"samples_ran_checked":13,"samples_ran_instrument_failed":9,"samples_unverified":13,"pointer_only_for_licence":20,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":10,"papers_with_a_run_with_no_instrument_failure":7,"papers_where_every_run_was_an_instrument_failure":3,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":1,"papers_placed":1,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/zero-shot-composed-image-retrieval-zs-cir-on","since_archive":"/sota/zero-shot-composed-image-retrieval-zs-cir-on#since-judged","papers_judged":1,"placed":1}]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"b37a3971e13fed841d343bb6cda35838511f3f462853872de0dbee602217d8c1","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}