{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/image-to-text-retrieval","name":"Image-to-Text Retrieval","slug":"image-to-text-retrieval","description_markdown":"**Image-text retrieval** is the process of retrieving relevant images based on textual descriptions or finding corresponding textual descriptions for a given image. This task is interdisciplinary, combining techniques from computer vision, and natural language processing. The primary challenge lies in bridging the *semantic gap* — the difference between how visual data is represented in images and how humans describe that information using language. To address this, many methods focus on learning a shared embedding space where both images and text can be represented in a comparable way, allowing their similarities to be measured and facilitating more accurate retrieval.\r\n\r\n**Source**: <span class=\"description-source\"> [Extending CLIP for Category-to-Image Retrieval in E-commerce](https://arxiv.org/abs/2112.11294)</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":59,"papers_with_code":37,"benchmarks":8,"benchmark_tables_in_archive":8,"benchmark_tables_shown":8,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":8,"subtasks":0,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/image-to-text-retrieval-on-flickr30k","slug":"image-to-text-retrieval-on-flickr30k","dataset":"Flickr30k","dataset_url":"/dataset/flickr30k","rows_in_archive":11,"metrics":["Recall@1","Recall@5","Recall@10","Recall@Sum"],"first_row_in_archive_order":{"model":"InternVL-G-FT (finetuned, w/o ranking)","paper_title":"InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks","paper_url":"/paper/internvl-scaling-up-vision-foundation-models","paper_date":"2023-12-21","arxiv_id":"2312.14238","code_links":[{"title":"opengvlab/internvl","url":"https://github.com/opengvlab/internvl"},{"title":"opengvlab/internvl-mmdetseg","url":"https://github.com/opengvlab/internvl-mmdetseg"}],"syntology":{"n":2,"n_ran":2,"n_constructed":2,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":2,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","sample_list":"/paper/internvl-scaling-up-vision-foundation-models#ran","syntology_url":"https://syntology.ai/paper/2312.14238","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.14238"}},"official":{"repos":["opengvlab/internvl"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/image-to-text-retrieval-on-coco","slug":"image-to-text-retrieval-on-coco","dataset":"COCO (Common Objects in Context)","dataset_url":"/dataset/coco","rows_in_archive":9,"metrics":["Recall@1","Recall@5","Recall@10"],"first_row_in_archive_order":{"model":"BLIP-2 (ViT-G, fine-tuned)","paper_title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","paper_url":"/paper/blip-2-bootstrapping-language-image-pre","paper_date":"2023-01-30","arxiv_id":"2301.12597","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"salesforce/lavis","url":"https://github.com/salesforce/lavis"},{"title":"thudm/visualglm-6b","url":"https://github.com/thudm/visualglm-6b"},{"title":"baaivision/eva","url":"https://github.com/baaivision/eva"},{"title":"junshutang/Make-It-3D","url":"https://github.com/junshutang/Make-It-3D"},{"title":"facebookresearch/multimodal","url":"https://github.com/facebookresearch/multimodal"},{"title":"unispac/visual-adversarial-examples-jailbreak-large-language-models","url":"https://github.com/unispac/visual-adversarial-examples-jailbreak-large-language-models"},{"title":"yukw777/videoblip","url":"https://github.com/yukw777/videoblip"},{"title":"alibaba/graphtranslator","url":"https://github.com/alibaba/graphtranslator"},{"title":"gregor-ge/mblip","url":"https://github.com/gregor-ge/mblip"},{"title":"linzhiqiu/clip-flant5","url":"https://github.com/linzhiqiu/clip-flant5"},{"title":"kdr/videorag-mrr2024","url":"https://github.com/kdr/videorag-mrr2024"},{"title":"rabiulcste/vqazero","url":"https://github.com/rabiulcste/vqazero"},{"title":"jiwanchung/vlis","url":"https://github.com/jiwanchung/vlis"},{"title":"yangyucheng000/University","url":"https://github.com/yangyucheng000/University/tree/main/model-2/blip_2"},{"title":"2024-MindSpore-1/Code2","url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/blip_2"},{"title":"albertotestoni/ndq_visual_objects","url":"https://github.com/albertotestoni/ndq_visual_objects"}],"syntology":{"n":8,"n_ran":4,"n_constructed":4,"n_ran_checked":4,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":1,"phrase":"4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result","sample_list":"/paper/blip-2-bootstrapping-language-image-pre#ran","syntology_url":"https://syntology.ai/paper/2301.12597","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.12597"}},"official":{"repos":["salesforce/lavis"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/image-to-text-retrieval-on-whoops","slug":"image-to-text-retrieval-on-whoops","dataset":"WHOOPS!","dataset_url":"/dataset/whoops","rows_in_archive":7,"metrics":["Specificity"],"first_row_in_archive_order":{"model":"BLIP2 FlanT5-XXL (Text-only FT)","paper_title":"Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images","paper_url":"/paper/breaking-common-sense-whoops-a-vision-and","paper_date":"2023-03-13","arxiv_id":"2303.07274","code_links":[],"syntology":null}},{"leaderboard":"/sota/image-to-text-retrieval-on-aic-icc","slug":"image-to-text-retrieval-on-aic-icc","dataset":"AIC-ICC","dataset_url":null,"rows_in_archive":2,"metrics":["Recall@1","Recall@10","Recall@5"],"first_row_in_archive_order":{"model":"ERNIE-ViL2.0","paper_title":"ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training","paper_url":"/paper/ernie-vil-2-0-multi-view-contrastive-learning","paper_date":"2022-09-30","arxiv_id":"2209.15270","code_links":[{"title":"PaddlePaddle/ERNIE","url":"https://github.com/PaddlePaddle/ERNIE"}],"syntology":null}},{"leaderboard":"/sota/image-to-text-retrieval-on-coco-1","slug":"image-to-text-retrieval-on-coco-1","dataset":"COCO","dataset_url":null,"rows_in_archive":1,"metrics":["Recall@1"],"first_row_in_archive_order":{"model":"SigLIP (ViT-L, zero-shot)","paper_title":"Sigmoid Loss for Language Image Pre-Training","paper_url":"/paper/sigmoid-loss-for-language-image-pre-training","paper_date":"2023-03-27","arxiv_id":"2303.15343","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"mlfoundations/open_clip","url":"https://github.com/mlfoundations/open_clip"},{"title":"google-research/big_vision","url":"https://github.com/google-research/big_vision"},{"title":"apple/ml-mobileclip","url":"https://github.com/apple/ml-mobileclip"},{"title":"merveenoyan/siglip","url":"https://github.com/merveenoyan/siglip"},{"title":"borisdayma/clip-jax","url":"https://github.com/borisdayma/clip-jax"},{"title":"filipbasara0/simple-clip","url":"https://github.com/filipbasara0/simple-clip"},{"title":"morrisfl/unifex","url":"https://github.com/morrisfl/unifex"},{"title":"filipbasara0/relic","url":"https://github.com/filipbasara0/relic"},{"title":"shkarupa-alex/tfclip","url":"https://github.com/shkarupa-alex/tfclip"},{"title":"ramanakshay/clip","url":"https://github.com/ramanakshay/clip"}],"syntology":{"n":29,"n_ran":14,"n_constructed":3,"n_ran_checked":11,"n_instrument":3,"n_unverified":15,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":25,"phrase":"14 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified","sample_list":"/paper/sigmoid-loss-for-language-image-pre-training#ran","syntology_url":"https://syntology.ai/paper/2303.15343","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15343"}},"official":{"repos":["google-research/big_vision"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/image-to-text-retrieval-on-feta-car-manuals","slug":"image-to-text-retrieval-on-feta-car-manuals","dataset":"FETA Car-Manuals","dataset_url":"/dataset/feta-car-manuals","rows_in_archive":1,"metrics":["R@1","R@10","R@5"],"first_row_in_archive_order":{"model":"FETA's CLIP-MIL (Many-Shot Image-to-text)","paper_title":"FETA: Towards Specializing Foundation Models for Expert Task Applications","paper_url":"/paper/feta-towards-specializing-foundation-models","paper_date":"2022-09-08","arxiv_id":"2209.03648","code_links":[{"title":"alfassy/FETA","url":"https://github.com/alfassy/FETA"}],"syntology":null}},{"leaderboard":"/sota/image-to-text-retrieval-on-rsicd","slug":"image-to-text-retrieval-on-rsicd","dataset":"RSICD","dataset_url":"/dataset/rsicd","rows_in_archive":1,"metrics":["Image to Text Recall@1"],"first_row_in_archive_order":{"model":"GeoRSCLIP-FT","paper_title":"RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing","paper_url":"/paper/rs5m-a-large-scale-vision-language-dataset","paper_date":"2023-06-20","arxiv_id":"2306.11300","code_links":[{"title":"om-ai-lab/rs5m","url":"https://github.com/om-ai-lab/rs5m"}],"syntology":{"n":7,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/rs5m-a-large-scale-vision-language-dataset#ran","syntology_url":"https://syntology.ai/paper/2306.11300","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.11300"}},"official":{"repos":["om-ai-lab/rs5m"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":1,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/image-to-text-retrieval-on-ruc-cas-wenlan","slug":"image-to-text-retrieval-on-ruc-cas-wenlan","dataset":"RUC-CAS-WenLan","dataset_url":null,"rows_in_archive":1,"metrics":["Recall@1","Recall@10","Recall@5"],"first_row_in_archive_order":{"model":"CMCL","paper_title":"WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training","paper_url":"/paper/wenlan-bridging-vision-and-language-by-large","paper_date":"2021-03-11","arxiv_id":"2103.06561","code_links":[{"title":"BAAI-WuDao/BriVl","url":"https://github.com/BAAI-WuDao/BriVl"},{"title":"Aman-4-Real/MMTG","url":"https://github.com/Aman-4-Real/MMTG"}],"syntology":null}}],"datasets":[{"url":"/dataset/coco","name":"COCO (Common Objects in Context)","full_name":"Common Objects in Context","num_papers_in_archive":11922},{"url":"/dataset/flickr30k","name":"Flickr30k","full_name":"Flickr30k","num_papers_in_archive":880},{"url":"/dataset/laion-400m","name":"LAION-400M","full_name":"","num_papers_in_archive":169},{"url":"/dataset/rsicd","name":"RSICD","full_name":"Remote Sensing Image Captioning Dataset","num_papers_in_archive":70},{"url":"/dataset/xm-3600","name":"XM 3600","full_name":"Crossmodal 3600","num_papers_in_archive":28},{"url":"/dataset/whoops","name":"WHOOPS!","full_name":"","num_papers_in_archive":14},{"url":"/dataset/fewsol","name":"FewSOL","full_name":"A Dataset for Few-Shot Object Learning in Robotic Environments","num_papers_in_archive":4},{"url":"/dataset/feta-car-manuals","name":"FETA Car-Manuals","full_name":"FETA Car-Manuals dataset, image-text retrieval for foundation models' expert data performance.","num_papers_in_archive":1}],"subtasks":[],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":1,"rows_per_page":100,"shown":59,"of":59,"of_with_code":37,"tagged_in_all":59,"counts":{"archive_papers_tagged":59,"with_a_code_link":37,"where_syntology_ran_a_sample":17,"not_listed_spam_title":0,"listed":59,"listed_where_code_ran":17,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":14,"every_run_a_failure_of_syntologys_instrument":3,"listed_with_a_run_with_no_instrument_failure":14,"listed_every_run_a_failure_of_syntologys_instrument":3,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/learning-transferable-visual-models-from","slug":"learning-transferable-visual-models-from","title":"Learning Transferable Visual Models From Natural Language Supervision","date":"2021-02-26","arxiv_id":"2103.00020","repositories_listed":82,"syntology":{"n":20,"n_ran":16,"n_constructed":0,"n_ran_checked":2,"n_instrument":14,"n_unverified":4,"n_honours":1,"n_violates":1,"n_no_contract":0,"n_pointer_only":16,"phrase":"16 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 14 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/learning-transferable-visual-models-from#ran","syntology_url":"https://syntology.ai/paper/2103.00020","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.00020"}},"official":{"repos":["openai/CLIP"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/blip-2-bootstrapping-language-image-pre","slug":"blip-2-bootstrapping-language-image-pre","title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","date":"2023-01-30","arxiv_id":"2301.12597","repositories_listed":17,"syntology":{"n":8,"n_ran":4,"n_constructed":4,"n_ran_checked":4,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":1,"phrase":"4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result","sample_list":"/paper/blip-2-bootstrapping-language-image-pre#ran","syntology_url":"https://syntology.ai/paper/2301.12597","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.12597"}},"official":{"repos":["salesforce/lavis"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/sigmoid-loss-for-language-image-pre-training","slug":"sigmoid-loss-for-language-image-pre-training","title":"Sigmoid Loss for Language Image Pre-Training","date":"2023-03-27","arxiv_id":"2303.15343","repositories_listed":11,"syntology":{"n":29,"n_ran":14,"n_constructed":3,"n_ran_checked":11,"n_instrument":3,"n_unverified":15,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":25,"phrase":"14 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified","sample_list":"/paper/sigmoid-loss-for-language-image-pre-training#ran","syntology_url":"https://syntology.ai/paper/2303.15343","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15343"}},"official":{"repos":["google-research/big_vision"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/align-before-fuse-vision-and-language","slug":"align-before-fuse-vision-and-language","title":"Align before Fuse: Vision and Language Representation Learning with Momentum Distillation","date":"2021-07-16","arxiv_id":"2107.07651","repositories_listed":6,"syntology":{"n":5,"n_ran":4,"n_constructed":0,"n_ran_checked":1,"n_instrument":3,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":3,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/align-before-fuse-vision-and-language#ran","syntology_url":"https://syntology.ai/paper/2107.07651","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.07651"}},"official":{"repos":["salesforce/lavis"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/flava-a-foundational-language-and-vision","slug":"flava-a-foundational-language-and-vision","title":"FLAVA: A Foundational Language And Vision Alignment Model","date":"2021-12-08","arxiv_id":"2112.04482","repositories_listed":4,"syntology":null},{"url":"/paper/oscar-object-semantics-aligned-pre-training","slug":"oscar-object-semantics-aligned-pre-training","title":"Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks","date":"2020-04-13","arxiv_id":"2004.06165","repositories_listed":4,"syntology":{"n":23,"n_ran":13,"n_constructed":6,"n_ran_checked":10,"n_instrument":3,"n_unverified":10,"n_honours":1,"n_violates":0,"n_no_contract":9,"n_pointer_only":1,"phrase":"13 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified","sample_list":"/paper/oscar-object-semantics-aligned-pre-training#ran","syntology_url":"https://syntology.ai/paper/2004.06165","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.06165"}},"official":{"repos":["microsoft/Oscar"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/deep-visual-semantic-alignments-for","slug":"deep-visual-semantic-alignments-for","title":"Deep Visual-Semantic Alignments for Generating Image Descriptions","date":"2014-12-07","arxiv_id":"1412.2306","repositories_listed":4,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/deep-visual-semantic-alignments-for#ran","syntology_url":"https://syntology.ai/paper/1412.2306","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1412.2306"}},"official":null}},{"url":"/paper/iglue-a-benchmark-for-transfer-learning","slug":"iglue-a-benchmark-for-transfer-learning","title":"IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages","date":"2022-01-27","arxiv_id":"2201.11732","repositories_listed":3,"syntology":{"n":21,"n_ran":17,"n_constructed":2,"n_ran_checked":11,"n_instrument":6,"n_unverified":4,"n_honours":2,"n_violates":0,"n_no_contract":9,"n_pointer_only":3,"phrase":"17 ran (of which 2 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/iglue-a-benchmark-for-transfer-learning#ran","syntology_url":"https://syntology.ai/paper/2201.11732","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.11732"}},"official":{"repos":["e-bug/iglue","e-bug/volta"],"state":"official (archive's flag): 17 ran","n_ran":17,"n_constructed":2,"n_ran_no_instrument_failure":11,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/internvl-scaling-up-vision-foundation-models","slug":"internvl-scaling-up-vision-foundation-models","title":"InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks","date":"2023-12-21","arxiv_id":"2312.14238","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":2,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":2,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","sample_list":"/paper/internvl-scaling-up-vision-foundation-models#ran","syntology_url":"https://syntology.ai/paper/2312.14238","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.14238"}},"official":{"repos":["opengvlab/internvl"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/negative-pre-aware-for-noisy-cross-modal","slug":"negative-pre-aware-for-noisy-cross-modal","title":"Negative Pre-aware for Noisy Cross-modal Matching","date":"2023-12-10","arxiv_id":"2312.05777","repositories_listed":2,"syntology":null},{"url":"/paper/multimodal-dataset-distillation-for-image","slug":"multimodal-dataset-distillation-for-image","title":"Vision-Language Dataset Distillation","date":"2023-08-15","arxiv_id":"2308.07545","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":1,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/multimodal-dataset-distillation-for-image#ran","syntology_url":"https://syntology.ai/paper/2308.07545","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.07545"}},"official":{"repos":["princetonvisualai/multimodal_dataset_distillation"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/one-peace-exploring-one-general","slug":"one-peace-exploring-one-general","title":"ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities","date":"2023-05-18","arxiv_id":"2305.11172","repositories_listed":2,"syntology":{"n":7,"n_ran":5,"n_constructed":2,"n_ran_checked":4,"n_instrument":1,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":3,"n_pointer_only":1,"phrase":"5 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/one-peace-exploring-one-general#ran","syntology_url":"https://syntology.ai/paper/2305.11172","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.11172"}},"official":{"repos":["OFA-Sys/ONE-PEACE"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":2,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/upop-unified-and-progressive-pruning-for","slug":"upop-unified-and-progressive-pruning-for","title":"UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers","date":"2023-01-31","arxiv_id":"2301.13741","repositories_listed":2,"syntology":{"n":2,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 2 unverified","sample_list":"/paper/upop-unified-and-progressive-pruning-for#ran","syntology_url":"https://syntology.ai/paper/2301.13741","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.13741"}},"official":{"repos":["sdc17/upop"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"url":"/paper/hada-a-graph-based-amalgamation-framework-in","slug":"hada-a-graph-based-amalgamation-framework-in","title":"HADA: A Graph-based Amalgamation Framework in Image-text Retrieval","date":"2023-01-11","arxiv_id":"2301.04742","repositories_listed":2,"syntology":null},{"url":"/paper/a-differentiable-semantic-metric","slug":"a-differentiable-semantic-metric","title":"A Differentiable Semantic Metric Approximation in Probabilistic Embedding for Cross-Modal Retrieval","date":"2022-12-06","arxiv_id":null,"repositories_listed":2,"syntology":null},{"url":"/paper/altclip-altering-the-language-encoder-in-clip","slug":"altclip-altering-the-language-encoder-in-clip","title":"AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities","date":"2022-11-12","arxiv_id":"2211.06679","repositories_listed":2,"syntology":{"n":11,"n_ran":10,"n_constructed":0,"n_ran_checked":10,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":1,"n_no_contract":9,"n_pointer_only":2,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/altclip-altering-the-language-encoder-in-clip#ran","syntology_url":"https://syntology.ai/paper/2211.06679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.06679"}},"official":{"repos":["flagai-open/flagai"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/opt-omni-perception-pre-trainer-for-cross","slug":"opt-omni-perception-pre-trainer-for-cross","title":"OPT: Omni-Perception Pre-Trainer for Cross-Modal Understanding and Generation","date":"2021-07-01","arxiv_id":"2107.00249","repositories_listed":2,"syntology":null},{"url":"/paper/wenlan-bridging-vision-and-language-by-large","slug":"wenlan-bridging-vision-and-language-by-large","title":"WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training","date":"2021-03-11","arxiv_id":"2103.06561","repositories_listed":2,"syntology":null},{"url":"/paper/exploring-models-and-data-for-remote-sensing","slug":"exploring-models-and-data-for-remote-sensing","title":"Exploring Models and Data for Remote Sensing Image Caption Generation","date":"2017-12-21","arxiv_id":"1712.07835","repositories_listed":2,"syntology":null},{"url":"/paper/efficient-medical-vision-language-alignment","slug":"efficient-medical-vision-language-alignment","title":"Efficient Medical Vision-Language Alignment Through Adapting Masked Vision Models","date":"2025-06-10","arxiv_id":"2506.08990","repositories_listed":1,"syntology":null},{"url":"/paper/gabinsight-exploring-gender-activity-binding","slug":"gabinsight-exploring-gender-activity-binding","title":"GABInsight: Exploring Gender-Activity Binding Bias in Vision-Language Models","date":"2024-07-30","arxiv_id":"2407.21001","repositories_listed":1,"syntology":null},{"url":"/paper/towards-a-text-based-quantitative-and","slug":"towards-a-text-based-quantitative-and","title":"Towards a text-based quantitative and explainable histopathology image analysis","date":"2024-07-10","arxiv_id":"2407.07360","repositories_listed":1,"syntology":null},{"url":"/paper/bivlc-extending-vision-language","slug":"bivlc-extending-vision-language","title":"BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval","date":"2024-06-14","arxiv_id":"2406.09952","repositories_listed":1,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/bivlc-extending-vision-language#ran","syntology_url":"https://syntology.ai/paper/2406.09952","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.09952"}},"official":{"repos":["imirandam/bivlc"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/efficient-remote-sensing-with-harmonized","slug":"efficient-remote-sensing-with-harmonized","title":"Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment","date":"2024-04-28","arxiv_id":"2404.18253","repositories_listed":1,"syntology":{"n":6,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/efficient-remote-sensing-with-harmonized#ran","syntology_url":"https://syntology.ai/paper/2404.18253","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.18253"}},"official":{"repos":["seekerhuang/harma"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":5,"ran_from_kinds":["official"]}}},{"url":"/paper/linguistic-aware-patch-slimming-framework-for","slug":"linguistic-aware-patch-slimming-framework-for","title":"Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment","date":"2024-01-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/prototype-based-aleatoric-uncertainty-1","slug":"prototype-based-aleatoric-uncertainty-1","title":"Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval","date":"2023-09-29","arxiv_id":"2309.17093","repositories_listed":1,"syntology":{"n":19,"n_ran":17,"n_constructed":0,"n_ran_checked":9,"n_instrument":8,"n_unverified":2,"n_honours":5,"n_violates":1,"n_no_contract":3,"n_pointer_only":8,"phrase":"17 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 5 honoured, 1 violated, 3 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/prototype-based-aleatoric-uncertainty-1#ran","syntology_url":"https://syntology.ai/paper/2309.17093","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.17093"}},"official":{"repos":["leolee99/pau"],"state":"official (archive's flag): 17 ran","n_ran":17,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/prior-prototype-representation-joint-learning","slug":"prior-prototype-representation-joint-learning","title":"PRIOR: Prototype Representation Joint Learning from Medical Images and Reports","date":"2023-07-24","arxiv_id":"2307.12577","repositories_listed":1,"syntology":{"n":3,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/prior-prototype-representation-joint-learning#ran","syntology_url":"https://syntology.ai/paper/2307.12577","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.12577"}},"official":{"repos":["qtacierp/prior"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/rs5m-a-large-scale-vision-language-dataset","slug":"rs5m-a-large-scale-vision-language-dataset","title":"RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing","date":"2023-06-20","arxiv_id":"2306.11300","repositories_listed":1,"syntology":{"n":7,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/rs5m-a-large-scale-vision-language-dataset#ran","syntology_url":"https://syntology.ai/paper/2306.11300","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.11300"}},"official":{"repos":["om-ai-lab/rs5m"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/crossget-cross-guided-ensemble-of-tokens-for","slug":"crossget-cross-guided-ensemble-of-tokens-for","title":"CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers","date":"2023-05-27","arxiv_id":"2305.17455","repositories_listed":1,"syntology":{"n":4,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/crossget-cross-guided-ensemble-of-tokens-for#ran","syntology_url":"https://syntology.ai/paper/2305.17455","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.17455"}},"official":{"repos":["sdc17/crossget"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/rethinking-benchmarks-for-cross-modal-image","slug":"rethinking-benchmarks-for-cross-modal-image","title":"Rethinking Benchmarks for Cross-modal Image-text Retrieval","date":"2023-04-21","arxiv_id":"2304.10824","repositories_listed":1,"syntology":null},{"url":"/paper/ernie-vil-2-0-multi-view-contrastive-learning","slug":"ernie-vil-2-0-multi-view-contrastive-learning","title":"ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training","date":"2022-09-30","arxiv_id":"2209.15270","repositories_listed":1,"syntology":null},{"url":"/paper/feta-towards-specializing-foundation-models","slug":"feta-towards-specializing-foundation-models","title":"FETA: Towards Specializing Foundation Models for Expert Task Applications","date":"2022-09-08","arxiv_id":"2209.03648","repositories_listed":1,"syntology":null},{"url":"/paper/design-of-the-topology-for-contrastive-visual","slug":"design-of-the-topology-for-contrastive-visual","title":"Design of the topology for contrastive visual-textual alignment","date":"2022-09-05","arxiv_id":"2209.02127","repositories_listed":1,"syntology":null},{"url":"/paper/uni-perceiver-moe-learning-sparse-generalist","slug":"uni-perceiver-moe-learning-sparse-generalist","title":"Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs","date":"2022-06-09","arxiv_id":"2206.04674","repositories_listed":1,"syntology":null},{"url":"/paper/a-deep-local-and-global-scene-graph-matching","slug":"a-deep-local-and-global-scene-graph-matching","title":"A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval","date":"2021-06-04","arxiv_id":"2106.02400","repositories_listed":1,"syntology":null},{"url":"/paper/learning-relation-alignment-for-calibrated","slug":"learning-relation-alignment-for-calibrated","title":"Learning Relation Alignment for Calibrated Cross-modal Retrieval","date":"2021-05-28","arxiv_id":"2105.13868","repositories_listed":1,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/learning-relation-alignment-for-calibrated#ran","syntology_url":"https://syntology.ai/paper/2105.13868","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.13868"}},"official":{"repos":["lancopku/IAIS"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/aligning-multilingual-word-embeddings-for","slug":"aligning-multilingual-word-embeddings-for","title":"Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task","date":"2019-10-08","arxiv_id":"1910.03291","repositories_listed":1,"syntology":null},{"url":null,"slug":"improving-medical-visual-representation","title":"Improving Medical Visual Representation Learning with Pathological-level Cross-Modal Alignment and Correlation Exploration","date":"2025-06-12","arxiv_id":"2506.10573","repositories_listed":0,"syntology":null},{"url":null,"slug":"2505-10921","title":"Towards Cross-modal Retrieval in Chinese Cultural Heritage Documents: Dataset and Solution","date":"2025-05-16","arxiv_id":"2505.10921","repositories_listed":0,"syntology":null},{"url":null,"slug":"semcore-a-semantic-enhanced-generative-cross","title":"SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMs","date":"2025-04-17","arxiv_id":"2504.13172","repositories_listed":0,"syntology":null},{"url":null,"slug":"dart-disease-aware-image-text-alignment-and","title":"DART: Disease-aware Image-Text Alignment and Self-correcting Re-alignment for Trustworthy Radiology Report Generation","date":"2025-04-16","arxiv_id":"2504.11786","repositories_listed":0,"syntology":null},{"url":null,"slug":"abc-achieving-better-control-of-multimodal","title":"ABC: Achieving Better Control of Multimodal Embeddings using VLMs","date":"2025-03-01","arxiv_id":"2503.00329","repositories_listed":0,"syntology":null},{"url":null,"slug":"retaining-knowledge-and-enhancing-long-text","title":"Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation","date":"2025-01-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"dir-retrieval-augmented-image-captioning-with","title":"DIR: Retrieval-Augmented Image Captioning with Comprehensive Understanding","date":"2024-12-02","arxiv_id":"2412.01115","repositories_listed":0,"syntology":null},{"url":null,"slug":"robotic-state-recognition-with-image-to-text","title":"Robotic State Recognition with Image-to-Text Retrieval Task of Pre-Trained Vision-Language Model and Black-Box Optimization","date":"2024-10-30","arxiv_id":"2410.22707","repositories_listed":0,"syntology":null},{"url":null,"slug":"robotic-environmental-state-recognition-with","title":"Robotic Environmental State Recognition with Pre-Trained Vision-Language Models and Black-Box Optimization","date":"2024-09-26","arxiv_id":"2409.17519","repositories_listed":0,"syntology":null},{"url":null,"slug":"understanding-the-effect-of-using","title":"Understanding the Effect of using Semantically Meaningful Tokens for Visual Representation Learning","date":"2024-05-26","arxiv_id":"2405.16401","repositories_listed":0,"syntology":null},{"url":null,"slug":"clip-the-bias-how-useful-is-balancing-data-in","title":"CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?","date":"2024-03-07","arxiv_id":"2403.04547","repositories_listed":0,"syntology":null},{"url":null,"slug":"accept-the-modality-gap-an-exploration-in-the","title":"Accept the Modality Gap: An Exploration in the Hyperbolic Space","date":"2024-01-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"towards-a-visual-language-foundation-model","title":"Towards a Visual-Language Foundation Model for Computational Pathology","date":"2023-07-24","arxiv_id":"2307.12914","repositories_listed":0,"syntology":null},{"url":null,"slug":"is-cross-modal-information-retrieval-possible","title":"Is Cross-modal Information Retrieval Possible without Training?","date":"2023-04-20","arxiv_id":"2304.11095","repositories_listed":0,"syntology":null},{"url":"/paper/breaking-common-sense-whoops-a-vision-and","slug":"breaking-common-sense-whoops-a-vision-and","title":"Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images","date":"2023-03-13","arxiv_id":"2303.07274","repositories_listed":0,"syntology":null},{"url":null,"slug":"when-are-lemons-purple-the-concept","title":"When are Lemons Purple? The Concept Association Bias of Vision-Language Models","date":"2022-12-22","arxiv_id":"2212.12043","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-survey-on-knowledge-enhanced-multimodal","title":"A survey on knowledge-enhanced multimodal learning","date":"2022-11-19","arxiv_id":"2211.12328","repositories_listed":0,"syntology":null},{"url":null,"slug":"paired-cross-modal-data-augmentation-for-fine","title":"Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrieval","date":"2022-07-29","arxiv_id":"2207.14428","repositories_listed":0,"syntology":null},{"url":"/paper/crossmodal-3600-a-massively-multilingual-1","slug":"crossmodal-3600-a-massively-multilingual-1","title":"Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset","date":"2022-05-25","arxiv_id":"2205.12522","repositories_listed":0,"syntology":null},{"url":"/paper/cots-collaborative-two-stream-vision-language","slug":"cots-collaborative-two-stream-vision-language","title":"COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval","date":"2022-04-15","arxiv_id":"2204.07441","repositories_listed":0,"syntology":null},{"url":"/paper/hierarchical-gumbel-attention-network-for","slug":"hierarchical-gumbel-attention-network-for","title":"Hierarchical Gumbel Attention Network for Text-based Person Search","date":"2020-10-10","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":"/paper/unicoder-vl-a-universal-encoder-for-vision","slug":"unicoder-vl-a-universal-encoder-for-vision","title":"Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training","date":"2019-08-16","arxiv_id":"1908.06066","repositories_listed":0,"syntology":null}],"syntology_records":19,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":3,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/image-to-text-retrieval-on-flickr30k","since_archive":"/sota/image-to-text-retrieval-on-flickr30k#since-judged","papers_judged":3,"placed":0},{"leaderboard":"/sota/image-to-text-retrieval-on-coco","since_archive":"/sota/image-to-text-retrieval-on-coco#since-judged","papers_judged":1,"placed":0}]},"papers_where_code_ran":17,"papers_where_code_ran_first_page":"/task/image-to-text-retrieval/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/task/image-to-text-retrieval/papers/ran/1","json":"/task/image-to-text-retrieval/papers/ran/1.json","rows":17}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"b44a6e6c5f1c0b5b3a640e79fd5bc78644eda98d9e41e2386ed656e87a920491","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}