{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/imagenet-sketch","name":"ImageNet-Sketch","full_name":null,"description_markdown":"ImageNet-Sketch data set consists of 50,889 images,  approximately 50 images for each of the 1000 ImageNet classes. The data set is constructed with Google Image queries \"sketch of __\", where __ is the standard class name. Only within the \"black and white\" color scheme is searched. 100 images are initially queried for every class, and the pulled images are cleaned by deleting the irrelevant images and images that are for similar but different classes. For some classes, there are less than 50 images after manually cleaning, and then the data set is augmented by flipping and rotating the images.\r\n\r\nSource: [ImageNet-Sketch](https://github.com/HaohanWang/ImageNet-Sketch)\r\nImage Source: [https://github.com/HaohanWang/ImageNet-Sketch](https://github.com/HaohanWang/ImageNet-Sketch)","description_withheld":null,"homepage":"https://github.com/HaohanWang/ImageNet-Sketch","introduced_date":"2019-05-29","introduced_date_note":null,"introduced_by":{"paper":"/paper/190513549","title":"Learning Robust Global Representations by Penalizing Local Predictive Power","first_author":"Haohan Wang","url":null},"license":{"name":"Unknown","url":null},"modalities":[{"name":"Images","url":"/datasets/modality/images"}],"tasks":[{"name":"Image Classification","url":"/task/image-classification","datasets_with_task":"/datasets/task/image-classification"},{"name":"Domain Adaptation","url":"/task/domain-adaptation","datasets_with_task":"/datasets/task/domain-adaptation"},{"name":"Domain Generalization","url":"/task/domain-generalization","datasets_with_task":"/datasets/task/domain-generalization"},{"name":"Zero-Shot Transfer Image Classification","url":"/task/zero-shot-transfer-image-classification","datasets_with_task":"/datasets/task/zero-shot-transfer-image-classification"},{"name":"Data Augmentation","url":"/task/data-augmentation","datasets_with_task":"/datasets/task/data-augmentation"}],"languages":[],"variants":["ImageNet-Sketch"],"data_loaders":[{"repo":"https://github.com/huggingface/datasets","url":"https://huggingface.co/datasets/songweig/imagenet_sketch","frameworks":["tf","pytorch","jax"]},{"repo":"https://github.com/huggingface/datasets","url":"https://huggingface.co/datasets/imagenet_sketch","frameworks":["tf","pytorch","jax"]},{"repo":"https://github.com/tensorflow/datasets","url":"https://www.tensorflow.org/datasets/catalog/imagenet_sketch","frameworks":["tf","pytorch","jax"]},{"repo":"https://github.com/HaohanWang/ImageNet-Sketch","url":"https://github.com/HaohanWang/ImageNet-Sketch","frameworks":["pytorch"]}],"num_papers_in_archive":268,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/domain-generalization-on-imagenet-sketch","task":"Domain Generalization","dataset_variant":"ImageNet-Sketch","rows":20,"metrics":["Top-1 accuracy"],"first_row_in_archive_order":{"model":"Model soups (BASIC-L)","paper":"/paper/model-soups-averaging-weights-of-multiple","metrics":{"Top-1 accuracy":"77.18"},"code_links":[{"title":"mlfoundations/model-soups","url":"https://github.com/mlfoundations/model-soups"},{"title":"Burf/ModelSoups","url":"https://github.com/Burf/ModelSoups"},{"title":"facebookresearch/ModelRatatouille","url":"https://github.com/facebookresearch/ModelRatatouille"},{"title":"hwk0702/keras2torch","url":"https://github.com/hwk0702/keras2torch/tree/main/Computer_Vision/Model_Soup"},{"title":"flowritecom/flow-merge","url":"https://github.com/flowritecom/flow-merge"},{"title":"shallowlearn/sportsreid","url":"https://github.com/shallowlearn/sportsreid"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/zero-shot-transfer-image-classification-on-8","task":"Zero-Shot Transfer Image Classification","dataset_variant":"ImageNet-Sketch","rows":7,"metrics":["Accuracy (Private)"],"first_row_in_archive_order":{"model":"CoCa","paper":"/paper/coca-contrastive-captioners-are-image-text","metrics":{"Accuracy (Private)":"77.6"},"code_links":[{"title":"mlfoundations/open_clip","url":"https://github.com/mlfoundations/open_clip"},{"title":"facebookresearch/multimodal","url":"https://github.com/facebookresearch/multimodal"},{"title":"lucidrains/CoCa-pytorch","url":"https://github.com/lucidrains/CoCa-pytorch"},{"title":"amitakamath/whatsup_vlms","url":"https://github.com/amitakamath/whatsup_vlms"},{"title":"amitakamath/hard_positives","url":"https://github.com/amitakamath/hard_positives"},{"title":"Chaolei98/FreeZAD","url":"https://github.com/Chaolei98/FreeZAD"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/image-classification-on-imagenet-sketch","task":"Image Classification","dataset_variant":"ImageNet-Sketch","rows":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"µ2Net+ (ViT-L/16)","paper":"/paper/a-continual-development-methodology-for-large","metrics":{"Accuracy":"88.6"},"code_links":[{"title":"google-research/google-research","url":"https://github.com/google-research/google-research/tree/master/muNet"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":20,"of":20,"counts":{"papers_with_a_benchmark_row":20,"with_a_code_link":18,"where_syntology_ran_a_sample":12,"not_listed_spam_title":0,"listed":20,"listed_where_code_ran":12,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":12,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":12,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/eva-clip-18b-scaling-clip-to-18-billion","slug":"eva-clip-18b-scaling-clip-to-18-billion","title":"EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters","date":"2024-02-06","arxiv_id":"2402.04252","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":4,"pointer_only_for_licence":4,"official":{"repos":["baaivision/eva"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eva-clip-18b-scaling-clip-to-18-billion#ran","syntology_url":"https://syntology.ai/paper/2402.04252","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.04252"}}}},{"paper":"/paper/internvl-scaling-up-vision-foundation-models","slug":"internvl-scaling-up-vision-foundation-models","title":"InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks","date":"2023-12-21","arxiv_id":"2312.14238","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":2,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":2,"official":{"repos":["opengvlab/internvl"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/internvl-scaling-up-vision-foundation-models#ran","syntology_url":"https://syntology.ai/paper/2312.14238","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.14238"}}}},{"paper":"/paper/distilling-out-of-distribution-robustness-1","slug":"distilling-out-of-distribution-robustness-1","title":"Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models","date":"2023-11-02","arxiv_id":"2311.01441","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":1,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["lapisrocks/DiscreteAdversarialDistillation"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/distilling-out-of-distribution-robustness-1#ran","syntology_url":"https://syntology.ai/paper/2311.01441","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.01441"}}}},{"paper":"/paper/eva-clip-improved-training-techniques-for","slug":"eva-clip-improved-training-techniques-for","title":"EVA-CLIP: Improved Training Techniques for CLIP at Scale","date":"2023-03-27","arxiv_id":"2303.15389","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":0,"official":{"repos":["baaivision/eva"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eva-clip-improved-training-techniques-for#ran","syntology_url":"https://syntology.ai/paper/2303.15389","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15389"}}}},{"paper":"/paper/a-whac-a-mole-dilemma-shortcuts-come-in","slug":"a-whac-a-mole-dilemma-shortcuts-come-in","title":"A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others","date":"2022-12-09","arxiv_id":"2212.04825","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/context-aware-robust-fine-tuning","slug":"context-aware-robust-fine-tuning","title":"Context-Aware Robust Fine-Tuning","date":"2022-11-29","arxiv_id":"2211.16175","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/altclip-altering-the-language-encoder-in-clip","slug":"altclip-altering-the-language-encoder-in-clip","title":"AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities","date":"2022-11-12","arxiv_id":"2211.06679","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":11,"samples_ran":10,"samples_constructed":0,"samples_ran_checked":10,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":2,"official":{"repos":["flagai-open/flagai"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/altclip-altering-the-language-encoder-in-clip#ran","syntology_url":"https://syntology.ai/paper/2211.06679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.06679"}}}},{"paper":"/paper/metaformer-baselines-for-vision","slug":"metaformer-baselines-for-vision","title":"MetaFormer Baselines for Vision","date":"2022-10-24","arxiv_id":"2210.13452","rows_on_this_dataset":6,"code_links":8,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":0,"official":{"repos":["rwightman/pytorch-image-models","sail-sg/metaformer"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/metaformer-baselines-for-vision#ran","syntology_url":"https://syntology.ai/paper/2210.13452","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.13452"}}}},{"paper":"/paper/generalized-parametric-contrastive-learning","slug":"generalized-parametric-contrastive-learning","title":"Generalized Parametric Contrastive Learning","date":"2022-09-26","arxiv_id":"2209.12400","rows_on_this_dataset":1,"code_links":4,"syntology":null},{"paper":"/paper/enhance-the-visual-representation-via","slug":"enhance-the-visual-representation-via","title":"Enhance the Visual Representation via Discrete Adversarial Training","date":"2022-09-16","arxiv_id":"2209.07735","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":11,"samples_ran":10,"samples_constructed":5,"samples_ran_checked":7,"samples_ran_instrument_failed":3,"samples_unverified":1,"pointer_only_for_licence":1,"official":{"repos":["alibaba/easyrobust"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":5,"n_ran_no_instrument_failure":7,"n_unverified":1,"ran_from_kinds":["official","unlocated"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/enhance-the-visual-representation-via#ran","syntology_url":"https://syntology.ai/paper/2209.07735","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.07735"}}}},{"paper":"/paper/a-continual-development-methodology-for-large","slug":"a-continual-development-methodology-for-large","title":"A Continual Development Methodology for Large-scale Multitask Dynamic ML Systems","date":"2022-09-15","arxiv_id":"2209.07326","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/coca-contrastive-captioners-are-image-text","slug":"coca-contrastive-captioners-are-image-text","title":"CoCa: Contrastive Captioners are Image-Text Foundation Models","date":"2022-05-04","arxiv_id":"2205.01917","rows_on_this_dataset":1,"code_links":6,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":10,"samples_constructed":5,"samples_ran_checked":9,"samples_ran_instrument_failed":1,"samples_unverified":7,"pointer_only_for_licence":2,"official":null,"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/coca-contrastive-captioners-are-image-text#ran","syntology_url":"https://syntology.ai/paper/2205.01917","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.01917"}}}},{"paper":"/paper/sequencer-deep-lstm-for-image-classification","slug":"sequencer-deep-lstm-for-image-classification","title":"Sequencer: Deep LSTM for Image Classification","date":"2022-05-04","arxiv_id":"2205.01972","rows_on_this_dataset":1,"code_links":5,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":5,"pointer_only_for_licence":0,"official":{"repos":["okojoalg/sequencer","rwightman/pytorch-image-models"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":5,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/sequencer-deep-lstm-for-image-classification#ran","syntology_url":"https://syntology.ai/paper/2205.01972","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.01972"}}}},{"paper":"/paper/model-soups-averaging-weights-of-multiple","slug":"model-soups-averaging-weights-of-multiple","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","date":"2022-03-10","arxiv_id":"2203.05482","rows_on_this_dataset":2,"code_links":6,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":10,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":5,"samples_unverified":7,"pointer_only_for_licence":0,"official":{"repos":["mlfoundations/model-soups"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/model-soups-averaging-weights-of-multiple#ran","syntology_url":"https://syntology.ai/paper/2203.05482","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.05482"}}}},{"paper":"/paper/vision-models-are-more-robust-and-fair-when","slug":"vision-models-are-more-robust-and-fair-when","title":"Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision","date":"2022-02-16","arxiv_id":"2202.08360","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/a-convnet-for-the-2020s","slug":"a-convnet-for-the-2020s","title":"A ConvNet for the 2020s","date":"2022-01-10","arxiv_id":"2201.03545","rows_on_this_dataset":1,"code_links":54,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":80,"samples_ran":57,"samples_constructed":39,"samples_ran_checked":49,"samples_ran_instrument_failed":8,"samples_unverified":23,"pointer_only_for_licence":12,"official":{"repos":["facebookresearch/ConvNeXt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/a-convnet-for-the-2020s#ran","syntology_url":"https://syntology.ai/paper/2201.03545","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.03545"}}}},{"paper":"/paper/pyramid-adversarial-training-improves-vit","slug":"pyramid-adversarial-training-improves-vit","title":"Pyramid Adversarial Training Improves ViT Performance","date":"2021-11-30","arxiv_id":"2111.15121","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/discrete-representations-strengthen-vision-1","slug":"discrete-representations-strengthen-vision-1","title":"Discrete Representations Strengthen Vision Transformer Robustness","date":"2021-11-20","arxiv_id":"2111.10493","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/combined-scaling-for-zero-shot-transfer","slug":"combined-scaling-for-zero-shot-transfer","title":"Combined Scaling for Zero-shot Transfer Learning","date":"2021-11-19","arxiv_id":"2111.10050","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/masked-autoencoders-are-scalable-vision","slug":"masked-autoencoders-are-scalable-vision","title":"Masked Autoencoders Are Scalable Vision Learners","date":"2021-11-11","arxiv_id":"2111.06377","rows_on_this_dataset":1,"code_links":58,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":137,"samples_ran":86,"samples_constructed":40,"samples_ran_checked":68,"samples_ran_instrument_failed":18,"samples_unverified":51,"pointer_only_for_licence":78,"official":{"repos":["facebookresearch/mae"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/masked-autoencoders-are-scalable-vision#ran","syntology_url":"https://syntology.ai/paper/2111.06377","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.06377"}}}}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/eva-clip-18b-scaling-clip-to-18-billion","slug":"eva-clip-18b-scaling-clip-to-18-billion","title":"EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters","date":"2024-02-06","arxiv_id":"2402.04252","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":4,"pointer_only_for_licence":4,"official":{"repos":["baaivision/eva"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eva-clip-18b-scaling-clip-to-18-billion#ran","syntology_url":"https://syntology.ai/paper/2402.04252","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.04252"}}}},{"paper":"/paper/internvl-scaling-up-vision-foundation-models","slug":"internvl-scaling-up-vision-foundation-models","title":"InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks","date":"2023-12-21","arxiv_id":"2312.14238","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":2,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":2,"official":{"repos":["opengvlab/internvl"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/internvl-scaling-up-vision-foundation-models#ran","syntology_url":"https://syntology.ai/paper/2312.14238","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.14238"}}}},{"paper":"/paper/distilling-out-of-distribution-robustness-1","slug":"distilling-out-of-distribution-robustness-1","title":"Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models","date":"2023-11-02","arxiv_id":"2311.01441","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":1,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["lapisrocks/DiscreteAdversarialDistillation"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/distilling-out-of-distribution-robustness-1#ran","syntology_url":"https://syntology.ai/paper/2311.01441","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.01441"}}}},{"paper":"/paper/eva-clip-improved-training-techniques-for","slug":"eva-clip-improved-training-techniques-for","title":"EVA-CLIP: Improved Training Techniques for CLIP at Scale","date":"2023-03-27","arxiv_id":"2303.15389","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":0,"official":{"repos":["baaivision/eva"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eva-clip-improved-training-techniques-for#ran","syntology_url":"https://syntology.ai/paper/2303.15389","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15389"}}}},{"paper":"/paper/a-whac-a-mole-dilemma-shortcuts-come-in","slug":"a-whac-a-mole-dilemma-shortcuts-come-in","title":"A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others","date":"2022-12-09","arxiv_id":"2212.04825","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/context-aware-robust-fine-tuning","slug":"context-aware-robust-fine-tuning","title":"Context-Aware Robust Fine-Tuning","date":"2022-11-29","arxiv_id":"2211.16175","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/altclip-altering-the-language-encoder-in-clip","slug":"altclip-altering-the-language-encoder-in-clip","title":"AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities","date":"2022-11-12","arxiv_id":"2211.06679","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":11,"samples_ran":10,"samples_constructed":0,"samples_ran_checked":10,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":2,"official":{"repos":["flagai-open/flagai"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/altclip-altering-the-language-encoder-in-clip#ran","syntology_url":"https://syntology.ai/paper/2211.06679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.06679"}}}},{"paper":"/paper/metaformer-baselines-for-vision","slug":"metaformer-baselines-for-vision","title":"MetaFormer Baselines for Vision","date":"2022-10-24","arxiv_id":"2210.13452","rows_on_this_dataset":6,"code_links":8,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":4,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":0,"official":{"repos":["rwightman/pytorch-image-models","sail-sg/metaformer"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/metaformer-baselines-for-vision#ran","syntology_url":"https://syntology.ai/paper/2210.13452","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.13452"}}}},{"paper":"/paper/generalized-parametric-contrastive-learning","slug":"generalized-parametric-contrastive-learning","title":"Generalized Parametric Contrastive Learning","date":"2022-09-26","arxiv_id":"2209.12400","rows_on_this_dataset":1,"code_links":4,"syntology":null},{"paper":"/paper/enhance-the-visual-representation-via","slug":"enhance-the-visual-representation-via","title":"Enhance the Visual Representation via Discrete Adversarial Training","date":"2022-09-16","arxiv_id":"2209.07735","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":11,"samples_ran":10,"samples_constructed":5,"samples_ran_checked":7,"samples_ran_instrument_failed":3,"samples_unverified":1,"pointer_only_for_licence":1,"official":{"repos":["alibaba/easyrobust"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":5,"n_ran_no_instrument_failure":7,"n_unverified":1,"ran_from_kinds":["official","unlocated"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/enhance-the-visual-representation-via#ran","syntology_url":"https://syntology.ai/paper/2209.07735","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.07735"}}}},{"paper":"/paper/a-continual-development-methodology-for-large","slug":"a-continual-development-methodology-for-large","title":"A Continual Development Methodology for Large-scale Multitask Dynamic ML Systems","date":"2022-09-15","arxiv_id":"2209.07326","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/coca-contrastive-captioners-are-image-text","slug":"coca-contrastive-captioners-are-image-text","title":"CoCa: Contrastive Captioners are Image-Text Foundation Models","date":"2022-05-04","arxiv_id":"2205.01917","rows_on_this_dataset":1,"code_links":6,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":10,"samples_constructed":5,"samples_ran_checked":9,"samples_ran_instrument_failed":1,"samples_unverified":7,"pointer_only_for_licence":2,"official":null,"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/coca-contrastive-captioners-are-image-text#ran","syntology_url":"https://syntology.ai/paper/2205.01917","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.01917"}}}},{"paper":"/paper/sequencer-deep-lstm-for-image-classification","slug":"sequencer-deep-lstm-for-image-classification","title":"Sequencer: Deep LSTM for Image Classification","date":"2022-05-04","arxiv_id":"2205.01972","rows_on_this_dataset":1,"code_links":5,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":5,"pointer_only_for_licence":0,"official":{"repos":["okojoalg/sequencer","rwightman/pytorch-image-models"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":5,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/sequencer-deep-lstm-for-image-classification#ran","syntology_url":"https://syntology.ai/paper/2205.01972","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.01972"}}}},{"paper":"/paper/model-soups-averaging-weights-of-multiple","slug":"model-soups-averaging-weights-of-multiple","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","date":"2022-03-10","arxiv_id":"2203.05482","rows_on_this_dataset":2,"code_links":6,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":10,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":5,"samples_unverified":7,"pointer_only_for_licence":0,"official":{"repos":["mlfoundations/model-soups"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/model-soups-averaging-weights-of-multiple#ran","syntology_url":"https://syntology.ai/paper/2203.05482","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.05482"}}}},{"paper":"/paper/vision-models-are-more-robust-and-fair-when","slug":"vision-models-are-more-robust-and-fair-when","title":"Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision","date":"2022-02-16","arxiv_id":"2202.08360","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/a-convnet-for-the-2020s","slug":"a-convnet-for-the-2020s","title":"A ConvNet for the 2020s","date":"2022-01-10","arxiv_id":"2201.03545","rows_on_this_dataset":1,"code_links":54,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":80,"samples_ran":57,"samples_constructed":39,"samples_ran_checked":49,"samples_ran_instrument_failed":8,"samples_unverified":23,"pointer_only_for_licence":12,"official":{"repos":["facebookresearch/ConvNeXt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/a-convnet-for-the-2020s#ran","syntology_url":"https://syntology.ai/paper/2201.03545","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.03545"}}}},{"paper":"/paper/pyramid-adversarial-training-improves-vit","slug":"pyramid-adversarial-training-improves-vit","title":"Pyramid Adversarial Training Improves ViT Performance","date":"2021-11-30","arxiv_id":"2111.15121","rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/discrete-representations-strengthen-vision-1","slug":"discrete-representations-strengthen-vision-1","title":"Discrete Representations Strengthen Vision Transformer Robustness","date":"2021-11-20","arxiv_id":"2111.10493","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/combined-scaling-for-zero-shot-transfer","slug":"combined-scaling-for-zero-shot-transfer","title":"Combined Scaling for Zero-shot Transfer Learning","date":"2021-11-19","arxiv_id":"2111.10050","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/masked-autoencoders-are-scalable-vision","slug":"masked-autoencoders-are-scalable-vision","title":"Masked Autoencoders Are Scalable Vision Learners","date":"2021-11-11","arxiv_id":"2111.06377","rows_on_this_dataset":1,"code_links":58,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":137,"samples_ran":86,"samples_constructed":40,"samples_ran_checked":68,"samples_ran_instrument_failed":18,"samples_unverified":51,"pointer_only_for_licence":78,"official":{"repos":["facebookresearch/mae"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/masked-autoencoders-are-scalable-vision#ran","syntology_url":"https://syntology.ai/paper/2111.06377","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.06377"}}}}],"papers_where_code_ran":12,"papers_where_code_ran_first_page":"/dataset/imagenet-sketch/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/dataset/imagenet-sketch/papers/ran/1","json":"/dataset/imagenet-sketch/papers/ran/1.json","rows":12}],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":12,"samples_harvested":299,"samples_ran":194,"samples_constructed":92,"samples_ran_checked":159,"samples_ran_instrument_failed":35,"samples_unverified":105,"pointer_only_for_licence":101,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":12,"papers_with_a_run_with_no_instrument_failure":12,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":2,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/image-classification-on-imagenet-sketch","since_archive":"/sota/image-classification-on-imagenet-sketch#since-judged","papers_judged":2,"placed":0}]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"38645dc6feb67e6ec450a7e6539d3fa0a69104248b5480f445b2ee711d46a2f2","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}